2026-03-29 20:10:04 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-29 20:10:04 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-29 20:10:04 [motorway.uk] INFO: Batch mode enabled: batch 3/4
2026-03-29 20:10:04 [motorway.uk] INFO: Starting spider motorway.uk
2026-03-29 20:10:04 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-29 20:10:04 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-29 20:10:04 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-29 20:10:04 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-29 20:10:04 [scrapy.extensions.telnet] INFO: Telnet Password: 59b7ff04910e6efe
2026-03-29 20:10:04 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-29 20:10:05 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/motorway.uk/task_4_2026-03-29T20_10_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-29 20:10:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 20:10:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 20:10:05 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-29 20:10:05 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-29 20:10:05 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-29 20:10:05 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2122
2026-03-29 20:10:05 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:05 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-29 20:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-29 20:10:05 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-29 20:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-29 20:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-29 20:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-29 20:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-29 20:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-29 20:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-29 20:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-29 20:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-29 20:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-29 20:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-29 20:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-29 20:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-29 20:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-29 20:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-29 20:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-29 20:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-29 20:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-29 20:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-29 20:10:05 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-29 20:10:05 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-29 20:10:05 [scrapy.core.engine] INFO: Spider opened
2026-03-29 20:10:05 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-29 20:10:05 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6025
2026-03-29 20:10:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-29 20:10:05 [scrapy-playwright] INFO: Starting download handler
2026-03-29 20:10:05 [scrapy-playwright] INFO: Starting download handler
2026-03-29 20:10:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://pro.motorway.co.uk/api/login> (referer: None) ['zyte-api']
2026-03-29 20:10:13 [motorway.uk] INFO: Scrapy-formatted cookies: [{'name': 'access-token', 'value': 'eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJ2ZXJzaW9uIjoyLCJpZCI6ODQyOSwibmFtZSI6IlNhbmogS3Jpc2huYXNhbXkiLCJlbWFpbCI6ImluZm9Ac2tkaXJlY3QuY28udWsiLCJmZWF0dXJlcyI6eyJzZWxsZXJCYW5rU3RhdGVtZW50Ijp0cnVlLCJTRUxMRVJfUkVFTlRSWSI6dHJ1ZSwiRE9DVU1FTlRTX1BST0dSRVNTSVZFX1VQTE9BRCI6dHJ1ZSwiZG9jdW1lbnRDYXB0dXJlVjIiOmZhbHNlLCJwYXltZW50c01WUCI6ZmFsc2UsInBheW1lbnRzSGlkZVNlbGxlckJhbmtEZXRhaWxzIjpmYWxzZSwicGF5bWVudHNLWUMiOmZhbHNlLCJwYXltZW50c012cFRyYW5zYWN0aW9uU3RhdGVtZW50Ijp0cnVlLCJwYXltZW50c0ZlZUNvbGxlY3Rpb24iOmZhbHNlfSwiaGFzSW52b2ljZUFjY2VzcyI6dHJ1ZSwicGhvbmUiOiIwNzc4NzU3ODIxMSIsIm90cFBob25lIjpudWxsLCJwaG9uZUNvbmZpcm1lZEF0IjpudWxsLCJkZWFsZXJOYW1lIjoiUyBLIERpcmVjdCIsImRlYWxlcklzVHJhZGUiOmZhbHNlLCJwcmltYXJ5Q29udGFjdCI6dHJ1ZSwiZGVhbGVySWQiOjgyMjMsImRlYWxlclN0YXR1cyI6eyJzbHVnIjoiaW5hY3RpdmUiLCJiaWRkaW5nRW5hYmxlZCI6dHJ1ZX0sImxhdGl0dWRlIjo1MS42MDE4MTkxLCJsb25naXR1ZGUiOi0wLjY3NzYxNTgsInBvc3Rjb2RlIjoiSFAxMDBOTiIsInBhcnRuZXJzIjpbXSwicmVmcmVzaFRva2VuIjoiYmNkZDg5NDY2NTBjMWUwNWZlN2UxYmFlN2FmMjY1NDMwOWYyMTk1NTZlNzM5NzY0YmY5YTc0YWY1YjBlN2YyMyIsImlkZW50aXR5IjoiZXlKaGJHY2lPaUpJVXpJMU5pSXNJblI1Y0NJNklrcFhWQ0o5LmV5SnBaR1Z1ZEdsMGFXVnpJanBiZXlKbGJXRnBiQ0k2SW1sdVptOUFjMnRrYVhKbFkzUXVZMjh1ZFdzaUxDSmxlSEJwY21Weklqb2lNakF5Tmkwd05DMHlPRlF5TURveE1Eb3hNUzQxTnpSYUlpd2lhV1FpT2pnME1qa3NJblI1Y0dVaU9pSmtaV0ZzWlhJaUxDSndZWEowYm1WeWN5STZXMTE5WFN3aWFXRjBJam94TnpjME9ERTFNREV4ZlEuQ1hhU1JxWXNPX2ptUEdnZ1lRclVnc1k3RS0wQ01mY0t1MnFLU1hWQXIzSSIsImRlYWxlclBlcm1pc3Npb25zIjpbImludm9pY2luZyIsImt5YyJdLCJkZWFsZXJUaWVyIjoic2VsZi1zZXJ2ZSIsImlzc3VlZEF0IjoxNzc0ODE1MDExNTc0LCJpYXQiOjE3NzQ4MTUwMTEsImV4cCI6MTc3NDgxNTMxMX0.Id3AdPMqxiYrGJdwxmpXpriaHsgkqUfOZaUveshWMk8', 'domain': '.motorway.co.uk', 'path': '/'}, {'name': 'access-token', 'value': 'eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJ2ZXJzaW9uIjoyLCJpZCI6ODQyOSwibmFtZSI6IlNhbmogS3Jpc2huYXNhbXkiLCJlbWFpbCI6ImluZm9Ac2tkaXJlY3QuY28udWsiLCJmZWF0dXJlcyI6eyJzZWxsZXJCYW5rU3RhdGVtZW50Ijp0cnVlLCJTRUxMRVJfUkVFTlRSWSI6dHJ1ZSwiRE9DVU1FTlRTX1BST0dSRVNTSVZFX1VQTE9BRCI6dHJ1ZSwiZG9jdW1lbnRDYXB0dXJlVjIiOmZhbHNlLCJwYXltZW50c01WUCI6ZmFsc2UsInBheW1lbnRzSGlkZVNlbGxlckJhbmtEZXRhaWxzIjpmYWxzZSwicGF5bWVudHNLWUMiOmZhbHNlLCJwYXltZW50c012cFRyYW5zYWN0aW9uU3RhdGVtZW50Ijp0cnVlLCJwYXltZW50c0ZlZUNvbGxlY3Rpb24iOmZhbHNlfSwiaGFzSW52b2ljZUFjY2VzcyI6dHJ1ZSwicGhvbmUiOiIwNzc4NzU3ODIxMSIsIm90cFBob25lIjpudWxsLCJwaG9uZUNvbmZpcm1lZEF0IjpudWxsLCJkZWFsZXJOYW1lIjoiUyBLIERpcmVjdCIsImRlYWxlcklzVHJhZGUiOmZhbHNlLCJwcmltYXJ5Q29udGFjdCI6dHJ1ZSwiZGVhbGVySWQiOjgyMjMsImRlYWxlclN0YXR1cyI6eyJzbHVnIjoiaW5hY3RpdmUiLCJiaWRkaW5nRW5hYmxlZCI6dHJ1ZX0sImxhdGl0dWRlIjo1MS42MDE4MTkxLCJsb25naXR1ZGUiOi0wLjY3NzYxNTgsInBvc3Rjb2RlIjoiSFAxMDBOTiIsInBhcnRuZXJzIjpbXSwiaWRlbnRpdHkiOiJleUpoYkdjaU9pSklVekkxTmlJc0luUjVjQ0k2SWtwWFZDSjkuZXlKcFpHVnVkR2wwYVdWeklqcGJleUpwWkNJNk9EUXlPU3dpWlcxaGFXd2lPaUpwYm1adlFITnJaR2x5WldOMExtTnZMblZySWl3aWRIbHdaU0k2SW1SbFlXeGxjaUlzSW1WNGNHbHlaWE1pT2lJeU1ESTJMVEEwTFRJNFZESXdPakV3T2pFeExqYzRORm9pTENKd1lYSjBibVZ5Y3lJNlcxMTlYU3dpYVdGMElqb3hOemMwT0RFMU1ERXhmUS5GM1BFME9pVFdNYnFfTUItVGdJRUdnNVIwdGpCWEJycWdrbTkxcWxOS09vIiwiZGVhbGVyUGVybWlzc2lvbnMiOlsiaW52b2ljaW5nIiwia3ljIl0sInJlZnJlc2hUb2tlbiI6IjViMDJlNzY4MjIxZDYyOTFlYjA2NjQyM2Q0MmQwZTM1NzEyOGViOTdmODlmZjNhMjMxMWRjYzkwOTY4OWM3NzIiLCJkZWFsZXJUaWVyIjoic2VsZi1zZXJ2ZSIsImlzc3VlZEF0IjoxNzc0ODE1MDEyODEzLCJpYXQiOjE3NzQ4MTUwMTIsImV4cCI6MTc3NDgxNTMxMn0.vzE2LMW2CHPexUR2tN-zWJIIlYEQusJzgLlw9FJif6Y', 'domain': '.motorway.co.uk', 'path': '/'}]
2026-03-29 20:10:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk> (referer: https://pro.motorway.co.uk/api/login) ['zyte-api']
2026-03-29 20:10:16 [motorway.uk] INFO: Extracted Build ID: gL_OFaxoLv6tVLfo6F2-N
2026-03-29 20:10:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=buyItNow&loadedCount=0&page=0&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=0&page=0&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20210884
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 18349632
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718349632%27 HTTP/1.1" 200 None
2026-03-29 20:10:24 [motorway.uk] INFO: Scrape type for 18349632: 1
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20491343
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 19335779
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719335779%27 HTTP/1.1" 200 None
2026-03-29 20:10:24 [motorway.uk] INFO: Scrape type for 19335779: 1
2026-03-29 20:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20478384
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20420964
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 19293050
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719293050%27 HTTP/1.1" 200 None
2026-03-29 20:10:24 [motorway.uk] INFO: Scrape type for 19293050: 1
2026-03-29 20:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 11469561
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 16791811
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 16345921
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20501784
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20434421
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20406874
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20486638
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486638%27 HTTP/1.1" 200 None
2026-03-29 20:10:24 [motorway.uk] INFO: Scrape type for 20486638: 1
2026-03-29 20:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 15631500
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715631500%27 HTTP/1.1" 200 None
2026-03-29 20:10:24 [motorway.uk] INFO: Scrape type for 15631500: 1
2026-03-29 20:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 19204416
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719204416%27 HTTP/1.1" 200 None
2026-03-29 20:10:24 [motorway.uk] INFO: Scrape type for 19204416: 1
2026-03-29 20:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20462868
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20403112
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20380533
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720380533%27 HTTP/1.1" 200 None
2026-03-29 20:10:24 [motorway.uk] INFO: Scrape type for 20380533: 1
2026-03-29 20:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20438346
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 18341236
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 19960036
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719960036%27 HTTP/1.1" 200 None
2026-03-29 20:10:24 [motorway.uk] INFO: Scrape type for 19960036: 1
2026-03-29 20:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 19356442
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20217457
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720217457%27 HTTP/1.1" 200 None
2026-03-29 20:10:24 [motorway.uk] INFO: Scrape type for 20217457: 1
2026-03-29 20:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20183041
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720183041%27 HTTP/1.1" 200 None
2026-03-29 20:10:24 [motorway.uk] INFO: Scrape type for 20183041: 1
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 17833819
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 6235966
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 8799286
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 12116877
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712116877%27 HTTP/1.1" 200 None
2026-03-29 20:10:24 [motorway.uk] INFO: Scrape type for 12116877: 1
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20485059
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 14687227
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20371220
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20221411
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20482651
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 20414596
2026-03-29 20:10:24 [motorway.uk] INFO: Found listing with ID: 13957348
2026-03-29 20:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20380533.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e12bfd4c-78d2-5107-97bf-4d77eaec88da with identifier: 20380533
2026-03-29 20:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e12bfd4c-78d2-5107-97bf-4d77eaec88da with scrape type 1
2026-03-29 20:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e12bfd4c-78d2-5107-97bf-4d77eaec88da
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0533%252F20380533%252Fexterior_front_driver-1774176351224.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0533/20380533/exterior_front_driver-1774176351224.jpg not downloaded yet
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0533%252F20380533%252Fexterior_rear_driver-1774176399512.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0533/20380533/exterior_rear_driver-1774176399512.jpg not downloaded yet
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0533%252F20380533%252Fexterior_front_passenger-1774176493290.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0533/20380533/exterior_front_passenger-1774176493290.jpg not downloaded yet
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0533%252F20380533%252Fexterior_rear_passenger-1774176647677.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0533/20380533/exterior_rear_passenger-1774176647677.jpg not downloaded yet
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0533%252F20380533%252Finterior_front_seats-1774463069373.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0533/20380533/interior_front_seats-1774463069373.jpg not downloaded yet
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0533%252F20380533%252Finterior_rear_seats-1774633629979.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0533/20380533/interior_rear_seats-1774633629979.jpg not downloaded yet
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0533%252F20380533%252Finterior_dashboard-1774463131564.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0533/20380533/interior_dashboard-1774463131564.jpg not downloaded yet
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0533%252F20380533%252Finstrument_cluster-1774463172480.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0533/20380533/instrument_cluster-1774463172480.jpg not downloaded yet
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0533%252F20380533%252Finterior_boot-1774463212895.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0533/20380533/interior_boot-1774463212895.jpg not downloaded yet
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0533%252F20380533%252Fdocs_service_history-1774634178026.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da33123a6a937acc8a4f940050984c7da%27 HTTP/1.1" 200 None
2026-03-29 20:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0533/20380533/docs_service_history-1774634178026.jpg?ixlib=js-3.8.0&auto=format&s=a33123a6a937acc8a4f940050984c7da not downloaded yet
2026-03-29 20:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18349632.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:28 [motorway.uk] ERROR: Error parsing details
Traceback (most recent call last):
File "/usr/src/app/crawlers/spiders/motorway.py", line 262, in parse_details
item = self._extract_listing_item(detail_data, auction_type)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/motorway.py", line 290, in _extract_listing_item
trim = self._extract_trim(detail_data)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/motorway.py", line 476, in _extract_trim
.replace(model, "")
^^^^^^^^^^^^^^^^^^
TypeError: replace() argument 1 must be str, not None
2026-03-29 20:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0533/20380533/exterior_rear_driver-1774176399512.jpg> (referer: None)
2026-03-29 20:10:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-29 20:10:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-29 20:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e1b690>
2026-03-29 20:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e12bfd4c-78d2-5107-97bf-4d77eaec88da/e12bfd4c-78d2-5107-97bf-4d77eaec88da_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0533%252F20380533%252Fexterior_rear_driver-1774176399512.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0533/20380533/exterior_rear_driver-1774176399512.jpg saved to cache
2026-03-29 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e12bfd4c-78d2-5107-97bf-4d77eaec88da
2026-03-29 20:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0533/20380533/interior_front_seats-1774463069373.jpg> (referer: None)
2026-03-29 20:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0533/20380533/exterior_rear_passenger-1774176647677.jpg> (referer: None)
2026-03-29 20:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0533/20380533/docs_service_history-1774634178026.jpg?ixlib=js-3.8.0&auto=format&s=a33123a6a937acc8a4f940050984c7da> (referer: None)
2026-03-29 20:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0533/20380533/interior_boot-1774463212895.jpg> (referer: None)
2026-03-29 20:10:29 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item e12bfd4c-78d2-5107-97bf-4d77eaec88da due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:10:29 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item e12bfd4c-78d2-5107-97bf-4d77eaec88da due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:10:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e70450>
2026-03-29 20:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e12bfd4c-78d2-5107-97bf-4d77eaec88da/e12bfd4c-78d2-5107-97bf-4d77eaec88da_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0533%252F20380533%252Finterior_front_seats-1774463069373.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0533/20380533/interior_front_seats-1774463069373.jpg saved to cache
2026-03-29 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e12bfd4c-78d2-5107-97bf-4d77eaec88da
2026-03-29 20:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65998cc90>
2026-03-29 20:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e12bfd4c-78d2-5107-97bf-4d77eaec88da/e12bfd4c-78d2-5107-97bf-4d77eaec88da_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0533%252F20380533%252Fexterior_rear_passenger-1774176647677.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0533/20380533/exterior_rear_passenger-1774176647677.jpg saved to cache
2026-03-29 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e12bfd4c-78d2-5107-97bf-4d77eaec88da
2026-03-29 20:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19204416.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d6e990>
2026-03-29 20:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e12bfd4c-78d2-5107-97bf-4d77eaec88da/e12bfd4c-78d2-5107-97bf-4d77eaec88da_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0533%252F20380533%252Fdocs_service_history-1774634178026.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da33123a6a937acc8a4f940050984c7da') HTTP/1.1" 204 0
2026-03-29 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0533/20380533/docs_service_history-1774634178026.jpg?ixlib=js-3.8.0&auto=format&s=a33123a6a937acc8a4f940050984c7da saved to cache
2026-03-29 20:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e12bfd4c-78d2-5107-97bf-4d77eaec88da
2026-03-29 20:10:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599a5d50>
2026-03-29 20:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e12bfd4c-78d2-5107-97bf-4d77eaec88da/e12bfd4c-78d2-5107-97bf-4d77eaec88da_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0533%252F20380533%252Finterior_boot-1774463212895.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0533/20380533/interior_boot-1774463212895.jpg saved to cache
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e12bfd4c-78d2-5107-97bf-4d77eaec88da
2026-03-29 20:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20486638.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b1a00d4-64a7-5447-85fb-b6230d825303 with identifier: 19204416
2026-03-29 20:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b1a00d4-64a7-5447-85fb-b6230d825303 with scrape type 1
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4b1a00d4-64a7-5447-85fb-b6230d825303
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4416%252F19204416%252Fexterior_front_driver-1774548968173.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4416/19204416/exterior_front_driver-1774548968173.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4416%252F19204416%252Fexterior_rear_driver-1774548982719.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4416/19204416/exterior_rear_driver-1774548982719.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4416%252F19204416%252Fexterior_front_passenger-1774549011446.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4416/19204416/exterior_front_passenger-1774549011446.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4416%252F19204416%252Fexterior_rear_passenger-1774548996112.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4416/19204416/exterior_rear_passenger-1774548996112.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4416%252F19204416%252Finterior_front_seats-1774549138872.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4416/19204416/interior_front_seats-1774549138872.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4416%252F19204416%252Finterior_rear_seats-1774549147321.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4416/19204416/interior_rear_seats-1774549147321.jpg not downloaded yet
2026-03-29 20:10:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 067fe954-8df5-50d4-bc17-7652d40615f4 with identifier: 20486638
2026-03-29 20:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 067fe954-8df5-50d4-bc17-7652d40615f4 with scrape type 1
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 067fe954-8df5-50d4-bc17-7652d40615f4
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6638%252F20486638%252Fexterior_front_driver-1774699327589.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6638/20486638/exterior_front_driver-1774699327589.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4416%252F19204416%252Finterior_dashboard-1774628535257.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4416/19204416/interior_dashboard-1774628535257.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6638%252F20486638%252Fexterior_rear_driver-1774699327831.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6638/20486638/exterior_rear_driver-1774699327831.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4416%252F19204416%252Finstrument_cluster-1774549249312.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4416/19204416/instrument_cluster-1774549249312.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6638%252F20486638%252Fexterior_front_passenger-1774699331164.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6638/20486638/exterior_front_passenger-1774699331164.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4416%252F19204416%252Finterior_boot-1774628544527.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4416/19204416/interior_boot-1774628544527.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6638%252F20486638%252Fexterior_rear_passenger-1774699335203.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6638/20486638/exterior_rear_passenger-1774699335203.jpg not downloaded yet
2026-03-29 20:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0533/20380533/instrument_cluster-1774463172480.jpg> (referer: None)
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4416%252F19204416%252Fwheels_front_driver-1774549014206.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4416/19204416/wheels_front_driver-1774549014206.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6638%252F20486638%252Finterior_front_seats-1774699638592.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6638/20486638/interior_front_seats-1774699638592.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6638%252F20486638%252Finterior_rear_seats-1774699642146.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6638/20486638/interior_rear_seats-1774699642146.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6638%252F20486638%252Finterior_dashboard-1774701408053.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6638/20486638/interior_dashboard-1774701408053.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6638%252F20486638%252Finstrument_cluster-1774699628374.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6638/20486638/instrument_cluster-1774699628374.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6638%252F20486638%252Finterior_boot-1774701417491.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6638/20486638/interior_boot-1774701417491.jpg not downloaded yet
2026-03-29 20:10:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e46850>
2026-03-29 20:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e12bfd4c-78d2-5107-97bf-4d77eaec88da/e12bfd4c-78d2-5107-97bf-4d77eaec88da_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0533%252F20380533%252Finstrument_cluster-1774463172480.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0533/20380533/instrument_cluster-1774463172480.jpg saved to cache
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e12bfd4c-78d2-5107-97bf-4d77eaec88da
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6638%252F20486638%252Fdocs_service_history-1774699788576.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8a8e314f6619bc187bf08b0cb2b052d9%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6638/20486638/docs_service_history-1774699788576.jpg?ixlib=js-3.8.0&auto=format&s=8a8e314f6619bc187bf08b0cb2b052d9 not downloaded yet
2026-03-29 20:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19335779.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0533/20380533/interior_rear_seats-1774633629979.jpg> (referer: None)
2026-03-29 20:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4416/19204416/exterior_front_driver-1774548968173.jpg> (referer: None)
2026-03-29 20:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0533/20380533/interior_dashboard-1774463131564.jpg> (referer: None)
2026-03-29 20:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4416/19204416/exterior_front_passenger-1774549011446.jpg> (referer: None)
2026-03-29 20:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4416/19204416/exterior_rear_driver-1774548982719.jpg> (referer: None)
2026-03-29 20:10:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dafb102-27ce-5cf0-9103-45abfe322ad5 with identifier: 19335779
2026-03-29 20:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dafb102-27ce-5cf0-9103-45abfe322ad5 with scrape type 1
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9dafb102-27ce-5cf0-9103-45abfe322ad5
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5779%252F19335779%252Fexterior_front_driver-1774711800194.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5779/19335779/exterior_front_driver-1774711800194.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5779%252F19335779%252Fexterior_rear_driver-1774712171270.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5779/19335779/exterior_rear_driver-1774712171270.jpg not downloaded yet
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5779%252F19335779%252Fexterior_front_passenger-1774712144427.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5779/19335779/exterior_front_passenger-1774712144427.jpg not downloaded yet
2026-03-29 20:10:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fbc110>
2026-03-29 20:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e12bfd4c-78d2-5107-97bf-4d77eaec88da/e12bfd4c-78d2-5107-97bf-4d77eaec88da_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0533%252F20380533%252Finterior_rear_seats-1774633629979.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0533/20380533/interior_rear_seats-1774633629979.jpg saved to cache
2026-03-29 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e12bfd4c-78d2-5107-97bf-4d77eaec88da
2026-03-29 20:10:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ac5ad0>
2026-03-29 20:10:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b1a00d4-64a7-5447-85fb-b6230d825303/4b1a00d4-64a7-5447-85fb-b6230d825303_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4416%252F19204416%252Fexterior_front_driver-1774548968173.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4416/19204416/exterior_front_driver-1774548968173.jpg saved to cache
2026-03-29 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4b1a00d4-64a7-5447-85fb-b6230d825303
2026-03-29 20:10:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ae1190>
2026-03-29 20:10:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e12bfd4c-78d2-5107-97bf-4d77eaec88da/e12bfd4c-78d2-5107-97bf-4d77eaec88da_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0533%252F20380533%252Finterior_dashboard-1774463131564.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0533/20380533/interior_dashboard-1774463131564.jpg saved to cache
2026-03-29 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e12bfd4c-78d2-5107-97bf-4d77eaec88da
2026-03-29 20:10:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e12bfd4c-78d2-5107-97bf-4d77eaec88da, skipping ID generation
2026-03-29 20:10:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e12bfd4c-78d2-5107-97bf-4d77eaec88da with scrape type 1
2026-03-29 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e12bfd4c-78d2-5107-97bf-4d77eaec88da sending to next pipeline
2026-03-29 20:10:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e12bfd4c-78d2-5107-97bf-4d77eaec88da, identifier: 20380533
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5779%252F19335779%252Fexterior_rear_passenger-1774711867106.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5779/19335779/exterior_rear_passenger-1774711867106.jpg not downloaded yet
2026-03-29 20:10:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e12bfd4c-78d2-5107-97bf-4d77eaec88da with identifier: 20380533
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Beige HTTP/1.1" 200 None
2026-03-29 20:10:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel HTTP/1.1" 200 None
2026-03-29 20:10:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:10:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e12bfd4c-78d2-5107-97bf-4d77eaec88da with identifier: 20380533
2026-03-29 20:10:31 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e12bfd4c-78d2-5107-97bf-4d77eaec88da with identifier: 20380533 to the API
2026-03-29 20:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:10:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0533/20380533/interior_dashboard-1774463131564.jpg>
{'auction_title': '',
'category': None,
'color': 'Beige',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'e12bfd4c-78d2-5107-97bf-4d77eaec88da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CD51 MMO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20380533',
'listing': 'auction',
'location': 'Oxfordshire Abingdon',
'make': 'Volkswagen',
'model': 'Amarok',
'odometer': 55823,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12bfd4c-78d2-5107-97bf-4d77eaec88da/e12bfd4c-78d2-5107-97bf-4d77eaec88da_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1594601,
'Height': 2667,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0533/20380533/exterior_rear_driver-1774176399512.jpg',
'Width': 3556},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12bfd4c-78d2-5107-97bf-4d77eaec88da/e12bfd4c-78d2-5107-97bf-4d77eaec88da_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1458273,
'Height': 2514,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0533/20380533/exterior_rear_passenger-1774176647677.jpg',
'Width': 3352},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12bfd4c-78d2-5107-97bf-4d77eaec88da/e12bfd4c-78d2-5107-97bf-4d77eaec88da_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2662373,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0533/20380533/interior_front_seats-1774463069373.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12bfd4c-78d2-5107-97bf-4d77eaec88da/e12bfd4c-78d2-5107-97bf-4d77eaec88da_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2653139,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0533/20380533/interior_rear_seats-1774633629979.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12bfd4c-78d2-5107-97bf-4d77eaec88da/e12bfd4c-78d2-5107-97bf-4d77eaec88da_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3681292,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0533/20380533/interior_dashboard-1774463131564.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12bfd4c-78d2-5107-97bf-4d77eaec88da/e12bfd4c-78d2-5107-97bf-4d77eaec88da_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1707634,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0533/20380533/instrument_cluster-1774463172480.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12bfd4c-78d2-5107-97bf-4d77eaec88da/e12bfd4c-78d2-5107-97bf-4d77eaec88da_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4002451,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0533/20380533/interior_boot-1774463212895.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12bfd4c-78d2-5107-97bf-4d77eaec88da/e12bfd4c-78d2-5107-97bf-4d77eaec88da_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2557974,
'Height': 2994,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0533/20380533/docs_service_history-1774634178026.jpg?ixlib=js-3.8.0&auto=format&s=a33123a6a937acc8a4f940050984c7da',
'Width': 2178}],
'price': 23532,
'price_includes_vat': False,
'registration_date': '2019-03-01',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Amarok Highline V6 TDI 4MOT A',
'transmission': 'automatic',
'trim': 'Highline V6 TDI 4MOT A',
'vin': 'WV1ZZZ2HZJH030689',
'year': 2019}
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720380533%27 HTTP/1.1" 200 None
2026-03-29 20:10:32 [motorway.uk] INFO: Saving data for 20380533: {'created_time': 1774815032.291726, 'last_price_update_time': 1774815032.29174, 'auction_closing_time': 1774884600.0}
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20380533') HTTP/1.1" 204 0
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5779%252F19335779%252Finterior_front_seats-1774713054986.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5779/19335779/interior_front_seats-1774713054986.jpg not downloaded yet
2026-03-29 20:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=36&page=1&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5779%252F19335779%252Finterior_rear_seats-1774712782684.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5779/19335779/interior_rear_seats-1774712782684.jpg not downloaded yet
2026-03-29 20:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b353d0>
2026-03-29 20:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b1a00d4-64a7-5447-85fb-b6230d825303/4b1a00d4-64a7-5447-85fb-b6230d825303_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4416%252F19204416%252Fexterior_front_passenger-1774549011446.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4416/19204416/exterior_front_passenger-1774549011446.jpg saved to cache
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4b1a00d4-64a7-5447-85fb-b6230d825303
2026-03-29 20:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d7f3d0>
2026-03-29 20:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b1a00d4-64a7-5447-85fb-b6230d825303/4b1a00d4-64a7-5447-85fb-b6230d825303_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4416%252F19204416%252Fexterior_rear_driver-1774548982719.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4416/19204416/exterior_rear_driver-1774548982719.jpg saved to cache
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4b1a00d4-64a7-5447-85fb-b6230d825303
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5779%252F19335779%252Finterior_dashboard-1774712861179.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5779/19335779/interior_dashboard-1774712861179.jpg not downloaded yet
2026-03-29 20:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6638/20486638/interior_boot-1774701417491.jpg> (referer: None)
2026-03-29 20:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20217457.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20183041.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19960036.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19293050.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:32 [motorway.uk] INFO: Found listing with ID: 12213512
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712213512%27 HTTP/1.1" 200 None
2026-03-29 20:10:32 [motorway.uk] INFO: Scrape type for 12213512: 1
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5779%252F19335779%252Finstrument_cluster-1774715520405.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5779/19335779/instrument_cluster-1774715520405.jpg not downloaded yet
2026-03-29 20:10:32 [motorway.uk] INFO: Found listing with ID: 20488190
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488190%27 HTTP/1.1" 200 None
2026-03-29 20:10:32 [motorway.uk] INFO: Scrape type for 20488190: 1
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5779%252F19335779%252Finterior_boot-1774712989179.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5779/19335779/interior_boot-1774712989179.jpg not downloaded yet
2026-03-29 20:10:32 [motorway.uk] INFO: Found listing with ID: 20491954
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720491954%27 HTTP/1.1" 200 None
2026-03-29 20:10:32 [motorway.uk] INFO: Scrape type for 20491954: 1
2026-03-29 20:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6638/20486638/docs_service_history-1774699788576.jpg?ixlib=js-3.8.0&auto=format&s=8a8e314f6619bc187bf08b0cb2b052d9> (referer: None)
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5779%252F19335779%252Fdocs_service_history-1774714430576-1.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D83a519b31b330212ab30a3721fa809a6%27 HTTP/1.1" 200 None
2026-03-29 20:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5779/19335779/docs_service_history-1774714430576-1.jpeg?ixlib=js-3.8.0&auto=format&s=83a519b31b330212ab30a3721fa809a6 not downloaded yet
2026-03-29 20:10:32 [motorway.uk] INFO: Found listing with ID: 18395283
2026-03-29 20:10:32 [motorway.uk] INFO: Found listing with ID: 20007284
2026-03-29 20:10:32 [motorway.uk] INFO: Found listing with ID: 10801992
2026-03-29 20:10:32 [motorway.uk] INFO: Found listing with ID: 19925917
2026-03-29 20:10:32 [motorway.uk] INFO: Found listing with ID: 19874916
2026-03-29 20:10:32 [motorway.uk] INFO: Found listing with ID: 20226377
2026-03-29 20:10:32 [motorway.uk] INFO: Found listing with ID: 20343618
2026-03-29 20:10:32 [motorway.uk] INFO: Found listing with ID: 19943436
2026-03-29 20:10:32 [motorway.uk] INFO: Found listing with ID: 20452938
2026-03-29 20:10:32 [motorway.uk] INFO: Found listing with ID: 17257209
2026-03-29 20:10:32 [motorway.uk] INFO: Found listing with ID: 20481812
2026-03-29 20:10:32 [motorway.uk] INFO: Found listing with ID: 19560308
2026-03-29 20:10:32 [motorway.uk] INFO: Found listing with ID: 20485589
2026-03-29 20:10:32 [motorway.uk] INFO: Found listing with ID: 20425191
2026-03-29 20:10:32 [motorway.uk] INFO: Found listing with ID: 9396121
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279396121%27 HTTP/1.1" 200 None
2026-03-29 20:10:32 [motorway.uk] INFO: Scrape type for 9396121: 1
2026-03-29 20:10:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 19478931
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 20428242
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 20451701
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 20458099
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 15842916
2026-03-29 20:10:33 [motorway.uk] INFO: Found listing with ID: 20460677
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720460677%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [motorway.uk] INFO: Scrape type for 20460677: 1
2026-03-29 20:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658db0ad0>
2026-03-29 20:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_067fe954-8df5-50d4-bc17-7652d40615f4/067fe954-8df5-50d4-bc17-7652d40615f4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6638%252F20486638%252Finterior_boot-1774701417491.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6638/20486638/interior_boot-1774701417491.jpg saved to cache
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 067fe954-8df5-50d4-bc17-7652d40615f4
2026-03-29 20:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116 with identifier: 20217457
2026-03-29 20:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116 with scrape type 1
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7457%252F20217457%252Fexterior_front_driver-1774686941890.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7457/20217457/exterior_front_driver-1774686941890.jpg not downloaded yet
2026-03-29 20:10:33 [motorway.uk] ERROR: Error parsing details
Traceback (most recent call last):
File "/usr/src/app/crawlers/spiders/motorway.py", line 262, in parse_details
item = self._extract_listing_item(detail_data, auction_type)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/motorway.py", line 290, in _extract_listing_item
trim = self._extract_trim(detail_data)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/motorway.py", line 476, in _extract_trim
.replace(model, "")
^^^^^^^^^^^^^^^^^^
TypeError: replace() argument 1 must be str, not None
2026-03-29 20:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4c7bf66-1f74-57ea-9895-ab9ea9706f9d with identifier: 19960036
2026-03-29 20:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4c7bf66-1f74-57ea-9895-ab9ea9706f9d with scrape type 1
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f4c7bf66-1f74-57ea-9895-ab9ea9706f9d
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0036%252F19960036%252Fexterior_front_driver-1771924055965.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0036/19960036/exterior_front_driver-1771924055965.jpg already downloaded
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0036%252F19960036%252Fexterior_rear_driver-1771924084209.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0036/19960036/exterior_rear_driver-1771924084209.jpg already downloaded
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0036%252F19960036%252Fexterior_front_passenger-1771924117697.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0036/19960036/exterior_front_passenger-1771924117697.jpg already downloaded
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0036%252F19960036%252Fexterior_rear_passenger-1771924098387.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0036/19960036/exterior_rear_passenger-1771924098387.jpg already downloaded
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0036%252F19960036%252Finterior_front_seats-1772104194700.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0036/19960036/interior_front_seats-1772104194700.jpg already downloaded
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0036%252F19960036%252Finterior_rear_seats-1772459702370.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0036/19960036/interior_rear_seats-1772459702370.jpg already downloaded
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0036%252F19960036%252Finterior_dashboard-1772459745782.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0036/19960036/interior_dashboard-1772459745782.jpg already downloaded
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0036%252F19960036%252Finstrument_cluster-1772104361807.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0036/19960036/instrument_cluster-1772104361807.jpg already downloaded
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0036%252F19960036%252Finterior_boot-1772104258667.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0036/19960036/interior_boot-1772104258667.jpg already downloaded
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F0036%252F19960036%252Fdocs_service_history-1772460192856.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc2d5642b680beacb5d859e30ec8355a2%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/0036/19960036/docs_service_history-1772460192856.jpg?ixlib=js-3.8.0&auto=format&s=c2d5642b680beacb5d859e30ec8355a2 already downloaded
2026-03-29 20:10:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f4c7bf66-1f74-57ea-9895-ab9ea9706f9d, identifier: 19960036
2026-03-29 20:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb6853a6-2291-5175-ad37-11b527ab7e4f with identifier: 19293050
2026-03-29 20:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb6853a6-2291-5175-ad37-11b527ab7e4f with scrape type 1
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb6853a6-2291-5175-ad37-11b527ab7e4f
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3050%252F19293050%252Fexterior_front_driver-1774697717231.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3050/19293050/exterior_front_driver-1774697717231.jpg not downloaded yet
2026-03-29 20:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6638/20486638/instrument_cluster-1774699628374.jpg> (referer: None)
2026-03-29 20:10:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f4c7bf66-1f74-57ea-9895-ab9ea9706f9d with identifier: 19960036
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Black HTTP/1.1" 200 None
2026-03-29 20:10:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:10:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f4c7bf66-1f74-57ea-9895-ab9ea9706f9d with identifier: 19960036
2026-03-29 20:10:33 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f4c7bf66-1f74-57ea-9895-ab9ea9706f9d with identifier: 19960036 to the API
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:10:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:10:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19960036.json>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'f4c7bf66-1f74-57ea-9895-ab9ea9706f9d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WL12 YAN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19960036',
'listing': 'auction',
'location': 'Kent New Romney',
'make': 'Audi',
'model': 'SQ5',
'odometer': 36089,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/0036/19960036/exterior_front_driver-1771924055965.jpg',
'https://motorway-photos-redacted.imgix.net/0036/19960036/exterior_rear_driver-1771924084209.jpg',
'https://motorway-photos-redacted.imgix.net/0036/19960036/exterior_front_passenger-1771924117697.jpg',
'https://motorway-photos-redacted.imgix.net/0036/19960036/exterior_rear_passenger-1771924098387.jpg',
'https://motorway-photos.imgix.net/0036/19960036/interior_front_seats-1772104194700.jpg',
'https://motorway-photos.imgix.net/0036/19960036/interior_rear_seats-1772459702370.jpg',
'https://motorway-photos-redacted.imgix.net/0036/19960036/interior_dashboard-1772459745782.jpg',
'https://motorway-photos.imgix.net/0036/19960036/instrument_cluster-1772104361807.jpg',
'https://motorway-photos.imgix.net/0036/19960036/interior_boot-1772104258667.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/0036/19960036/docs_service_history-1772460192856.jpg?ixlib=js-3.8.0&auto=format&s=c2d5642b680beacb5d859e30ec8355a2'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bba53b-2426-5288-8359-2b162fe1860a/75bba53b-2426-5288-8359-2b162fe1860a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1784943,
'Height': 2386,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0036/19960036/exterior_front_driver-1771924055965.jpg',
'Width': 3181},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bba53b-2426-5288-8359-2b162fe1860a/75bba53b-2426-5288-8359-2b162fe1860a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2409734,
'Height': 2944,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0036/19960036/exterior_rear_driver-1771924084209.jpg',
'Width': 3925},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bba53b-2426-5288-8359-2b162fe1860a/75bba53b-2426-5288-8359-2b162fe1860a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1719804,
'Height': 2426,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0036/19960036/exterior_front_passenger-1771924117697.jpg',
'Width': 3234},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bba53b-2426-5288-8359-2b162fe1860a/75bba53b-2426-5288-8359-2b162fe1860a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2005006,
'Height': 2621,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0036/19960036/exterior_rear_passenger-1771924098387.jpg',
'Width': 3494},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bba53b-2426-5288-8359-2b162fe1860a/75bba53b-2426-5288-8359-2b162fe1860a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3123251,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0036/19960036/interior_front_seats-1772104194700.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bba53b-2426-5288-8359-2b162fe1860a/75bba53b-2426-5288-8359-2b162fe1860a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3051369,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0036/19960036/interior_rear_seats-1772459702370.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bba53b-2426-5288-8359-2b162fe1860a/75bba53b-2426-5288-8359-2b162fe1860a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1443448,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0036/19960036/interior_dashboard-1772459745782.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bba53b-2426-5288-8359-2b162fe1860a/75bba53b-2426-5288-8359-2b162fe1860a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2377403,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0036/19960036/instrument_cluster-1772104361807.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bba53b-2426-5288-8359-2b162fe1860a/75bba53b-2426-5288-8359-2b162fe1860a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3462296,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0036/19960036/interior_boot-1772104258667.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bba53b-2426-5288-8359-2b162fe1860a/75bba53b-2426-5288-8359-2b162fe1860a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3819231,
'Height': 3562,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/0036/19960036/docs_service_history-1772460192856.jpg?ixlib=js-3.8.0&auto=format&s=c2d5642b680beacb5d859e30ec8355a2',
'Width': 2066}],
'price': 37868,
'price_includes_vat': False,
'registration_date': '2022-01-14',
'seats_number': None,
'seller_name': None,
'title': 'Audi SQ5 TDI MHEV Quattro Auto',
'transmission': 'automatic',
'trim': 'TDI MHEV Quattro Auto',
'vin': 'WAUZZZFY0N2042899',
'year': 2022}
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719960036%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [motorway.uk] INFO: Saving data for 19960036: {'created_time': 1774815034.113779, 'last_price_update_time': 1774815034.11379, 'auction_closing_time': 1774884600.0}
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19960036') HTTP/1.1" 204 0
2026-03-29 20:10:34 [motorway.uk] INFO: Found listing with ID: 18909824
2026-03-29 20:10:34 [motorway.uk] INFO: Found listing with ID: 20468920
2026-03-29 20:10:34 [motorway.uk] INFO: Found listing with ID: 9709918
2026-03-29 20:10:34 [motorway.uk] INFO: Found listing with ID: 20449963
2026-03-29 20:10:34 [motorway.uk] INFO: Found listing with ID: 16442218
2026-03-29 20:10:34 [motorway.uk] INFO: Found listing with ID: 20468049
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720468049%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [motorway.uk] INFO: Scrape type for 20468049: 1
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7457%252F20217457%252Fexterior_rear_driver-1774686968245.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7457/20217457/exterior_rear_driver-1774686968245.jpg not downloaded yet
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3050%252F19293050%252Fexterior_rear_driver-1774696051591.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3050/19293050/exterior_rear_driver-1774696051591.jpg not downloaded yet
2026-03-29 20:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bfaed0>
2026-03-29 20:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_067fe954-8df5-50d4-bc17-7652d40615f4/067fe954-8df5-50d4-bc17-7652d40615f4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6638%252F20486638%252Fdocs_service_history-1774699788576.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8a8e314f6619bc187bf08b0cb2b052d9') HTTP/1.1" 204 0
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6638/20486638/docs_service_history-1774699788576.jpg?ixlib=js-3.8.0&auto=format&s=8a8e314f6619bc187bf08b0cb2b052d9 saved to cache
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 067fe954-8df5-50d4-bc17-7652d40615f4
2026-03-29 20:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4416/19204416/exterior_rear_passenger-1774548996112.jpg> (referer: None)
2026-03-29 20:10:34 [motorway.uk] INFO: Found listing with ID: 18710113
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718710113%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [motorway.uk] INFO: Scrape type for 18710113: 1
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7457%252F20217457%252Fexterior_front_passenger-1774687028707.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7457/20217457/exterior_front_passenger-1774687028707.jpg not downloaded yet
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3050%252F19293050%252Fexterior_front_passenger-1774696030094.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3050/19293050/exterior_front_passenger-1774696030094.jpg not downloaded yet
2026-03-29 20:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/12116877.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bfbd10>
2026-03-29 20:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_067fe954-8df5-50d4-bc17-7652d40615f4/067fe954-8df5-50d4-bc17-7652d40615f4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6638%252F20486638%252Finstrument_cluster-1774699628374.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6638/20486638/instrument_cluster-1774699628374.jpg saved to cache
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 067fe954-8df5-50d4-bc17-7652d40615f4
2026-03-29 20:10:34 [motorway.uk] INFO: Found listing with ID: 9721294
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279721294%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [motorway.uk] INFO: Scrape type for 9721294: 1
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7457%252F20217457%252Fexterior_rear_passenger-1774687090421.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7457/20217457/exterior_rear_passenger-1774687090421.jpg not downloaded yet
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3050%252F19293050%252Fexterior_rear_passenger-1774695963727.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3050/19293050/exterior_rear_passenger-1774695963727.jpg not downloaded yet
2026-03-29 20:10:34 [motorway.uk] INFO: Found listing with ID: 20454912
2026-03-29 20:10:34 [motorway.uk] INFO: Found listing with ID: 10856544
2026-03-29 20:10:34 [motorway.uk] INFO: Found listing with ID: 20471927
2026-03-29 20:10:34 [motorway.uk] INFO: Found listing with ID: 18459962
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718459962%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [motorway.uk] INFO: Scrape type for 18459962: 1
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7457%252F20217457%252Finterior_front_seats-1774687608083.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7457/20217457/interior_front_seats-1774687608083.jpg not downloaded yet
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3050%252F19293050%252Finterior_front_seats-1774696325326.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3050/19293050/interior_front_seats-1774696325326.jpg not downloaded yet
2026-03-29 20:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ac64d0>
2026-03-29 20:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b1a00d4-64a7-5447-85fb-b6230d825303/4b1a00d4-64a7-5447-85fb-b6230d825303_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4416%252F19204416%252Fexterior_rear_passenger-1774548996112.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4416/19204416/exterior_rear_passenger-1774548996112.jpg saved to cache
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4b1a00d4-64a7-5447-85fb-b6230d825303
2026-03-29 20:10:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b365b4b7-aa27-5f15-8f73-132a32405397 with identifier: 12116877
2026-03-29 20:10:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b365b4b7-aa27-5f15-8f73-132a32405397 with scrape type 1
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b365b4b7-aa27-5f15-8f73-132a32405397
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6877%252F12116877%252F12116877-exterior_front_driver-default-1774613153500.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6877/12116877/12116877-exterior_front_driver-default-1774613153500.jpg not downloaded yet
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7457%252F20217457%252Finterior_rear_seats-1774687625917.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7457/20217457/interior_rear_seats-1774687625917.jpg not downloaded yet
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3050%252F19293050%252Finterior_rear_seats-1774697047392.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3050/19293050/interior_rear_seats-1774697047392.jpg not downloaded yet
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6877%252F12116877%252F12116877-exterior_rear_driver-default-1774613152286.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6877/12116877/12116877-exterior_rear_driver-default-1774613152286.jpg not downloaded yet
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7457%252F20217457%252Finterior_dashboard-1774709395991.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7457/20217457/interior_dashboard-1774709395991.jpg not downloaded yet
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3050%252F19293050%252Finterior_dashboard-1774697182134.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3050/19293050/interior_dashboard-1774697182134.jpg not downloaded yet
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6877%252F12116877%252F12116877-exterior_front_passenger-default-1774613154526.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6877/12116877/12116877-exterior_front_passenger-default-1774613154526.jpg not downloaded yet
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7457%252F20217457%252Finterior_boot-1774709428382.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7457/20217457/interior_boot-1774709428382.jpg not downloaded yet
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3050%252F19293050%252Finstrument_cluster-1774696523954.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3050/19293050/instrument_cluster-1774696523954.jpg not downloaded yet
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6877%252F12116877%252F12116877-exterior_rear_passenger-default-1774613157530.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6877/12116877/12116877-exterior_rear_passenger-default-1774613157530.jpg not downloaded yet
2026-03-29 20:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4416/19204416/interior_boot-1774628544527.jpg> (referer: None)
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7457%252F20217457%252Fdocs_service_history-1774705575567.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7f6606015ed6b357d260f67699055c42%27 HTTP/1.1" 200 None
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7457/20217457/docs_service_history-1774705575567.jpg?ixlib=js-3.8.0&auto=format&s=7f6606015ed6b357d260f67699055c42 not downloaded yet
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3050%252F19293050%252Finterior_boot-1774696436186.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3050/19293050/interior_boot-1774696436186.jpg not downloaded yet
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6877%252F12116877%252F12116877-interior_front_seats-default-1774613147185.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6877/12116877/12116877-interior_front_seats-default-1774613147185.jpg not downloaded yet
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7457%252F20217457%252Fwheels_front_driver-1774687133655.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7457/20217457/wheels_front_driver-1774687133655.jpg not downloaded yet
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3050%252F19293050%252Fdocs_service_history-1774696534227.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D95e8a79f477491337483948dd39060c6%27 HTTP/1.1" 200 None
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3050/19293050/docs_service_history-1774696534227.jpg?ixlib=js-3.8.0&auto=format&s=95e8a79f477491337483948dd39060c6 not downloaded yet
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6877%252F12116877%252F12116877-interior_rear_seats-default-1774613149313.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6877/12116877/12116877-interior_rear_seats-default-1774613149313.jpg not downloaded yet
2026-03-29 20:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4416/19204416/interior_front_seats-1774549138872.jpg> (referer: None)
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6877%252F12116877%252F12116877-interior_dashboard-default-1774613168322.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6877/12116877/12116877-interior_dashboard-default-1774613168322.jpg not downloaded yet
2026-03-29 20:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5779/19335779/exterior_rear_passenger-1774711867106.jpg> (referer: None)
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b19990>
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b1a00d4-64a7-5447-85fb-b6230d825303/4b1a00d4-64a7-5447-85fb-b6230d825303_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4416%252F19204416%252Finterior_boot-1774628544527.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4416/19204416/interior_boot-1774628544527.jpg saved to cache
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4b1a00d4-64a7-5447-85fb-b6230d825303
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6877%252F12116877%252F12116877-instrument_cluster-default-1774613287291.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6877/12116877/12116877-instrument_cluster-default-1774613287291.jpg not downloaded yet
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6877%252F12116877%252F12116877-interior_boot-default-1774613152403.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6877/12116877/12116877-interior_boot-default-1774613152403.jpg not downloaded yet
2026-03-29 20:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5779/19335779/exterior_rear_driver-1774712171270.jpg> (referer: None)
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252F6877%252F12116877%252Fdocs_service_history-1764270478644.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D25a23eaf6a9d3b02b5261cd06bb579bc%27 HTTP/1.1" 200 None
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/6877/12116877/docs_service_history-1764270478644.jpeg?ixlib=js-3.8.0&auto=format&s=25a23eaf6a9d3b02b5261cd06bb579bc not downloaded yet
2026-03-29 20:10:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b59790>
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b1a00d4-64a7-5447-85fb-b6230d825303/4b1a00d4-64a7-5447-85fb-b6230d825303_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4416%252F19204416%252Finterior_front_seats-1774549138872.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4416/19204416/interior_front_seats-1774549138872.jpg saved to cache
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4b1a00d4-64a7-5447-85fb-b6230d825303
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659cc11d0>
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dafb102-27ce-5cf0-9103-45abfe322ad5/9dafb102-27ce-5cf0-9103-45abfe322ad5_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5779%252F19335779%252Fexterior_rear_passenger-1774711867106.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5779/19335779/exterior_rear_passenger-1774711867106.jpg saved to cache
2026-03-29 20:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9dafb102-27ce-5cf0-9103-45abfe322ad5
2026-03-29 20:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6638/20486638/interior_dashboard-1774701408053.jpg> (referer: None)
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ff8910>
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dafb102-27ce-5cf0-9103-45abfe322ad5/9dafb102-27ce-5cf0-9103-45abfe322ad5_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5779%252F19335779%252Fexterior_rear_driver-1774712171270.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5779/19335779/exterior_rear_driver-1774712171270.jpg saved to cache
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9dafb102-27ce-5cf0-9103-45abfe322ad5
2026-03-29 20:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5779/19335779/exterior_front_passenger-1774712144427.jpg> (referer: None)
2026-03-29 20:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15631500.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6590156d0>
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_067fe954-8df5-50d4-bc17-7652d40615f4/067fe954-8df5-50d4-bc17-7652d40615f4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6638%252F20486638%252Finterior_dashboard-1774701408053.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6638/20486638/interior_dashboard-1774701408053.jpg saved to cache
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 067fe954-8df5-50d4-bc17-7652d40615f4
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bc0510>
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dafb102-27ce-5cf0-9103-45abfe322ad5/9dafb102-27ce-5cf0-9103-45abfe322ad5_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5779%252F19335779%252Fexterior_front_passenger-1774712144427.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5779/19335779/exterior_front_passenger-1774712144427.jpg saved to cache
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9dafb102-27ce-5cf0-9103-45abfe322ad5
2026-03-29 20:10:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfd07963-cd21-5e48-8be8-c96460602a87 with identifier: 15631500
2026-03-29 20:10:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfd07963-cd21-5e48-8be8-c96460602a87 with scrape type 1
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cfd07963-cd21-5e48-8be8-c96460602a87
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1500%252F15631500%252Fexterior_front_driver-1754576695585.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1500/15631500/exterior_front_driver-1754576695585.jpeg not downloaded yet
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1500%252F15631500%252Fexterior_rear_driver-1754576732522.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1500/15631500/exterior_rear_driver-1754576732522.jpeg not downloaded yet
2026-03-29 20:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/6877/12116877/docs_service_history-1764270478644.jpeg?ixlib=js-3.8.0&auto=format&s=25a23eaf6a9d3b02b5261cd06bb579bc> (referer: None)
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1500%252F15631500%252Fexterior_front_passenger-1754576714647.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1500/15631500/exterior_front_passenger-1754576714647.jpeg not downloaded yet
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1500%252F15631500%252Fexterior_rear_passenger-1754576724870.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1500/15631500/exterior_rear_passenger-1754576724870.jpeg not downloaded yet
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1500%252F15631500%252Finterior_front_seats-1754576774593.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1500/15631500/interior_front_seats-1754576774593.jpeg not downloaded yet
2026-03-29 20:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3050/19293050/exterior_front_driver-1774697717231.jpg> (referer: None)
2026-03-29 20:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5779/19335779/exterior_front_driver-1774711800194.jpg> (referer: None)
2026-03-29 20:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5779/19335779/interior_dashboard-1774712861179.jpg> (referer: None)
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1500%252F15631500%252Finterior_rear_seats-1754576820780.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1500/15631500/interior_rear_seats-1754576820780.jpeg not downloaded yet
2026-03-29 20:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5779/19335779/interior_front_seats-1774713054986.jpg> (referer: None)
2026-03-29 20:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6877/12116877/12116877-exterior_rear_passenger-default-1774613157530.jpg> (referer: None)
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1500%252F15631500%252F15631500-interior_dashboard-default-1774711371542.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1500/15631500/15631500-interior_dashboard-default-1774711371542.jpg not downloaded yet
2026-03-29 20:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6638/20486638/interior_rear_seats-1774699642146.jpg> (referer: None)
2026-03-29 20:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3050/19293050/exterior_front_passenger-1774696030094.jpg> (referer: None)
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1500%252F15631500%252F15631500-interior_boot-default-1774711352683.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1500/15631500/15631500-interior_boot-default-1774711352683.jpg not downloaded yet
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F1500%252F15631500%252Fdocs_service_history-1754577859603-1.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D04f6a0fa60d6f578a97e3abde21eb724%27 HTTP/1.1" 200 None
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/1500/15631500/docs_service_history-1754577859603-1.jpeg?ixlib=js-3.8.0&auto=format&s=04f6a0fa60d6f578a97e3abde21eb724 not downloaded yet
2026-03-29 20:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7457/20217457/exterior_front_passenger-1774687028707.jpg> (referer: None)
2026-03-29 20:10:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65902b550>
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b365b4b7-aa27-5f15-8f73-132a32405397/b365b4b7-aa27-5f15-8f73-132a32405397_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252F6877%252F12116877%252Fdocs_service_history-1764270478644.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D25a23eaf6a9d3b02b5261cd06bb579bc') HTTP/1.1" 204 0
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/6877/12116877/docs_service_history-1764270478644.jpeg?ixlib=js-3.8.0&auto=format&s=25a23eaf6a9d3b02b5261cd06bb579bc saved to cache
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b365b4b7-aa27-5f15-8f73-132a32405397
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1500%252F15631500%252Fwheels_front_driver-1754576885551.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1500/15631500/wheels_front_driver-1754576885551.jpeg not downloaded yet
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599a70d0>
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb6853a6-2291-5175-ad37-11b527ab7e4f/bb6853a6-2291-5175-ad37-11b527ab7e4f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3050%252F19293050%252Fexterior_front_driver-1774697717231.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3050/19293050/exterior_front_driver-1774697717231.jpg saved to cache
2026-03-29 20:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb6853a6-2291-5175-ad37-11b527ab7e4f
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a9ef10>
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dafb102-27ce-5cf0-9103-45abfe322ad5/9dafb102-27ce-5cf0-9103-45abfe322ad5_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5779%252F19335779%252Fexterior_front_driver-1774711800194.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5779/19335779/exterior_front_driver-1774711800194.jpg saved to cache
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9dafb102-27ce-5cf0-9103-45abfe322ad5
2026-03-29 20:10:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e47d50>
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dafb102-27ce-5cf0-9103-45abfe322ad5/9dafb102-27ce-5cf0-9103-45abfe322ad5_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5779%252F19335779%252Finterior_dashboard-1774712861179.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5779/19335779/interior_dashboard-1774712861179.jpg saved to cache
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9dafb102-27ce-5cf0-9103-45abfe322ad5
2026-03-29 20:10:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65999c750>
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dafb102-27ce-5cf0-9103-45abfe322ad5/9dafb102-27ce-5cf0-9103-45abfe322ad5_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5779%252F19335779%252Finterior_front_seats-1774713054986.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5779/19335779/interior_front_seats-1774713054986.jpg saved to cache
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9dafb102-27ce-5cf0-9103-45abfe322ad5
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e864d0>
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b365b4b7-aa27-5f15-8f73-132a32405397/b365b4b7-aa27-5f15-8f73-132a32405397_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6877%252F12116877%252F12116877-exterior_rear_passenger-default-1774613157530.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6877/12116877/12116877-exterior_rear_passenger-default-1774613157530.jpg saved to cache
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b365b4b7-aa27-5f15-8f73-132a32405397
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d74b50>
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_067fe954-8df5-50d4-bc17-7652d40615f4/067fe954-8df5-50d4-bc17-7652d40615f4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6638%252F20486638%252Finterior_rear_seats-1774699642146.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6638/20486638/interior_rear_seats-1774699642146.jpg saved to cache
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 067fe954-8df5-50d4-bc17-7652d40615f4
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65bf14a90>
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb6853a6-2291-5175-ad37-11b527ab7e4f/bb6853a6-2291-5175-ad37-11b527ab7e4f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3050%252F19293050%252Fexterior_front_passenger-1774696030094.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3050/19293050/exterior_front_passenger-1774696030094.jpg saved to cache
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb6853a6-2291-5175-ad37-11b527ab7e4f
2026-03-29 20:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5779/19335779/interior_rear_seats-1774712782684.jpg> (referer: None)
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65901dd10>
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116/a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7457%252F20217457%252Fexterior_front_passenger-1774687028707.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7457/20217457/exterior_front_passenger-1774687028707.jpg saved to cache
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116
2026-03-29 20:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3050/19293050/docs_service_history-1774696534227.jpg?ixlib=js-3.8.0&auto=format&s=95e8a79f477491337483948dd39060c6> (referer: None)
2026-03-29 20:10:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586d0e50>
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dafb102-27ce-5cf0-9103-45abfe322ad5/9dafb102-27ce-5cf0-9103-45abfe322ad5_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5779%252F19335779%252Finterior_rear_seats-1774712782684.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5779/19335779/interior_rear_seats-1774712782684.jpg saved to cache
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9dafb102-27ce-5cf0-9103-45abfe322ad5
2026-03-29 20:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/1500/15631500/docs_service_history-1754577859603-1.jpeg?ixlib=js-3.8.0&auto=format&s=04f6a0fa60d6f578a97e3abde21eb724> (referer: None)
2026-03-29 20:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6877/12116877/12116877-instrument_cluster-default-1774613287291.jpg> (referer: None)
2026-03-29 20:10:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e4f190>
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb6853a6-2291-5175-ad37-11b527ab7e4f/bb6853a6-2291-5175-ad37-11b527ab7e4f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3050%252F19293050%252Fdocs_service_history-1774696534227.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D95e8a79f477491337483948dd39060c6') HTTP/1.1" 204 0
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3050/19293050/docs_service_history-1774696534227.jpg?ixlib=js-3.8.0&auto=format&s=95e8a79f477491337483948dd39060c6 saved to cache
2026-03-29 20:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bb6853a6-2291-5175-ad37-11b527ab7e4f
2026-03-29 20:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6877/12116877/12116877-interior_boot-default-1774613152403.jpg> (referer: None)
2026-03-29 20:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6877/12116877/12116877-interior_dashboard-default-1774613168322.jpg> (referer: None)
2026-03-29 20:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1500/15631500/exterior_rear_driver-1754576732522.jpeg> (referer: None)
2026-03-29 20:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1500/15631500/exterior_rear_passenger-1754576724870.jpeg> (referer: None)
2026-03-29 20:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1500/15631500/exterior_front_passenger-1754576714647.jpeg> (referer: None)
2026-03-29 20:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6877/12116877/12116877-interior_rear_seats-default-1774613149313.jpg> (referer: None)
2026-03-29 20:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1500/15631500/exterior_front_driver-1754576695585.jpeg> (referer: None)
2026-03-29 20:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1500/15631500/15631500-interior_dashboard-default-1774711371542.jpg> (referer: None)
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fd1dd0>
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfd07963-cd21-5e48-8be8-c96460602a87/cfd07963-cd21-5e48-8be8-c96460602a87_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F1500%252F15631500%252Fdocs_service_history-1754577859603-1.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D04f6a0fa60d6f578a97e3abde21eb724') HTTP/1.1" 204 0
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/1500/15631500/docs_service_history-1754577859603-1.jpeg?ixlib=js-3.8.0&auto=format&s=04f6a0fa60d6f578a97e3abde21eb724 saved to cache
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cfd07963-cd21-5e48-8be8-c96460602a87
2026-03-29 20:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1500/15631500/15631500-interior_boot-default-1774711352683.jpg> (referer: None)
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b69050>
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b365b4b7-aa27-5f15-8f73-132a32405397/b365b4b7-aa27-5f15-8f73-132a32405397_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6877%252F12116877%252F12116877-instrument_cluster-default-1774613287291.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6877/12116877/12116877-instrument_cluster-default-1774613287291.jpg saved to cache
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b365b4b7-aa27-5f15-8f73-132a32405397
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658da7910>
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b365b4b7-aa27-5f15-8f73-132a32405397/b365b4b7-aa27-5f15-8f73-132a32405397_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6877%252F12116877%252F12116877-interior_boot-default-1774613152403.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6877/12116877/12116877-interior_boot-default-1774613152403.jpg saved to cache
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b365b4b7-aa27-5f15-8f73-132a32405397
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a396d0>
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b365b4b7-aa27-5f15-8f73-132a32405397/b365b4b7-aa27-5f15-8f73-132a32405397_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6877%252F12116877%252F12116877-interior_dashboard-default-1774613168322.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6877/12116877/12116877-interior_dashboard-default-1774613168322.jpg saved to cache
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b365b4b7-aa27-5f15-8f73-132a32405397
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e2e8d0>
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfd07963-cd21-5e48-8be8-c96460602a87/cfd07963-cd21-5e48-8be8-c96460602a87_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1500%252F15631500%252Fexterior_rear_driver-1754576732522.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1500/15631500/exterior_rear_driver-1754576732522.jpeg saved to cache
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cfd07963-cd21-5e48-8be8-c96460602a87
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b68390>
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfd07963-cd21-5e48-8be8-c96460602a87/cfd07963-cd21-5e48-8be8-c96460602a87_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1500%252F15631500%252Fexterior_rear_passenger-1754576724870.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1500/15631500/exterior_rear_passenger-1754576724870.jpeg saved to cache
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cfd07963-cd21-5e48-8be8-c96460602a87
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e2da50>
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfd07963-cd21-5e48-8be8-c96460602a87/cfd07963-cd21-5e48-8be8-c96460602a87_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1500%252F15631500%252Fexterior_front_passenger-1754576714647.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1500/15631500/exterior_front_passenger-1754576714647.jpeg saved to cache
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cfd07963-cd21-5e48-8be8-c96460602a87
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e2e2d0>
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b365b4b7-aa27-5f15-8f73-132a32405397/b365b4b7-aa27-5f15-8f73-132a32405397_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6877%252F12116877%252F12116877-interior_rear_seats-default-1774613149313.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6877/12116877/12116877-interior_rear_seats-default-1774613149313.jpg saved to cache
2026-03-29 20:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b365b4b7-aa27-5f15-8f73-132a32405397
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a396d0>
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfd07963-cd21-5e48-8be8-c96460602a87/cfd07963-cd21-5e48-8be8-c96460602a87_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1500%252F15631500%252Fexterior_front_driver-1754576695585.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1500/15631500/exterior_front_driver-1754576695585.jpeg saved to cache
2026-03-29 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cfd07963-cd21-5e48-8be8-c96460602a87
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b0b210>
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfd07963-cd21-5e48-8be8-c96460602a87/cfd07963-cd21-5e48-8be8-c96460602a87_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1500%252F15631500%252F15631500-interior_dashboard-default-1774711371542.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1500/15631500/15631500-interior_dashboard-default-1774711371542.jpg saved to cache
2026-03-29 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cfd07963-cd21-5e48-8be8-c96460602a87
2026-03-29 20:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1500/15631500/wheels_front_driver-1754576885551.jpeg> (referer: None)
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b85c50>
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfd07963-cd21-5e48-8be8-c96460602a87/cfd07963-cd21-5e48-8be8-c96460602a87_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1500%252F15631500%252F15631500-interior_boot-default-1774711352683.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1500/15631500/15631500-interior_boot-default-1774711352683.jpg saved to cache
2026-03-29 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cfd07963-cd21-5e48-8be8-c96460602a87
2026-03-29 20:10:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1500/15631500/interior_rear_seats-1754576820780.jpeg> (referer: None)
2026-03-29 20:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1500/15631500/interior_front_seats-1754576774593.jpeg> (referer: None)
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659abcfd0>
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfd07963-cd21-5e48-8be8-c96460602a87/cfd07963-cd21-5e48-8be8-c96460602a87_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1500%252F15631500%252Fwheels_front_driver-1754576885551.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1500/15631500/wheels_front_driver-1754576885551.jpeg saved to cache
2026-03-29 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cfd07963-cd21-5e48-8be8-c96460602a87
2026-03-29 20:10:39 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:10:39 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:10:39 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00(\xbb\xd9\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x18V\x00(\xb1\xc9\x00\x00\x00\x00'
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d8b090>
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfd07963-cd21-5e48-8be8-c96460602a87/cfd07963-cd21-5e48-8be8-c96460602a87_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1500%252F15631500%252Finterior_rear_seats-1754576820780.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1500/15631500/interior_rear_seats-1754576820780.jpeg saved to cache
2026-03-29 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cfd07963-cd21-5e48-8be8-c96460602a87
2026-03-29 20:10:39 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:10:39 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:10:39 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b"\x00\x03\x00\x00\x00'\xe7\xd4\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02=D\x00'\xdd\xc4\x00\x00\x00\x00"
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bc9c10>
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfd07963-cd21-5e48-8be8-c96460602a87/cfd07963-cd21-5e48-8be8-c96460602a87_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1500%252F15631500%252Finterior_front_seats-1754576774593.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1500/15631500/interior_front_seats-1754576774593.jpeg saved to cache
2026-03-29 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cfd07963-cd21-5e48-8be8-c96460602a87
2026-03-29 20:10:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cfd07963-cd21-5e48-8be8-c96460602a87, skipping ID generation
2026-03-29 20:10:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfd07963-cd21-5e48-8be8-c96460602a87 with scrape type 1
2026-03-29 20:10:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cfd07963-cd21-5e48-8be8-c96460602a87 sending to next pipeline
2026-03-29 20:10:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: cfd07963-cd21-5e48-8be8-c96460602a87, identifier: 15631500
2026-03-29 20:10:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: cfd07963-cd21-5e48-8be8-c96460602a87 with identifier: 15631500
2026-03-29 20:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Blue HTTP/1.1" 200 None
2026-03-29 20:10:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol HTTP/1.1" 200 None
2026-03-29 20:10:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:10:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: cfd07963-cd21-5e48-8be8-c96460602a87 with identifier: 15631500
2026-03-29 20:10:40 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: cfd07963-cd21-5e48-8be8-c96460602a87 with identifier: 15631500 to the API
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:10:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/1500/15631500/interior_front_seats-1754576774593.jpeg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '5.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'cfd07963-cd21-5e48-8be8-c96460602a87',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DE17 WEY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/15631500',
'listing': 'auction',
'location': 'Hampshire Bordon',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 49500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfd07963-cd21-5e48-8be8-c96460602a87/cfd07963-cd21-5e48-8be8-c96460602a87_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1588984,
'Height': 2378,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1500/15631500/exterior_front_driver-1754576695585.jpeg',
'Width': 3171},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfd07963-cd21-5e48-8be8-c96460602a87/cfd07963-cd21-5e48-8be8-c96460602a87_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1763414,
'Height': 2502,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1500/15631500/exterior_rear_driver-1754576732522.jpeg',
'Width': 3336},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfd07963-cd21-5e48-8be8-c96460602a87/cfd07963-cd21-5e48-8be8-c96460602a87_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1739012,
'Height': 2402,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1500/15631500/exterior_front_passenger-1754576714647.jpeg',
'Width': 3203},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfd07963-cd21-5e48-8be8-c96460602a87/cfd07963-cd21-5e48-8be8-c96460602a87_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1857674,
'Height': 2545,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1500/15631500/exterior_rear_passenger-1754576724870.jpeg',
'Width': 3393},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfd07963-cd21-5e48-8be8-c96460602a87/cfd07963-cd21-5e48-8be8-c96460602a87_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2762008,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1500/15631500/interior_front_seats-1754576774593.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfd07963-cd21-5e48-8be8-c96460602a87/cfd07963-cd21-5e48-8be8-c96460602a87_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2806831,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1500/15631500/interior_rear_seats-1754576820780.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfd07963-cd21-5e48-8be8-c96460602a87/cfd07963-cd21-5e48-8be8-c96460602a87_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1738427,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1500/15631500/15631500-interior_dashboard-default-1774711371542.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfd07963-cd21-5e48-8be8-c96460602a87/cfd07963-cd21-5e48-8be8-c96460602a87_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2017273,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1500/15631500/15631500-interior_boot-default-1774711352683.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfd07963-cd21-5e48-8be8-c96460602a87/cfd07963-cd21-5e48-8be8-c96460602a87_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111788,
'Height': 1263,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/1500/15631500/docs_service_history-1754577859603-1.jpeg?ixlib=js-3.8.0&auto=format&s=04f6a0fa60d6f578a97e3abde21eb724',
'Width': 892},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfd07963-cd21-5e48-8be8-c96460602a87/cfd07963-cd21-5e48-8be8-c96460602a87_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1663420,
'Height': 2599,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1500/15631500/wheels_front_driver-1754576885551.jpeg',
'Width': 3465}],
'price': 36602,
'price_includes_vat': False,
'registration_date': '2018-10-11',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Range Rover Sport SVR S/C Auto',
'transmission': 'automatic',
'trim': 'Sport SVR S/C Auto',
'vin': 'SALWA2AE1KA820459',
'year': 2018}
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715631500%27 HTTP/1.1" 200 None
2026-03-29 20:10:40 [motorway.uk] INFO: Saving data for 15631500: {'created_time': 1774815040.6155, 'last_price_update_time': 1774815040.615511, 'auction_closing_time': 1774884600.0}
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='15631500') HTTP/1.1" 204 0
2026-03-29 20:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7457/20217457/interior_boot-1774709428382.jpg> (referer: None)
2026-03-29 20:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7457/20217457/docs_service_history-1774705575567.jpg?ixlib=js-3.8.0&auto=format&s=7f6606015ed6b357d260f67699055c42> (referer: None)
2026-03-29 20:10:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7457/20217457/wheels_front_driver-1774687133655.jpg> (referer: None)
2026-03-29 20:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6877/12116877/12116877-exterior_rear_driver-default-1774613152286.jpg> (referer: None)
2026-03-29 20:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3050/19293050/interior_dashboard-1774697182134.jpg> (referer: None)
2026-03-29 20:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6877/12116877/12116877-interior_front_seats-default-1774613147185.jpg> (referer: None)
2026-03-29 20:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3050/19293050/interior_rear_seats-1774697047392.jpg> (referer: None)
2026-03-29 20:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7457/20217457/interior_rear_seats-1774687625917.jpg> (referer: None)
2026-03-29 20:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3050/19293050/instrument_cluster-1774696523954.jpg> (referer: None)
2026-03-29 20:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6877/12116877/12116877-exterior_front_passenger-default-1774613154526.jpg> (referer: None)
2026-03-29 20:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3050/19293050/interior_boot-1774696436186.jpg> (referer: None)
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bcbe10>
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116/a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7457%252F20217457%252Finterior_boot-1774709428382.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7457/20217457/interior_boot-1774709428382.jpg saved to cache
2026-03-29 20:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116
2026-03-29 20:10:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d88050>
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116/a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7457%252F20217457%252Fdocs_service_history-1774705575567.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7f6606015ed6b357d260f67699055c42') HTTP/1.1" 204 0
2026-03-29 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7457/20217457/docs_service_history-1774705575567.jpg?ixlib=js-3.8.0&auto=format&s=7f6606015ed6b357d260f67699055c42 saved to cache
2026-03-29 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659bdab50>
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116/a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7457%252F20217457%252Fwheels_front_driver-1774687133655.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7457/20217457/wheels_front_driver-1774687133655.jpg saved to cache
2026-03-29 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d96490>
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b365b4b7-aa27-5f15-8f73-132a32405397/b365b4b7-aa27-5f15-8f73-132a32405397_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6877%252F12116877%252F12116877-exterior_rear_driver-default-1774613152286.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6877/12116877/12116877-exterior_rear_driver-default-1774613152286.jpg saved to cache
2026-03-29 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b365b4b7-aa27-5f15-8f73-132a32405397
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c26850>
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb6853a6-2291-5175-ad37-11b527ab7e4f/bb6853a6-2291-5175-ad37-11b527ab7e4f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3050%252F19293050%252Finterior_dashboard-1774697182134.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3050/19293050/interior_dashboard-1774697182134.jpg saved to cache
2026-03-29 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bb6853a6-2291-5175-ad37-11b527ab7e4f
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ac3890>
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b365b4b7-aa27-5f15-8f73-132a32405397/b365b4b7-aa27-5f15-8f73-132a32405397_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6877%252F12116877%252F12116877-interior_front_seats-default-1774613147185.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6877/12116877/12116877-interior_front_seats-default-1774613147185.jpg saved to cache
2026-03-29 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b365b4b7-aa27-5f15-8f73-132a32405397
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659bd8c90>
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb6853a6-2291-5175-ad37-11b527ab7e4f/bb6853a6-2291-5175-ad37-11b527ab7e4f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3050%252F19293050%252Finterior_rear_seats-1774697047392.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3050/19293050/interior_rear_seats-1774697047392.jpg saved to cache
2026-03-29 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bb6853a6-2291-5175-ad37-11b527ab7e4f
2026-03-29 20:10:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c26e50>
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116/a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7457%252F20217457%252Finterior_rear_seats-1774687625917.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7457/20217457/interior_rear_seats-1774687625917.jpg saved to cache
2026-03-29 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116
2026-03-29 20:10:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d94910>
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb6853a6-2291-5175-ad37-11b527ab7e4f/bb6853a6-2291-5175-ad37-11b527ab7e4f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3050%252F19293050%252Finstrument_cluster-1774696523954.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3050/19293050/instrument_cluster-1774696523954.jpg saved to cache
2026-03-29 20:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bb6853a6-2291-5175-ad37-11b527ab7e4f
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598f06d0>
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b365b4b7-aa27-5f15-8f73-132a32405397/b365b4b7-aa27-5f15-8f73-132a32405397_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6877%252F12116877%252F12116877-exterior_front_passenger-default-1774613154526.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6877/12116877/12116877-exterior_front_passenger-default-1774613154526.jpg saved to cache
2026-03-29 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b365b4b7-aa27-5f15-8f73-132a32405397
2026-03-29 20:10:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ac36d0>
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb6853a6-2291-5175-ad37-11b527ab7e4f/bb6853a6-2291-5175-ad37-11b527ab7e4f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3050%252F19293050%252Finterior_boot-1774696436186.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3050/19293050/interior_boot-1774696436186.jpg saved to cache
2026-03-29 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bb6853a6-2291-5175-ad37-11b527ab7e4f
2026-03-29 20:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=72&page=2&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3050/19293050/interior_front_seats-1774696325326.jpg> (referer: None)
2026-03-29 20:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6877/12116877/12116877-exterior_front_driver-default-1774613153500.jpg> (referer: None)
2026-03-29 20:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7457/20217457/interior_front_seats-1774687608083.jpg> (referer: None)
2026-03-29 20:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7457/20217457/interior_dashboard-1774709395991.jpg> (referer: None)
2026-03-29 20:10:42 [motorway.uk] INFO: Found listing with ID: 6579411
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%276579411%27 HTTP/1.1" 200 None
2026-03-29 20:10:42 [motorway.uk] INFO: Scrape type for 6579411: 1
2026-03-29 20:10:42 [motorway.uk] INFO: Found listing with ID: 18288929
2026-03-29 20:10:42 [motorway.uk] INFO: Found listing with ID: 10230435
2026-03-29 20:10:42 [motorway.uk] INFO: Found listing with ID: 20413878
2026-03-29 20:10:42 [motorway.uk] INFO: Found listing with ID: 20489985
2026-03-29 20:10:42 [motorway.uk] INFO: Found listing with ID: 20266437
2026-03-29 20:10:42 [motorway.uk] INFO: Found listing with ID: 18704338
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718704338%27 HTTP/1.1" 200 None
2026-03-29 20:10:42 [motorway.uk] INFO: Scrape type for 18704338: 1
2026-03-29 20:10:42 [motorway.uk] INFO: Found listing with ID: 20479276
2026-03-29 20:10:42 [motorway.uk] INFO: Found listing with ID: 13909960
2026-03-29 20:10:42 [motorway.uk] INFO: Found listing with ID: 20487021
2026-03-29 20:10:42 [motorway.uk] INFO: Found listing with ID: 19601663
2026-03-29 20:10:42 [motorway.uk] INFO: Found listing with ID: 20444990
2026-03-29 20:10:42 [motorway.uk] INFO: Found listing with ID: 20184498
2026-03-29 20:10:42 [motorway.uk] INFO: Found listing with ID: 20155249
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720155249%27 HTTP/1.1" 200 None
2026-03-29 20:10:42 [motorway.uk] INFO: Scrape type for 20155249: 1
2026-03-29 20:10:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bee0d0>
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb6853a6-2291-5175-ad37-11b527ab7e4f/bb6853a6-2291-5175-ad37-11b527ab7e4f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3050%252F19293050%252Finterior_front_seats-1774696325326.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3050/19293050/interior_front_seats-1774696325326.jpg saved to cache
2026-03-29 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb6853a6-2291-5175-ad37-11b527ab7e4f
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659992210>
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b365b4b7-aa27-5f15-8f73-132a32405397/b365b4b7-aa27-5f15-8f73-132a32405397_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6877%252F12116877%252F12116877-exterior_front_driver-default-1774613153500.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6877/12116877/12116877-exterior_front_driver-default-1774613153500.jpg saved to cache
2026-03-29 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b365b4b7-aa27-5f15-8f73-132a32405397
2026-03-29 20:10:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b365b4b7-aa27-5f15-8f73-132a32405397, skipping ID generation
2026-03-29 20:10:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b365b4b7-aa27-5f15-8f73-132a32405397 with scrape type 1
2026-03-29 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b365b4b7-aa27-5f15-8f73-132a32405397 sending to next pipeline
2026-03-29 20:10:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b365b4b7-aa27-5f15-8f73-132a32405397, identifier: 12116877
2026-03-29 20:10:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b09650>
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116/a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7457%252F20217457%252Finterior_front_seats-1774687608083.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7457/20217457/interior_front_seats-1774687608083.jpg saved to cache
2026-03-29 20:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116
2026-03-29 20:10:42 [motorway.uk] INFO: Found listing with ID: 14811957
2026-03-29 20:10:42 [motorway.uk] INFO: Found listing with ID: 4700757
2026-03-29 20:10:42 [motorway.uk] INFO: Found listing with ID: 20492157
2026-03-29 20:10:42 [motorway.uk] INFO: Found listing with ID: 20415455
2026-03-29 20:10:42 [motorway.uk] INFO: Found listing with ID: 20465121
2026-03-29 20:10:42 [motorway.uk] INFO: Found listing with ID: 19763259
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719763259%27 HTTP/1.1" 200 None
2026-03-29 20:10:42 [motorway.uk] INFO: Scrape type for 19763259: 1
2026-03-29 20:10:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b365b4b7-aa27-5f15-8f73-132a32405397 with identifier: 12116877
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:10:42 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Grey HTTP/1.1" 200 None
2026-03-29 20:10:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:10:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b365b4b7-aa27-5f15-8f73-132a32405397 with identifier: 12116877
2026-03-29 20:10:43 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b365b4b7-aa27-5f15-8f73-132a32405397 with identifier: 12116877 to the API
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6877/12116877/12116877-exterior_front_driver-default-1774613153500.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '4.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'b365b4b7-aa27-5f15-8f73-132a32405397',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EJ21 LDL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/12116877',
'listing': 'auction',
'location': 'Essex Stanford-le-Hope',
'make': 'Audi',
'model': 'RS6',
'odometer': 52441,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b365b4b7-aa27-5f15-8f73-132a32405397/b365b4b7-aa27-5f15-8f73-132a32405397_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1849689,
'Height': 2754,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6877/12116877/12116877-exterior_front_driver-default-1774613153500.jpg',
'Width': 3672},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b365b4b7-aa27-5f15-8f73-132a32405397/b365b4b7-aa27-5f15-8f73-132a32405397_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1432521,
'Height': 2378,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6877/12116877/12116877-exterior_rear_driver-default-1774613152286.jpg',
'Width': 3170},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b365b4b7-aa27-5f15-8f73-132a32405397/b365b4b7-aa27-5f15-8f73-132a32405397_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2337497,
'Height': 2966,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6877/12116877/12116877-exterior_front_passenger-default-1774613154526.jpg',
'Width': 3955},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b365b4b7-aa27-5f15-8f73-132a32405397/b365b4b7-aa27-5f15-8f73-132a32405397_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1336213,
'Height': 2329,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6877/12116877/12116877-exterior_rear_passenger-default-1774613157530.jpg',
'Width': 3105},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b365b4b7-aa27-5f15-8f73-132a32405397/b365b4b7-aa27-5f15-8f73-132a32405397_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2278760,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6877/12116877/12116877-interior_front_seats-default-1774613147185.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b365b4b7-aa27-5f15-8f73-132a32405397/b365b4b7-aa27-5f15-8f73-132a32405397_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1778195,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6877/12116877/12116877-interior_rear_seats-default-1774613149313.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b365b4b7-aa27-5f15-8f73-132a32405397/b365b4b7-aa27-5f15-8f73-132a32405397_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2363160,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6877/12116877/12116877-interior_dashboard-default-1774613168322.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b365b4b7-aa27-5f15-8f73-132a32405397/b365b4b7-aa27-5f15-8f73-132a32405397_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2280400,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6877/12116877/12116877-instrument_cluster-default-1774613287291.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b365b4b7-aa27-5f15-8f73-132a32405397/b365b4b7-aa27-5f15-8f73-132a32405397_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2438518,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6877/12116877/12116877-interior_boot-default-1774613152403.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b365b4b7-aa27-5f15-8f73-132a32405397/b365b4b7-aa27-5f15-8f73-132a32405397_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 171653,
'Height': 2868,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/6877/12116877/docs_service_history-1764270478644.jpeg?ixlib=js-3.8.0&auto=format&s=25a23eaf6a9d3b02b5261cd06bb579bc',
'Width': 1320}],
'price': 66525,
'price_includes_vat': False,
'registration_date': '2021-05-20',
'seats_number': None,
'seller_name': None,
'title': 'Audi RS 6 Carbon BLK TFSI MHEV Quat A',
'transmission': 'automatic',
'trim': 'RS 6 Carbon BLK TFSI MHEV Quat A',
'vin': 'WUAZZZF27MN904904',
'year': 2021}
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712116877%27 HTTP/1.1" 200 None
2026-03-29 20:10:43 [motorway.uk] INFO: Saving data for 12116877: {'created_time': 1774815043.448415, 'last_price_update_time': 1774815043.448428, 'auction_closing_time': 1774884600.0}
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='12116877') HTTP/1.1" 204 0
2026-03-29 20:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5779/19335779/docs_service_history-1774714430576-1.jpeg?ixlib=js-3.8.0&auto=format&s=83a519b31b330212ab30a3721fa809a6> (referer: None)
2026-03-29 20:10:43 [motorway.uk] INFO: Found listing with ID: 20407866
2026-03-29 20:10:43 [motorway.uk] INFO: Found listing with ID: 19657268
2026-03-29 20:10:43 [motorway.uk] INFO: Found listing with ID: 4217945
2026-03-29 20:10:43 [motorway.uk] INFO: Found listing with ID: 20421154
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720421154%27 HTTP/1.1" 200 None
2026-03-29 20:10:43 [motorway.uk] INFO: Scrape type for 20421154: 1
2026-03-29 20:10:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:43 [motorway.uk] INFO: Found listing with ID: 20426599
2026-03-29 20:10:43 [motorway.uk] INFO: Found listing with ID: 20483409
2026-03-29 20:10:43 [motorway.uk] INFO: Found listing with ID: 20382764
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720382764%27 HTTP/1.1" 200 None
2026-03-29 20:10:43 [motorway.uk] INFO: Scrape type for 20382764: 1
2026-03-29 20:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b18c10>
2026-03-29 20:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116/a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7457%252F20217457%252Finterior_dashboard-1774709395991.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7457/20217457/interior_dashboard-1774709395991.jpg saved to cache
2026-03-29 20:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116
2026-03-29 20:10:43 [motorway.uk] INFO: Found listing with ID: 17702324
2026-03-29 20:10:43 [motorway.uk] INFO: Found listing with ID: 19979923
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719979923%27 HTTP/1.1" 200 None
2026-03-29 20:10:43 [motorway.uk] INFO: Scrape type for 19979923: 1
2026-03-29 20:10:43 [motorway.uk] INFO: Found listing with ID: 7899191
2026-03-29 20:10:43 [motorway.uk] INFO: Found listing with ID: 9335437
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279335437%27 HTTP/1.1" 200 None
2026-03-29 20:10:43 [motorway.uk] INFO: Scrape type for 9335437: 1
2026-03-29 20:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b57190>
2026-03-29 20:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dafb102-27ce-5cf0-9103-45abfe322ad5/9dafb102-27ce-5cf0-9103-45abfe322ad5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5779%252F19335779%252Fdocs_service_history-1774714430576-1.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D83a519b31b330212ab30a3721fa809a6') HTTP/1.1" 204 0
2026-03-29 20:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5779/19335779/docs_service_history-1774714430576-1.jpeg?ixlib=js-3.8.0&auto=format&s=83a519b31b330212ab30a3721fa809a6 saved to cache
2026-03-29 20:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9dafb102-27ce-5cf0-9103-45abfe322ad5
2026-03-29 20:10:43 [motorway.uk] INFO: Found listing with ID: 20443228
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720443228%27 HTTP/1.1" 200 None
2026-03-29 20:10:43 [motorway.uk] INFO: Scrape type for 20443228: 1
2026-03-29 20:10:43 [motorway.uk] INFO: Found listing with ID: 14132265
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714132265%27 HTTP/1.1" 200 None
2026-03-29 20:10:43 [motorway.uk] INFO: Scrape type for 14132265: 1
2026-03-29 20:10:43 [motorway.uk] INFO: Found listing with ID: 19384929
2026-03-29 20:10:43 [motorway.uk] INFO: Found listing with ID: 20385350
2026-03-29 20:10:43 [motorway.uk] INFO: Found listing with ID: 20231987
2026-03-29 20:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7457/20217457/exterior_front_driver-1774686941890.jpg> (referer: None)
2026-03-29 20:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3050/19293050/exterior_rear_passenger-1774695963727.jpg> (referer: None)
2026-03-29 20:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7457/20217457/exterior_rear_passenger-1774687090421.jpg> (referer: None)
2026-03-29 20:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3050/19293050/exterior_rear_driver-1774696051591.jpg> (referer: None)
2026-03-29 20:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7457/20217457/exterior_rear_driver-1774686968245.jpg> (referer: None)
2026-03-29 20:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5779/19335779/interior_boot-1774712989179.jpg> (referer: None)
2026-03-29 20:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fe1b10>
2026-03-29 20:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116/a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7457%252F20217457%252Fexterior_front_driver-1774686941890.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7457/20217457/exterior_front_driver-1774686941890.jpg saved to cache
2026-03-29 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b17250>
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb6853a6-2291-5175-ad37-11b527ab7e4f/bb6853a6-2291-5175-ad37-11b527ab7e4f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3050%252F19293050%252Fexterior_rear_passenger-1774695963727.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3050/19293050/exterior_rear_passenger-1774695963727.jpg saved to cache
2026-03-29 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bb6853a6-2291-5175-ad37-11b527ab7e4f
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f8d250>
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116/a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7457%252F20217457%252Fexterior_rear_passenger-1774687090421.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7457/20217457/exterior_rear_passenger-1774687090421.jpg saved to cache
2026-03-29 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659afbcd0>
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb6853a6-2291-5175-ad37-11b527ab7e4f/bb6853a6-2291-5175-ad37-11b527ab7e4f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3050%252F19293050%252Fexterior_rear_driver-1774696051591.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3050/19293050/exterior_rear_driver-1774696051591.jpg saved to cache
2026-03-29 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bb6853a6-2291-5175-ad37-11b527ab7e4f
2026-03-29 20:10:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb6853a6-2291-5175-ad37-11b527ab7e4f, skipping ID generation
2026-03-29 20:10:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb6853a6-2291-5175-ad37-11b527ab7e4f with scrape type 1
2026-03-29 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb6853a6-2291-5175-ad37-11b527ab7e4f sending to next pipeline
2026-03-29 20:10:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: bb6853a6-2291-5175-ad37-11b527ab7e4f, identifier: 19293050
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65beb5990>
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116/a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7457%252F20217457%252Fexterior_rear_driver-1774686968245.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7457/20217457/exterior_rear_driver-1774686968245.jpg saved to cache
2026-03-29 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116
2026-03-29 20:10:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116, skipping ID generation
2026-03-29 20:10:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116 with scrape type 1
2026-03-29 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116 sending to next pipeline
2026-03-29 20:10:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116, identifier: 20217457
2026-03-29 20:10:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b57450>
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dafb102-27ce-5cf0-9103-45abfe322ad5/9dafb102-27ce-5cf0-9103-45abfe322ad5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5779%252F19335779%252Finterior_boot-1774712989179.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5779/19335779/interior_boot-1774712989179.jpg saved to cache
2026-03-29 20:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9dafb102-27ce-5cf0-9103-45abfe322ad5
2026-03-29 20:10:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: bb6853a6-2291-5175-ad37-11b527ab7e4f with identifier: 19293050
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:10:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Green HTTP/1.1" 200 None
2026-03-29 20:10:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:10:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: bb6853a6-2291-5175-ad37-11b527ab7e4f with identifier: 19293050
2026-03-29 20:10:45 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: bb6853a6-2291-5175-ad37-11b527ab7e4f with identifier: 19293050 to the API
2026-03-29 20:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:10:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3050/19293050/exterior_rear_driver-1774696051591.jpg>
{'auction_title': '',
'category': None,
'color': 'Green',
'currency': 'GBP',
'doors_number': None,
'engine': '5.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'bb6853a6-2291-5175-ad37-11b527ab7e4f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LR16 YDC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19293050',
'listing': 'auction',
'location': 'None Llangollen',
'make': 'Audi',
'model': 'R8',
'odometer': 22200,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb6853a6-2291-5175-ad37-11b527ab7e4f/bb6853a6-2291-5175-ad37-11b527ab7e4f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2585195,
'Height': 2812,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3050/19293050/exterior_front_driver-1774697717231.jpg',
'Width': 3749},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb6853a6-2291-5175-ad37-11b527ab7e4f/bb6853a6-2291-5175-ad37-11b527ab7e4f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2561126,
'Height': 2914,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3050/19293050/exterior_rear_driver-1774696051591.jpg',
'Width': 3885},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb6853a6-2291-5175-ad37-11b527ab7e4f/bb6853a6-2291-5175-ad37-11b527ab7e4f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2653925,
'Height': 2814,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3050/19293050/exterior_front_passenger-1774696030094.jpg',
'Width': 3752},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb6853a6-2291-5175-ad37-11b527ab7e4f/bb6853a6-2291-5175-ad37-11b527ab7e4f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2465819,
'Height': 2711,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3050/19293050/exterior_rear_passenger-1774695963727.jpg',
'Width': 3615},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb6853a6-2291-5175-ad37-11b527ab7e4f/bb6853a6-2291-5175-ad37-11b527ab7e4f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2471896,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3050/19293050/interior_front_seats-1774696325326.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb6853a6-2291-5175-ad37-11b527ab7e4f/bb6853a6-2291-5175-ad37-11b527ab7e4f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1850376,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3050/19293050/interior_rear_seats-1774697047392.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb6853a6-2291-5175-ad37-11b527ab7e4f/bb6853a6-2291-5175-ad37-11b527ab7e4f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1771888,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3050/19293050/interior_dashboard-1774697182134.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb6853a6-2291-5175-ad37-11b527ab7e4f/bb6853a6-2291-5175-ad37-11b527ab7e4f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2298638,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3050/19293050/instrument_cluster-1774696523954.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb6853a6-2291-5175-ad37-11b527ab7e4f/bb6853a6-2291-5175-ad37-11b527ab7e4f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4097598,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3050/19293050/interior_boot-1774696436186.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb6853a6-2291-5175-ad37-11b527ab7e4f/bb6853a6-2291-5175-ad37-11b527ab7e4f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118608,
'Height': 842,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3050/19293050/docs_service_history-1774696534227.jpg?ixlib=js-3.8.0&auto=format&s=95e8a79f477491337483948dd39060c6',
'Width': 595}],
'price': 71575,
'price_includes_vat': False,
'registration_date': '2016-04-27',
'seats_number': None,
'seller_name': None,
'title': 'Audi R8 V10 Quattro S-A',
'transmission': 'automatic',
'trim': 'V10 Quattro S-A',
'vin': 'WUAZZZFX0G7901492',
'year': 2016}
2026-03-29 20:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719293050%27 HTTP/1.1" 200 None
2026-03-29 20:10:46 [motorway.uk] INFO: Saving data for 19293050: {'created_time': 1774815046.417181, 'last_price_update_time': 1774815046.417191, 'auction_closing_time': 1774884600.0}
2026-03-29 20:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19293050') HTTP/1.1" 204 0
2026-03-29 20:10:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116 with identifier: 20217457
2026-03-29 20:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116 with identifier: 20217457
2026-03-29 20:10:46 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116 with identifier: 20217457 to the API
2026-03-29 20:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:10:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7457/20217457/exterior_rear_driver-1774686968245.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': '6 GDW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20217457',
'listing': 'auction',
'location': 'Buckinghamshire Milton Keynes',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 14700,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116/a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1450540,
'Height': 2574,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7457/20217457/exterior_front_driver-1774686941890.jpg',
'Width': 3432},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116/a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2375963,
'Height': 2729,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7457/20217457/exterior_rear_driver-1774686968245.jpg',
'Width': 3638},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116/a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1969355,
'Height': 2662,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7457/20217457/exterior_front_passenger-1774687028707.jpg',
'Width': 3549},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116/a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1928165,
'Height': 2814,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7457/20217457/exterior_rear_passenger-1774687090421.jpg',
'Width': 3752},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116/a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3429005,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7457/20217457/interior_front_seats-1774687608083.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116/a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2163977,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7457/20217457/interior_rear_seats-1774687625917.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116/a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1866129,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7457/20217457/interior_dashboard-1774709395991.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116/a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374256,
'Height': 1807,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7457/20217457/interior_boot-1774709428382.jpg',
'Width': 2410},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116/a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2453132,
'Height': 2355,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7457/20217457/docs_service_history-1774705575567.jpg?ixlib=js-3.8.0&auto=format&s=7f6606015ed6b357d260f67699055c42',
'Width': 2403},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116/a1c51c4e-adc5-5320-9aa0-0c2c7d3a1116_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2546090,
'Height': 2985,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7457/20217457/wheels_front_driver-1774687133655.jpg',
'Width': 3980}],
'price': 66675,
'price_includes_vat': False,
'registration_date': '2023-09-22',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Range Rover Sport DYN SE MHEV A',
'transmission': 'automatic',
'trim': 'Sport DYN SE MHEV A',
'vin': 'SAL1A2AU3PA156450',
'year': 2023}
2026-03-29 20:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720217457%27 HTTP/1.1" 200 None
2026-03-29 20:10:46 [motorway.uk] INFO: Saving data for 20217457: {'created_time': 1774815046.955132, 'last_price_update_time': 1774815046.955144, 'auction_closing_time': 1774884600.0}
2026-03-29 20:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20217457') HTTP/1.1" 204 0
2026-03-29 20:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/9721294.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18459962.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20468049.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/9396121.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74cfe2b8-2b54-52df-ba03-e232b1f56186 with identifier: 9721294
2026-03-29 20:10:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74cfe2b8-2b54-52df-ba03-e232b1f56186 with scrape type 1
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 74cfe2b8-2b54-52df-ba03-e232b1f56186
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1294%252F9721294%252Fexterior_front_driver-1774097217988.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1294/9721294/exterior_front_driver-1774097217988.jpg not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1294%252F9721294%252Fexterior_rear_driver-1774097253786.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1294/9721294/exterior_rear_driver-1774097253786.jpg not downloaded yet
2026-03-29 20:10:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 497122b3-feab-5743-b75c-850548d09700 with identifier: 18459962
2026-03-29 20:10:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 497122b3-feab-5743-b75c-850548d09700 with scrape type 1
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 497122b3-feab-5743-b75c-850548d09700
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9962%252F18459962%252Fexterior_front_driver-1774703430545.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9962/18459962/exterior_front_driver-1774703430545.jpg not downloaded yet
2026-03-29 20:10:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86613f12-7b5a-52ba-8cb0-ba23d0c46349 with identifier: 20468049
2026-03-29 20:10:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86613f12-7b5a-52ba-8cb0-ba23d0c46349 with scrape type 1
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 86613f12-7b5a-52ba-8cb0-ba23d0c46349
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8049%252F20468049%252Fexterior_front_driver-1774714917905.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8049/20468049/exterior_front_driver-1774714917905.jpg not downloaded yet
2026-03-29 20:10:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03d99cd4-366c-53e6-bc17-9bebe02563ad with identifier: 9396121
2026-03-29 20:10:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03d99cd4-366c-53e6-bc17-9bebe02563ad with scrape type 1
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 03d99cd4-366c-53e6-bc17-9bebe02563ad
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6121%252F9396121%252Fexterior_front_driver-1774782663180.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6121/9396121/exterior_front_driver-1774782663180.jpg not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1294%252F9721294%252Fexterior_front_passenger-1774097340365.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1294/9721294/exterior_front_passenger-1774097340365.jpg not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9962%252F18459962%252Fexterior_rear_driver-1774704748753.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9962/18459962/exterior_rear_driver-1774704748753.jpg not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8049%252F20468049%252Fexterior_rear_driver-1774715375886.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8049/20468049/exterior_rear_driver-1774715375886.jpg not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6121%252F9396121%252Fexterior_rear_driver-1774782776791.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6121/9396121/exterior_rear_driver-1774782776791.jpg not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1294%252F9721294%252Fexterior_rear_passenger-1774097331594.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1294/9721294/exterior_rear_passenger-1774097331594.jpg not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9962%252F18459962%252Fexterior_front_passenger-1774703484585.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9962/18459962/exterior_front_passenger-1774703484585.jpg not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8049%252F20468049%252Fexterior_front_passenger-1774715394886.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8049/20468049/exterior_front_passenger-1774715394886.jpg not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6121%252F9396121%252Fexterior_front_passenger-1774782710335.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6121/9396121/exterior_front_passenger-1774782710335.jpg not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1294%252F9721294%252Finterior_front_seats-1774097728820.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1294/9721294/interior_front_seats-1774097728820.jpg not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9962%252F18459962%252Fexterior_rear_passenger-1774704762180.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9962/18459962/exterior_rear_passenger-1774704762180.jpg not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8049%252F20468049%252Fexterior_rear_passenger-1774714986891.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8049/20468049/exterior_rear_passenger-1774714986891.jpg not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6121%252F9396121%252Fexterior_rear_passenger-1774782697039.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6121/9396121/exterior_rear_passenger-1774782697039.jpg not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1294%252F9721294%252Finterior_rear_seats-1774097750156.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1294/9721294/interior_rear_seats-1774097750156.jpg not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9962%252F18459962%252Finterior_front_seats-1774704784582.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9962/18459962/interior_front_seats-1774704784582.jpg not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8049%252F20468049%252Finterior_front_seats-1774715814142.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8049/20468049/interior_front_seats-1774715814142.jpg not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6121%252F9396121%252Finterior_front_seats-1774782965103.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6121/9396121/interior_front_seats-1774782965103.jpg not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1294%252F9721294%252Finterior_dashboard-1774097773347.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1294/9721294/interior_dashboard-1774097773347.jpg not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9962%252F18459962%252Finterior_rear_seats-1774703993846.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9962/18459962/interior_rear_seats-1774703993846.jpg not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8049%252F20468049%252Finterior_rear_seats-1774716623497.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8049/20468049/interior_rear_seats-1774716623497.jpg not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6121%252F9396121%252Finterior_rear_seats-1774782957317.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6121/9396121/interior_rear_seats-1774782957317.jpg not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1294%252F9721294%252Finterior_boot-1774097794495.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1294/9721294/interior_boot-1774097794495.jpg not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9962%252F18459962%252Finterior_dashboard-1774704815975.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9962/18459962/interior_dashboard-1774704815975.jpg not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8049%252F20468049%252Finterior_dashboard-1774716363307.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8049/20468049/interior_dashboard-1774716363307.jpg not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6121%252F9396121%252Finterior_dashboard-1774782959212.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6121/9396121/interior_dashboard-1774782959212.jpg not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1294%252F9721294%252Fdocs_service_history-1774097949443.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De80f4b928526665442ef5d4587d6ba83%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1294/9721294/docs_service_history-1774097949443.jpg?ixlib=js-3.8.0&auto=format&s=e80f4b928526665442ef5d4587d6ba83 not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9962%252F18459962%252Finstrument_cluster-1774704000762.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9962/18459962/instrument_cluster-1774704000762.jpg not downloaded yet
2026-03-29 20:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8049%252F20468049%252Finstrument_cluster-1774715923106.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8049/20468049/instrument_cluster-1774715923106.jpg not downloaded yet
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6121%252F9396121%252Finstrument_cluster-1774783313978.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6121/9396121/instrument_cluster-1774783313978.jpg not downloaded yet
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1294%252F9721294%252Fwheels_front_driver-1774097350608.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1294/9721294/wheels_front_driver-1774097350608.jpg not downloaded yet
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9962%252F18459962%252Finterior_boot-1774704830650.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9962/18459962/interior_boot-1774704830650.jpg not downloaded yet
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8049%252F20468049%252Finterior_boot-1774716185634.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8049/20468049/interior_boot-1774716185634.jpg not downloaded yet
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6121%252F9396121%252Finterior_boot-1774782937625.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6121/9396121/interior_boot-1774782937625.jpg not downloaded yet
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9962%252F18459962%252Fdocs_service_history-1774705191710.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8be66be808ab61ee32140f0a40f016e5%27 HTTP/1.1" 200 None
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9962/18459962/docs_service_history-1774705191710.jpg?ixlib=js-3.8.0&auto=format&s=8be66be808ab61ee32140f0a40f016e5 not downloaded yet
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8049%252F20468049%252Fdocs_service_history-1774772347854.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D325efac2d2df3c6ba2a8181d3c3ee03b%27 HTTP/1.1" 200 None
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8049/20468049/docs_service_history-1774772347854.jpg?ixlib=js-3.8.0&auto=format&s=325efac2d2df3c6ba2a8181d3c3ee03b not downloaded yet
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6121%252F9396121%252Fdamage_missing_trims-1774790195024.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6121/9396121/damage_missing_trims-1774790195024.jpg not downloaded yet
2026-03-29 20:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5779/19335779/instrument_cluster-1774715520405.jpg> (referer: None)
2026-03-29 20:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20491954.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6121/9396121/damage_missing_trims-1774790195024.jpg> (referer: None)
2026-03-29 20:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8049/20468049/docs_service_history-1774772347854.jpg?ixlib=js-3.8.0&auto=format&s=325efac2d2df3c6ba2a8181d3c3ee03b> (referer: None)
2026-03-29 20:10:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a216d0>
2026-03-29 20:10:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dafb102-27ce-5cf0-9103-45abfe322ad5/9dafb102-27ce-5cf0-9103-45abfe322ad5_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5779%252F19335779%252Finstrument_cluster-1774715520405.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5779/19335779/instrument_cluster-1774715520405.jpg saved to cache
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9dafb102-27ce-5cf0-9103-45abfe322ad5
2026-03-29 20:10:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9dafb102-27ce-5cf0-9103-45abfe322ad5, skipping ID generation
2026-03-29 20:10:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dafb102-27ce-5cf0-9103-45abfe322ad5 with scrape type 1
2026-03-29 20:10:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9dafb102-27ce-5cf0-9103-45abfe322ad5 sending to next pipeline
2026-03-29 20:10:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9dafb102-27ce-5cf0-9103-45abfe322ad5, identifier: 19335779
2026-03-29 20:10:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9dafb102-27ce-5cf0-9103-45abfe322ad5 with identifier: 19335779
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Bronze HTTP/1.1" 200 None
2026-03-29 20:10:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:10:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9dafb102-27ce-5cf0-9103-45abfe322ad5 with identifier: 19335779
2026-03-29 20:10:48 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9dafb102-27ce-5cf0-9103-45abfe322ad5 with identifier: 19335779 to the API
2026-03-29 20:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/5779/19335779/instrument_cluster-1774715520405.jpg>
{'auction_title': '',
'category': None,
'color': 'Bronze',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '9dafb102-27ce-5cf0-9103-45abfe322ad5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AE70 OJM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19335779',
'listing': 'auction',
'location': 'Cambridgeshire Huntingdon',
'make': 'Land Rover',
'model': 'Other Land Rover',
'odometer': 43000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dafb102-27ce-5cf0-9103-45abfe322ad5/9dafb102-27ce-5cf0-9103-45abfe322ad5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1530501,
'Height': 2751,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5779/19335779/exterior_front_driver-1774711800194.jpg',
'Width': 3668},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dafb102-27ce-5cf0-9103-45abfe322ad5/9dafb102-27ce-5cf0-9103-45abfe322ad5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1671176,
'Height': 2763,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5779/19335779/exterior_rear_driver-1774712171270.jpg',
'Width': 3684},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dafb102-27ce-5cf0-9103-45abfe322ad5/9dafb102-27ce-5cf0-9103-45abfe322ad5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2081527,
'Height': 2768,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5779/19335779/exterior_front_passenger-1774712144427.jpg',
'Width': 3691},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dafb102-27ce-5cf0-9103-45abfe322ad5/9dafb102-27ce-5cf0-9103-45abfe322ad5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1330656,
'Height': 2621,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5779/19335779/exterior_rear_passenger-1774711867106.jpg',
'Width': 3494},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dafb102-27ce-5cf0-9103-45abfe322ad5/9dafb102-27ce-5cf0-9103-45abfe322ad5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3037053,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5779/19335779/interior_front_seats-1774713054986.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dafb102-27ce-5cf0-9103-45abfe322ad5/9dafb102-27ce-5cf0-9103-45abfe322ad5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3136013,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5779/19335779/interior_rear_seats-1774712782684.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dafb102-27ce-5cf0-9103-45abfe322ad5/9dafb102-27ce-5cf0-9103-45abfe322ad5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2913880,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5779/19335779/interior_dashboard-1774712861179.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dafb102-27ce-5cf0-9103-45abfe322ad5/9dafb102-27ce-5cf0-9103-45abfe322ad5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1710700,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5779/19335779/instrument_cluster-1774715520405.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dafb102-27ce-5cf0-9103-45abfe322ad5/9dafb102-27ce-5cf0-9103-45abfe322ad5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3494479,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5779/19335779/interior_boot-1774712989179.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dafb102-27ce-5cf0-9103-45abfe322ad5/9dafb102-27ce-5cf0-9103-45abfe322ad5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76723,
'Height': 1263,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5779/19335779/docs_service_history-1774714430576-1.jpeg?ixlib=js-3.8.0&auto=format&s=83a519b31b330212ab30a3721fa809a6',
'Width': 892}],
'price': 20796,
'price_includes_vat': False,
'registration_date': '2021-02-05',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover R R Evoque R-DYNAMIC HSE D MHEV A',
'transmission': 'automatic',
'trim': 'R R Evoque R-DYNAMIC HSE D MHEV A',
'vin': 'SALZA2AN7MH131307',
'year': 2021}
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719335779%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [motorway.uk] INFO: Saving data for 19335779: {'created_time': 1774815049.124767, 'last_price_update_time': 1774815049.124779, 'auction_closing_time': 1774884600.0}
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19335779') HTTP/1.1" 204 0
2026-03-29 20:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4593bc1e-ae86-531d-ac7e-fd215ba51c9c with identifier: 20491954
2026-03-29 20:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4593bc1e-ae86-531d-ac7e-fd215ba51c9c with scrape type 1
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4593bc1e-ae86-531d-ac7e-fd215ba51c9c
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1954%252F20491954%252Fexterior_front_driver-1774787235398.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1954/20491954/exterior_front_driver-1774787235398.jpg not downloaded yet
2026-03-29 20:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a17790>
2026-03-29 20:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d99cd4-366c-53e6-bc17-9bebe02563ad/03d99cd4-366c-53e6-bc17-9bebe02563ad_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6121%252F9396121%252Fdamage_missing_trims-1774790195024.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6121/9396121/damage_missing_trims-1774790195024.jpg saved to cache
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 03d99cd4-366c-53e6-bc17-9bebe02563ad
2026-03-29 20:10:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599fb290>
2026-03-29 20:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86613f12-7b5a-52ba-8cb0-ba23d0c46349/86613f12-7b5a-52ba-8cb0-ba23d0c46349_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8049%252F20468049%252Fdocs_service_history-1774772347854.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D325efac2d2df3c6ba2a8181d3c3ee03b') HTTP/1.1" 204 0
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8049/20468049/docs_service_history-1774772347854.jpg?ixlib=js-3.8.0&auto=format&s=325efac2d2df3c6ba2a8181d3c3ee03b saved to cache
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 86613f12-7b5a-52ba-8cb0-ba23d0c46349
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1954%252F20491954%252Fexterior_rear_driver-1774787103889.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1954/20491954/exterior_rear_driver-1774787103889.jpg not downloaded yet
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1954%252F20491954%252Fexterior_front_passenger-1774787237803.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1954/20491954/exterior_front_passenger-1774787237803.jpg not downloaded yet
2026-03-29 20:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/9962/18459962/docs_service_history-1774705191710.jpg?ixlib=js-3.8.0&auto=format&s=8be66be808ab61ee32140f0a40f016e5> (referer: None)
2026-03-29 20:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=108&page=3&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1954%252F20491954%252Fexterior_rear_passenger-1774787236496.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1954/20491954/exterior_rear_passenger-1774787236496.jpg not downloaded yet
2026-03-29 20:10:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1954%252F20491954%252Finterior_front_seats-1774788310351.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1954/20491954/interior_front_seats-1774788310351.jpg not downloaded yet
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1954%252F20491954%252Finterior_rear_seats-1774788311722.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1954/20491954/interior_rear_seats-1774788311722.jpg not downloaded yet
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1954%252F20491954%252Finterior_dashboard-1774788324697.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1954/20491954/interior_dashboard-1774788324697.jpg not downloaded yet
2026-03-29 20:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa66990fb50>
2026-03-29 20:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_497122b3-feab-5743-b75c-850548d09700/497122b3-feab-5743-b75c-850548d09700_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9962%252F18459962%252Fdocs_service_history-1774705191710.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8be66be808ab61ee32140f0a40f016e5') HTTP/1.1" 204 0
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9962/18459962/docs_service_history-1774705191710.jpg?ixlib=js-3.8.0&auto=format&s=8be66be808ab61ee32140f0a40f016e5 saved to cache
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 497122b3-feab-5743-b75c-850548d09700
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1954%252F20491954%252Finstrument_cluster-1774788442485.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1954/20491954/instrument_cluster-1774788442485.jpg not downloaded yet
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 20449304
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 17481408
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717481408%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [motorway.uk] INFO: Scrape type for 17481408: 1
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1954%252F20491954%252Finterior_boot-1774788313458.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1954/20491954/interior_boot-1774788313458.jpg not downloaded yet
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 20476083
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 20450250
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 20443071
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 20263862
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 20476478
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720476478%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [motorway.uk] INFO: Scrape type for 20476478: 1
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1954%252F20491954%252Fdocs_service_history-1774788239125.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2ffd9711092df7ebe9ac145075a191f5%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1954/20491954/docs_service_history-1774788239125.jpg?ixlib=js-3.8.0&auto=format&s=2ffd9711092df7ebe9ac145075a191f5 not downloaded yet
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 20477592
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 19952830
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 19845582
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 20485961
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 19583490
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 20485937
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720485937%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [motorway.uk] INFO: Scrape type for 20485937: 1
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 20431432
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 20420321
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720420321%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [motorway.uk] INFO: Scrape type for 20420321: 1
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 19097531
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 20491041
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 15524366
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 20382551
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 20477418
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720477418%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [motorway.uk] INFO: Scrape type for 20477418: 1
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 20305532
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 18763419
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 17680882
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 8876821
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 20413933
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 11696787
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 20136196
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 20500894
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 20411106
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 18971390
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 20311155
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 20401199
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 16449198
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716449198%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [motorway.uk] INFO: Scrape type for 16449198: 1
2026-03-29 20:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18710113.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 20386812
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 20464629
2026-03-29 20:10:49 [motorway.uk] INFO: Found listing with ID: 13048174
2026-03-29 20:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1954/20491954/exterior_rear_driver-1774787103889.jpg> (referer: None)
2026-03-29 20:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1954/20491954/exterior_front_passenger-1774787237803.jpg> (referer: None)
2026-03-29 20:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6121/9396121/interior_boot-1774782937625.jpg> (referer: None)
2026-03-29 20:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d883a023-6f2e-5009-9c07-0ba6489d73a6 with identifier: 18710113
2026-03-29 20:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d883a023-6f2e-5009-9c07-0ba6489d73a6 with scrape type 1
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d883a023-6f2e-5009-9c07-0ba6489d73a6
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0113%252F18710113%252Fexterior_front_driver-1774545007806.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0113/18710113/exterior_front_driver-1774545007806.jpeg not downloaded yet
2026-03-29 20:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0113%252F18710113%252Fexterior_rear_driver-1774545040697.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0113/18710113/exterior_rear_driver-1774545040697.jpeg not downloaded yet
2026-03-29 20:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20155249.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0113%252F18710113%252Fexterior_front_passenger-1774545016486.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0113/18710113/exterior_front_passenger-1774545016486.jpeg not downloaded yet
2026-03-29 20:10:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65bc6d190>
2026-03-29 20:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4593bc1e-ae86-531d-ac7e-fd215ba51c9c/4593bc1e-ae86-531d-ac7e-fd215ba51c9c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1954%252F20491954%252Fexterior_rear_driver-1774787103889.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1954/20491954/exterior_rear_driver-1774787103889.jpg saved to cache
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4593bc1e-ae86-531d-ac7e-fd215ba51c9c
2026-03-29 20:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589f5250>
2026-03-29 20:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4593bc1e-ae86-531d-ac7e-fd215ba51c9c/4593bc1e-ae86-531d-ac7e-fd215ba51c9c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1954%252F20491954%252Fexterior_front_passenger-1774787237803.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1954/20491954/exterior_front_passenger-1774787237803.jpg saved to cache
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4593bc1e-ae86-531d-ac7e-fd215ba51c9c
2026-03-29 20:10:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584229d0>
2026-03-29 20:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03d99cd4-366c-53e6-bc17-9bebe02563ad/03d99cd4-366c-53e6-bc17-9bebe02563ad_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6121%252F9396121%252Finterior_boot-1774782937625.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6121/9396121/interior_boot-1774782937625.jpg saved to cache
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 03d99cd4-366c-53e6-bc17-9bebe02563ad
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0113%252F18710113%252Fexterior_rear_passenger-1774545027651.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0113/18710113/exterior_rear_passenger-1774545027651.jpeg not downloaded yet
2026-03-29 20:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14132265.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19763259.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0113%252F18710113%252Finterior_front_seats-1774545089456.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0113/18710113/interior_front_seats-1774545089456.jpeg not downloaded yet
2026-03-29 20:10:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93bae072-7f05-5b1b-9cf2-ea8cd934bc0f with identifier: 20155249
2026-03-29 20:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93bae072-7f05-5b1b-9cf2-ea8cd934bc0f with scrape type 1
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 93bae072-7f05-5b1b-9cf2-ea8cd934bc0f
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5249%252F20155249%252Fexterior_front_driver-1774622866762.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5249/20155249/exterior_front_driver-1774622866762.jpg not downloaded yet
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0113%252F18710113%252Finterior_rear_seats-1774545135762.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0113/18710113/interior_rear_seats-1774545135762.jpeg not downloaded yet
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5249%252F20155249%252Fexterior_rear_driver-1774622881959.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5249/20155249/exterior_rear_driver-1774622881959.jpg not downloaded yet
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0113%252F18710113%252F18710113-interior_dashboard-modified-1774549291230.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0113/18710113/18710113-interior_dashboard-modified-1774549291230.jpeg not downloaded yet
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5249%252F20155249%252Fexterior_front_passenger-1774622910223.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5249/20155249/exterior_front_passenger-1774622910223.jpg not downloaded yet
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0113%252F18710113%252Finstrument_cluster-1774545237182.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0113/18710113/instrument_cluster-1774545237182.jpeg not downloaded yet
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5249%252F20155249%252Fexterior_rear_passenger-1774622900972.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5249/20155249/exterior_rear_passenger-1774622900972.jpg not downloaded yet
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0113%252F18710113%252Finterior_boot-1774545184195.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0113/18710113/interior_boot-1774545184195.jpeg not downloaded yet
2026-03-29 20:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b4bb6b8-69c9-509e-abf0-c8b355b0fa3c with identifier: 14132265
2026-03-29 20:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b4bb6b8-69c9-509e-abf0-c8b355b0fa3c with scrape type 1
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2b4bb6b8-69c9-509e-abf0-c8b355b0fa3c
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2265%252F14132265%252Fexterior_front_driver-1771253186971.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2265/14132265/exterior_front_driver-1771253186971.jpeg not downloaded yet
2026-03-29 20:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d71c2e1f-fcb3-582e-9908-55aa2af7754a with identifier: 19763259
2026-03-29 20:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d71c2e1f-fcb3-582e-9908-55aa2af7754a with scrape type 1
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d71c2e1f-fcb3-582e-9908-55aa2af7754a
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3259%252F19763259%252Fexterior_front_driver-1774525531319.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3259/19763259/exterior_front_driver-1774525531319.jpg not downloaded yet
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5249%252F20155249%252Finterior_front_seats-1774623511421.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5249/20155249/interior_front_seats-1774623511421.jpg not downloaded yet
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0113%252F18710113%252Fdocs_service_history-1774546089728.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8e1be33fbe375a7210e3000e871084eb%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0113/18710113/docs_service_history-1774546089728.jpeg?ixlib=js-3.8.0&auto=format&s=8e1be33fbe375a7210e3000e871084eb not downloaded yet
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2265%252F14132265%252Fexterior_rear_driver-1771253172293.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2265/14132265/exterior_rear_driver-1771253172293.jpeg not downloaded yet
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3259%252F19763259%252Fexterior_rear_driver-1774525548294.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3259/19763259/exterior_rear_driver-1774525548294.jpg not downloaded yet
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5249%252F20155249%252Finterior_rear_seats-1774623604647.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5249/20155249/interior_rear_seats-1774623604647.jpg not downloaded yet
2026-03-29 20:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18704338.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2265%252F14132265%252Fexterior_front_passenger-1771253128136.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2265/14132265/exterior_front_passenger-1771253128136.jpeg not downloaded yet
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3259%252F19763259%252Fexterior_front_passenger-1774525578180.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3259/19763259/exterior_front_passenger-1774525578180.jpg not downloaded yet
2026-03-29 20:10:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5249%252F20155249%252Finterior_dashboard-1774693729347.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5249/20155249/interior_dashboard-1774693729347.jpg not downloaded yet
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2265%252F14132265%252Fexterior_rear_passenger-1771253158828.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2265/14132265/exterior_rear_passenger-1771253158828.jpeg not downloaded yet
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3259%252F19763259%252Fexterior_rear_passenger-1774526080336.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3259/19763259/exterior_rear_passenger-1774526080336.jpg not downloaded yet
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5249%252F20155249%252Finstrument_cluster-1774623606777.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5249/20155249/instrument_cluster-1774623606777.jpg not downloaded yet
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2265%252F14132265%252F14132265-interior_front_seats-modified-1771255666230.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2265/14132265/14132265-interior_front_seats-modified-1771255666230.jpeg not downloaded yet
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3259%252F19763259%252Finterior_front_seats-1774525792608.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3259/19763259/interior_front_seats-1774525792608.jpg not downloaded yet
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5249%252F20155249%252Finterior_boot-1774623574743.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5249/20155249/interior_boot-1774623574743.jpg not downloaded yet
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2265%252F14132265%252F14132265-interior_rear_seats-modified-1771255673013.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2265/14132265/14132265-interior_rear_seats-modified-1771255673013.jpeg not downloaded yet
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3259%252F19763259%252Finterior_rear_seats-1774525807095.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3259/19763259/interior_rear_seats-1774525807095.jpg not downloaded yet
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5249%252F20155249%252Fdamage_scratches-1774623055078.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5249/20155249/damage_scratches-1774623055078.jpg not downloaded yet
2026-03-29 20:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5d828c1-ecd3-53f9-8ec7-087397c0de68 with identifier: 18704338
2026-03-29 20:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5d828c1-ecd3-53f9-8ec7-087397c0de68 with scrape type 1
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e5d828c1-ecd3-53f9-8ec7-087397c0de68
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4338%252F18704338%252Fexterior_front_driver-1774716233187.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4338/18704338/exterior_front_driver-1774716233187.jpg not downloaded yet
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2265%252F14132265%252F14132265-interior_dashboard-modified-1771319367647.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2265/14132265/14132265-interior_dashboard-modified-1771319367647.jpeg not downloaded yet
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3259%252F19763259%252Finterior_dashboard-1774526303733.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3259/19763259/interior_dashboard-1774526303733.jpg not downloaded yet
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4338%252F18704338%252Fexterior_rear_driver-1774714006000.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4338/18704338/exterior_rear_driver-1774714006000.jpg not downloaded yet
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2265%252F14132265%252Finstrument_cluster-1771253271903.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2265/14132265/instrument_cluster-1771253271903.jpeg not downloaded yet
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3259%252F19763259%252Finstrument_cluster-1774525901926.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3259/19763259/instrument_cluster-1774525901926.jpg not downloaded yet
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4338%252F18704338%252Fexterior_front_passenger-1774719531547.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4338/18704338/exterior_front_passenger-1774719531547.jpg not downloaded yet
2026-03-29 20:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0113/18710113/exterior_rear_driver-1774545040697.jpeg> (referer: None)
2026-03-29 20:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0113/18710113/exterior_rear_passenger-1774545027651.jpeg> (referer: None)
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2265%252F14132265%252F14132265-interior_boot-modified-1771319373990.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2265/14132265/14132265-interior_boot-modified-1771319373990.jpeg not downloaded yet
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3259%252F19763259%252Finterior_boot-1774525840456.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3259/19763259/interior_boot-1774525840456.jpg not downloaded yet
2026-03-29 20:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0113/18710113/exterior_front_passenger-1774545016486.jpeg> (referer: None)
2026-03-29 20:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0113/18710113/exterior_front_driver-1774545007806.jpeg> (referer: None)
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4338%252F18704338%252Fexterior_rear_passenger-1774714010025.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4338/18704338/exterior_rear_passenger-1774714010025.jpg not downloaded yet
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F2265%252F14132265%252F14132265-docs_service_history-default-1771319587444.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Daa7c07c920ce0cc09332e8f927ca0228%27 HTTP/1.1" 200 None
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/2265/14132265/14132265-docs_service_history-default-1771319587444.jpg?ixlib=js-3.8.0&auto=format&s=aa7c07c920ce0cc09332e8f927ca0228 not downloaded yet
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3259%252F19763259%252Fdocs_service_history-1774629205544-2.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D677dfe30fbb54cda637f4db98f64316d%27 HTTP/1.1" 200 None
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3259/19763259/docs_service_history-1774629205544-2.jpeg?ixlib=js-3.8.0&auto=format&s=677dfe30fbb54cda637f4db98f64316d not downloaded yet
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4338%252F18704338%252Finterior_front_seats-1774714444806.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4338/18704338/interior_front_seats-1774714444806.jpg not downloaded yet
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4338%252F18704338%252Finterior_rear_seats-1774714441556.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4338/18704338/interior_rear_seats-1774714441556.jpg not downloaded yet
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599f16d0>
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d883a023-6f2e-5009-9c07-0ba6489d73a6/d883a023-6f2e-5009-9c07-0ba6489d73a6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0113%252F18710113%252Fexterior_rear_driver-1774545040697.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0113/18710113/exterior_rear_driver-1774545040697.jpeg saved to cache
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d883a023-6f2e-5009-9c07-0ba6489d73a6
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a68710>
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d883a023-6f2e-5009-9c07-0ba6489d73a6/d883a023-6f2e-5009-9c07-0ba6489d73a6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0113%252F18710113%252Fexterior_rear_passenger-1774545027651.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0113/18710113/exterior_rear_passenger-1774545027651.jpeg saved to cache
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d883a023-6f2e-5009-9c07-0ba6489d73a6
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4338%252F18704338%252Finterior_dashboard-1774714462321.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4338/18704338/interior_dashboard-1774714462321.jpg not downloaded yet
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4338%252F18704338%252Finstrument_cluster-1774714469964.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4338/18704338/instrument_cluster-1774714469964.jpg not downloaded yet
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b09610>
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d883a023-6f2e-5009-9c07-0ba6489d73a6/d883a023-6f2e-5009-9c07-0ba6489d73a6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0113%252F18710113%252Fexterior_front_passenger-1774545016486.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0113/18710113/exterior_front_passenger-1774545016486.jpeg saved to cache
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d883a023-6f2e-5009-9c07-0ba6489d73a6
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6585563d0>
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d883a023-6f2e-5009-9c07-0ba6489d73a6/d883a023-6f2e-5009-9c07-0ba6489d73a6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0113%252F18710113%252Fexterior_front_driver-1774545007806.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0113/18710113/exterior_front_driver-1774545007806.jpeg saved to cache
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d883a023-6f2e-5009-9c07-0ba6489d73a6
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4338%252F18704338%252Finterior_boot-1774714442499.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4338/18704338/interior_boot-1774714442499.jpg not downloaded yet
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4338%252F18704338%252Fdocs_service_history-1774714694320.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D34e7a25d03c4fe786f1f13b8bd679750%27 HTTP/1.1" 200 None
2026-03-29 20:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4338/18704338/docs_service_history-1774714694320.jpg?ixlib=js-3.8.0&auto=format&s=34e7a25d03c4fe786f1f13b8bd679750 not downloaded yet
2026-03-29 20:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3259/19763259/exterior_rear_driver-1774525548294.jpg> (referer: None)
2026-03-29 20:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3259/19763259/instrument_cluster-1774525901926.jpg> (referer: None)
2026-03-29 20:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2265/14132265/instrument_cluster-1771253271903.jpeg> (referer: None)
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f8db50>
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d71c2e1f-fcb3-582e-9908-55aa2af7754a/d71c2e1f-fcb3-582e-9908-55aa2af7754a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3259%252F19763259%252Fexterior_rear_driver-1774525548294.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3259/19763259/exterior_rear_driver-1774525548294.jpg saved to cache
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d71c2e1f-fcb3-582e-9908-55aa2af7754a
2026-03-29 20:10:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d6f250>
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d71c2e1f-fcb3-582e-9908-55aa2af7754a/d71c2e1f-fcb3-582e-9908-55aa2af7754a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3259%252F19763259%252Finstrument_cluster-1774525901926.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3259/19763259/instrument_cluster-1774525901926.jpg saved to cache
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d71c2e1f-fcb3-582e-9908-55aa2af7754a
2026-03-29 20:10:52 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:10:52 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:10:52 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00&b\xcf\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xce\xb7\x00&X\xbd\x00\x00\x00\x00'
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ced350>
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b4bb6b8-69c9-509e-abf0-c8b355b0fa3c/2b4bb6b8-69c9-509e-abf0-c8b355b0fa3c_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2265%252F14132265%252Finstrument_cluster-1771253271903.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2265/14132265/instrument_cluster-1771253271903.jpeg saved to cache
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2b4bb6b8-69c9-509e-abf0-c8b355b0fa3c
2026-03-29 20:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4338/18704338/docs_service_history-1774714694320.jpg?ixlib=js-3.8.0&auto=format&s=34e7a25d03c4fe786f1f13b8bd679750> (referer: None)
2026-03-29 20:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4338/18704338/interior_boot-1774714442499.jpg> (referer: None)
2026-03-29 20:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4338/18704338/interior_front_seats-1774714444806.jpg> (referer: None)
2026-03-29 20:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4338/18704338/interior_rear_seats-1774714441556.jpg> (referer: None)
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fe22d0>
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d828c1-ecd3-53f9-8ec7-087397c0de68/e5d828c1-ecd3-53f9-8ec7-087397c0de68_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4338%252F18704338%252Fdocs_service_history-1774714694320.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D34e7a25d03c4fe786f1f13b8bd679750') HTTP/1.1" 204 0
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4338/18704338/docs_service_history-1774714694320.jpg?ixlib=js-3.8.0&auto=format&s=34e7a25d03c4fe786f1f13b8bd679750 saved to cache
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e5d828c1-ecd3-53f9-8ec7-087397c0de68
2026-03-29 20:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19979923.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20460677.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586da050>
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d828c1-ecd3-53f9-8ec7-087397c0de68/e5d828c1-ecd3-53f9-8ec7-087397c0de68_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4338%252F18704338%252Finterior_boot-1774714442499.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4338/18704338/interior_boot-1774714442499.jpg saved to cache
2026-03-29 20:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e5d828c1-ecd3-53f9-8ec7-087397c0de68
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659008f10>
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d828c1-ecd3-53f9-8ec7-087397c0de68/e5d828c1-ecd3-53f9-8ec7-087397c0de68_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4338%252F18704338%252Finterior_front_seats-1774714444806.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4338/18704338/interior_front_seats-1774714444806.jpg saved to cache
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e5d828c1-ecd3-53f9-8ec7-087397c0de68
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65c004550>
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d828c1-ecd3-53f9-8ec7-087397c0de68/e5d828c1-ecd3-53f9-8ec7-087397c0de68_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4338%252F18704338%252Finterior_rear_seats-1774714441556.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4338/18704338/interior_rear_seats-1774714441556.jpg saved to cache
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e5d828c1-ecd3-53f9-8ec7-087397c0de68
2026-03-29 20:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3259/19763259/docs_service_history-1774629205544-2.jpeg?ixlib=js-3.8.0&auto=format&s=677dfe30fbb54cda637f4db98f64316d> (referer: None)
2026-03-29 20:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20443228.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66d63951-0842-558e-8c02-883583fbc10b with identifier: 19979923
2026-03-29 20:10:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66d63951-0842-558e-8c02-883583fbc10b with scrape type 1
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 66d63951-0842-558e-8c02-883583fbc10b
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9923%252F19979923%252Fexterior_front_driver-1774687582316.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9923/19979923/exterior_front_driver-1774687582316.jpg not downloaded yet
2026-03-29 20:10:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc0f7a7a-1142-576d-bd55-7618407cbfa2 with identifier: 20460677
2026-03-29 20:10:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc0f7a7a-1142-576d-bd55-7618407cbfa2 with scrape type 1
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dc0f7a7a-1142-576d-bd55-7618407cbfa2
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0677%252F20460677%252Fexterior_front_driver-1774701256190.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0677/20460677/exterior_front_driver-1774701256190.jpg not downloaded yet
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9923%252F19979923%252Fexterior_rear_driver-1774687601035.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9923/19979923/exterior_rear_driver-1774687601035.jpg not downloaded yet
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0677%252F20460677%252Fexterior_rear_driver-1774701396163.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0677/20460677/exterior_rear_driver-1774701396163.jpg not downloaded yet
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9923%252F19979923%252Fexterior_front_passenger-1774687628114.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9923/19979923/exterior_front_passenger-1774687628114.jpg not downloaded yet
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0677%252F20460677%252Fexterior_front_passenger-1774701356256.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0677/20460677/exterior_front_passenger-1774701356256.jpg not downloaded yet
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ce4c90>
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d71c2e1f-fcb3-582e-9908-55aa2af7754a/d71c2e1f-fcb3-582e-9908-55aa2af7754a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3259%252F19763259%252Fdocs_service_history-1774629205544-2.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D677dfe30fbb54cda637f4db98f64316d') HTTP/1.1" 204 0
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3259/19763259/docs_service_history-1774629205544-2.jpeg?ixlib=js-3.8.0&auto=format&s=677dfe30fbb54cda637f4db98f64316d saved to cache
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d71c2e1f-fcb3-582e-9908-55aa2af7754a
2026-03-29 20:10:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbfc2172-71b7-5edf-b629-7bba3f4ede35 with identifier: 20443228
2026-03-29 20:10:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbfc2172-71b7-5edf-b629-7bba3f4ede35 with scrape type 1
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cbfc2172-71b7-5edf-b629-7bba3f4ede35
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3228%252F20443228%252Fexterior_front_driver-1774781401506.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3228/20443228/exterior_front_driver-1774781401506.jpg not downloaded yet
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9923%252F19979923%252Fexterior_rear_passenger-1774687611723.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9923/19979923/exterior_rear_passenger-1774687611723.jpg not downloaded yet
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0677%252F20460677%252Fexterior_rear_passenger-1774701330787.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0677/20460677/exterior_rear_passenger-1774701330787.jpg not downloaded yet
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3228%252F20443228%252Fexterior_rear_driver-1774780516482.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3228/20443228/exterior_rear_driver-1774780516482.jpg not downloaded yet
2026-03-29 20:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20488190.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9923%252F19979923%252Finterior_front_seats-1774688449459.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9923/19979923/interior_front_seats-1774688449459.jpg not downloaded yet
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0677%252F20460677%252Finterior_front_seats-1774702101009.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0677/20460677/interior_front_seats-1774702101009.jpg not downloaded yet
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3228%252F20443228%252Fexterior_front_passenger-1774780589884.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3228/20443228/exterior_front_passenger-1774780589884.jpg not downloaded yet
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9923%252F19979923%252Finterior_rear_seats-1774687966122.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9923/19979923/interior_rear_seats-1774687966122.jpg not downloaded yet
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0677%252F20460677%252Finterior_rear_seats-1774702126597.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0677/20460677/interior_rear_seats-1774702126597.jpg not downloaded yet
2026-03-29 20:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4338/18704338/instrument_cluster-1774714469964.jpg> (referer: None)
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3228%252F20443228%252Fexterior_rear_passenger-1774781490708.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3228/20443228/exterior_rear_passenger-1774781490708.jpg not downloaded yet
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9923%252F19979923%252Finterior_dashboard-1774698880698.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9923/19979923/interior_dashboard-1774698880698.jpg not downloaded yet
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0677%252F20460677%252Finterior_dashboard-1774702157620.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0677/20460677/interior_dashboard-1774702157620.jpg not downloaded yet
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3228%252F20443228%252Finterior_front_seats-1774781259038.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3228/20443228/interior_front_seats-1774781259038.jpg not downloaded yet
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9923%252F19979923%252F19979923-instrument_cluster-modified-1774792205744.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9923/19979923/19979923-instrument_cluster-modified-1774792205744.jpeg not downloaded yet
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0677%252F20460677%252Finterior_boot-1774702196482.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0677/20460677/interior_boot-1774702196482.jpg not downloaded yet
2026-03-29 20:10:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb4abeba-0bb1-5d32-906c-02136d7225c0 with identifier: 20488190
2026-03-29 20:10:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb4abeba-0bb1-5d32-906c-02136d7225c0 with scrape type 1
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb4abeba-0bb1-5d32-906c-02136d7225c0
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8190%252F20488190%252Fexterior_front_driver-1774711648418.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8190/20488190/exterior_front_driver-1774711648418.jpg not downloaded yet
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3228%252F20443228%252Finterior_rear_seats-1774781157398.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3228/20443228/interior_rear_seats-1774781157398.jpg not downloaded yet
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9923%252F19979923%252Finterior_boot-1774698899376.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9923/19979923/interior_boot-1774698899376.jpg not downloaded yet
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0677%252F20460677%252Fdocs_service_history-1774702523422.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D960573181b896f56cf8f14522b94268b%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0677/20460677/docs_service_history-1774702523422.jpg?ixlib=js-3.8.0&auto=format&s=960573181b896f56cf8f14522b94268b not downloaded yet
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8190%252F20488190%252Fexterior_rear_driver-1774711690794.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8190/20488190/exterior_rear_driver-1774711690794.jpg not downloaded yet
2026-03-29 20:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4338/18704338/interior_dashboard-1774714462321.jpg> (referer: None)
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3228%252F20443228%252Finterior_dashboard-1774781190042.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3228/20443228/interior_dashboard-1774781190042.jpg not downloaded yet
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9923%252F19979923%252Fdocs_service_history-1774697436475.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcfc0d561f774e16dd35a963fb7d42e12%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9923/19979923/docs_service_history-1774697436475.jpg?ixlib=js-3.8.0&auto=format&s=cfc0d561f774e16dd35a963fb7d42e12 not downloaded yet
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0677%252F20460677%252Fdocs_service_history-1774702525102.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D119b5ff55667d5feacc79e19296f50b8%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0677/20460677/docs_service_history-1774702525102.jpg?ixlib=js-3.8.0&auto=format&s=119b5ff55667d5feacc79e19296f50b8 not downloaded yet
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8190%252F20488190%252Fexterior_front_passenger-1774711717136.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8190/20488190/exterior_front_passenger-1774711717136.jpg not downloaded yet
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584c85d0>
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d828c1-ecd3-53f9-8ec7-087397c0de68/e5d828c1-ecd3-53f9-8ec7-087397c0de68_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4338%252F18704338%252Finstrument_cluster-1774714469964.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4338/18704338/instrument_cluster-1774714469964.jpg saved to cache
2026-03-29 20:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e5d828c1-ecd3-53f9-8ec7-087397c0de68
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3228%252F20443228%252Finstrument_cluster-1774791420776.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3228/20443228/instrument_cluster-1774791420776.jpg not downloaded yet
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8190%252F20488190%252Fexterior_rear_passenger-1774711703005.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8190/20488190/exterior_rear_passenger-1774711703005.jpg not downloaded yet
2026-03-29 20:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/6579411.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20421154.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20382764.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3228%252F20443228%252Finterior_boot-1774781195845.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3228/20443228/interior_boot-1774781195845.jpg not downloaded yet
2026-03-29 20:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658302510>
2026-03-29 20:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d828c1-ecd3-53f9-8ec7-087397c0de68/e5d828c1-ecd3-53f9-8ec7-087397c0de68_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4338%252F18704338%252Finterior_dashboard-1774714462321.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4338/18704338/interior_dashboard-1774714462321.jpg saved to cache
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e5d828c1-ecd3-53f9-8ec7-087397c0de68
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8190%252F20488190%252Finterior_front_seats-1774712233699.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8190/20488190/interior_front_seats-1774712233699.jpg not downloaded yet
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3228%252F20443228%252Fdocs_service_history-1774781702641.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D348748a5b6e5ea406df98d9d14ade07f%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3228/20443228/docs_service_history-1774781702641.jpg?ixlib=js-3.8.0&auto=format&s=348748a5b6e5ea406df98d9d14ade07f not downloaded yet
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8190%252F20488190%252Finterior_rear_seats-1774712072680.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8190/20488190/interior_rear_seats-1774712072680.jpg not downloaded yet
2026-03-29 20:10:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc90a8eb-953b-59a1-b8f5-1455e87fb37a with identifier: 6579411
2026-03-29 20:10:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc90a8eb-953b-59a1-b8f5-1455e87fb37a with scrape type 1
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cc90a8eb-953b-59a1-b8f5-1455e87fb37a
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9411%252F6579411%252Fexterior_front_driver-1774022836112.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9411/6579411/exterior_front_driver-1774022836112.jpg not downloaded yet
2026-03-29 20:10:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd956f99-886a-54cd-a617-5b8f616c26dc with identifier: 20421154
2026-03-29 20:10:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd956f99-886a-54cd-a617-5b8f616c26dc with scrape type 1
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fd956f99-886a-54cd-a617-5b8f616c26dc
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1154%252F20421154%252Fexterior_front_driver-1774692105618.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1154/20421154/exterior_front_driver-1774692105618.jpeg not downloaded yet
2026-03-29 20:10:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5544130f-c3f2-5032-a791-daa4bd9280e6 with identifier: 20382764
2026-03-29 20:10:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5544130f-c3f2-5032-a791-daa4bd9280e6 with scrape type 1
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5544130f-c3f2-5032-a791-daa4bd9280e6
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2764%252F20382764%252Fexterior_front_driver-1774191335858.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2764/20382764/exterior_front_driver-1774191335858.jpg not downloaded yet
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8190%252F20488190%252Finterior_dashboard-1774712301390.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8190/20488190/interior_dashboard-1774712301390.jpg not downloaded yet
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9411%252F6579411%252Fexterior_rear_driver-1774010170410.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9411/6579411/exterior_rear_driver-1774010170410.jpg not downloaded yet
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1154%252F20421154%252Fexterior_rear_driver-1774692188468.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1154/20421154/exterior_rear_driver-1774692188468.jpeg not downloaded yet
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2764%252F20382764%252Fexterior_rear_driver-1774191373011.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2764/20382764/exterior_rear_driver-1774191373011.jpg not downloaded yet
2026-03-29 20:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4338/18704338/exterior_rear_passenger-1774714010025.jpg> (referer: None)
2026-03-29 20:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4338/18704338/exterior_rear_driver-1774714006000.jpg> (referer: None)
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8190%252F20488190%252Finstrument_cluster-1774712155992.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8190/20488190/instrument_cluster-1774712155992.jpg not downloaded yet
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9411%252F6579411%252Fexterior_front_passenger-1773760084607.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9411/6579411/exterior_front_passenger-1773760084607.jpg not downloaded yet
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1154%252F20421154%252Fexterior_front_passenger-1774692083522.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1154/20421154/exterior_front_passenger-1774692083522.jpeg not downloaded yet
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2764%252F20382764%252Fexterior_front_passenger-1774191419320.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2764/20382764/exterior_front_passenger-1774191419320.jpg not downloaded yet
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8190%252F20488190%252Finterior_boot-1774712188293.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8190/20488190/interior_boot-1774712188293.jpg not downloaded yet
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9411%252F6579411%252Fexterior_rear_passenger-1774010154026.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9411/6579411/exterior_rear_passenger-1774010154026.jpg not downloaded yet
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1154%252F20421154%252Fexterior_rear_passenger-1774692121084.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1154/20421154/exterior_rear_passenger-1774692121084.jpeg not downloaded yet
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2764%252F20382764%252Fexterior_rear_passenger-1774191402222.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2764/20382764/exterior_rear_passenger-1774191402222.jpg not downloaded yet
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8190%252F20488190%252Fdocs_service_history-1774719421636.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3c72fe805eb5b7ca00dc22479c0a170e%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8190/20488190/docs_service_history-1774719421636.jpg?ixlib=js-3.8.0&auto=format&s=3c72fe805eb5b7ca00dc22479c0a170e not downloaded yet
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9411%252F6579411%252Finterior_front_seats-1774785595198.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9411/6579411/interior_front_seats-1774785595198.jpg not downloaded yet
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1154%252F20421154%252Finterior_front_seats-1774692226518.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1154/20421154/interior_front_seats-1774692226518.jpeg not downloaded yet
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2764%252F20382764%252Finterior_front_seats-1774191968305.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2764/20382764/interior_front_seats-1774191968305.jpg not downloaded yet
2026-03-29 20:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582e50d0>
2026-03-29 20:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d828c1-ecd3-53f9-8ec7-087397c0de68/e5d828c1-ecd3-53f9-8ec7-087397c0de68_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4338%252F18704338%252Fexterior_rear_passenger-1774714010025.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4338/18704338/exterior_rear_passenger-1774714010025.jpg saved to cache
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e5d828c1-ecd3-53f9-8ec7-087397c0de68
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a11e10>
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d828c1-ecd3-53f9-8ec7-087397c0de68/e5d828c1-ecd3-53f9-8ec7-087397c0de68_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4338%252F18704338%252Fexterior_rear_driver-1774714006000.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4338/18704338/exterior_rear_driver-1774714006000.jpg saved to cache
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e5d828c1-ecd3-53f9-8ec7-087397c0de68
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9411%252F6579411%252Finterior_dashboard-1774549033458.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9411/6579411/interior_dashboard-1774549033458.jpg not downloaded yet
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1154%252F20421154%252Finterior_rear_seats-1774692417495.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1154/20421154/interior_rear_seats-1774692417495.jpeg not downloaded yet
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2764%252F20382764%252Finterior_rear_seats-1774191983224.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2764/20382764/interior_rear_seats-1774191983224.jpg not downloaded yet
2026-03-29 20:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/2265/14132265/14132265-docs_service_history-default-1771319587444.jpg?ixlib=js-3.8.0&auto=format&s=aa7c07c920ce0cc09332e8f927ca0228> (referer: None)
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9411%252F6579411%252Finstrument_cluster-1774785610237.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9411/6579411/instrument_cluster-1774785610237.jpg not downloaded yet
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1154%252F20421154%252Finterior_dashboard-1774692479333.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1154/20421154/interior_dashboard-1774692479333.jpeg not downloaded yet
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2764%252F20382764%252Finterior_dashboard-1774619879963.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2764/20382764/interior_dashboard-1774619879963.jpg not downloaded yet
2026-03-29 20:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0677/20460677/exterior_rear_passenger-1774701330787.jpg> (referer: None)
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9411%252F6579411%252Finterior_boot-1774785576012.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9411/6579411/interior_boot-1774785576012.jpg not downloaded yet
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1154%252F20421154%252Finstrument_cluster-1774692510485.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1154/20421154/instrument_cluster-1774692510485.jpeg not downloaded yet
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2764%252F20382764%252Finterior_boot-1774690901238.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2764/20382764/interior_boot-1774690901238.jpg not downloaded yet
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9411%252F6579411%252Fdocs_service_history-1774010479382.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfa2712d22b94be0caf51a7aef85778d1%27 HTTP/1.1" 200 None
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9411/6579411/docs_service_history-1774010479382.jpg?ixlib=js-3.8.0&auto=format&s=fa2712d22b94be0caf51a7aef85778d1 not downloaded yet
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1154%252F20421154%252F20421154-interior_boot-modified-1774704031806.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1154/20421154/20421154-interior_boot-modified-1774704031806.jpeg not downloaded yet
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2764%252F20382764%252Fdocs_service_history-1774192278591.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd7fa27031db40a44f4833c55e8764b9b%27 HTTP/1.1" 200 None
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2764/20382764/docs_service_history-1774192278591.jpg?ixlib=js-3.8.0&auto=format&s=d7fa27031db40a44f4833c55e8764b9b not downloaded yet
2026-03-29 20:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2265/14132265/14132265-interior_boot-modified-1771319373990.jpeg> (referer: None)
2026-03-29 20:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4338/18704338/exterior_front_passenger-1774719531547.jpg> (referer: None)
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ab3610>
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b4bb6b8-69c9-509e-abf0-c8b355b0fa3c/2b4bb6b8-69c9-509e-abf0-c8b355b0fa3c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F2265%252F14132265%252F14132265-docs_service_history-default-1771319587444.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Daa7c07c920ce0cc09332e8f927ca0228') HTTP/1.1" 204 0
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/2265/14132265/14132265-docs_service_history-default-1771319587444.jpg?ixlib=js-3.8.0&auto=format&s=aa7c07c920ce0cc09332e8f927ca0228 saved to cache
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2b4bb6b8-69c9-509e-abf0-c8b355b0fa3c
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9411%252F6579411%252Fdocs_service_history-1774010492828.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D778966c75fec340da6c4a96ebca1eb44%27 HTTP/1.1" 200 None
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9411/6579411/docs_service_history-1774010492828.jpg?ixlib=js-3.8.0&auto=format&s=778966c75fec340da6c4a96ebca1eb44 not downloaded yet
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1154%252F20421154%252Fdocs_service_history-1774703439091.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc5e747a624c15f5f13972d5a1426ba50%27 HTTP/1.1" 200 None
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1154/20421154/docs_service_history-1774703439091.jpeg?ixlib=js-3.8.0&auto=format&s=c5e747a624c15f5f13972d5a1426ba50 not downloaded yet
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2764%252F20382764%252Fdocs_service_history-1774193017662.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfa8eb46feb1af235ae6f468bb7eb477d%27 HTTP/1.1" 200 None
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2764/20382764/docs_service_history-1774193017662.jpg?ixlib=js-3.8.0&auto=format&s=fa8eb46feb1af235ae6f468bb7eb477d not downloaded yet
2026-03-29 20:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16449198.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ab2f90>
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc0f7a7a-1142-576d-bd55-7618407cbfa2/dc0f7a7a-1142-576d-bd55-7618407cbfa2_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0677%252F20460677%252Fexterior_rear_passenger-1774701330787.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0677/20460677/exterior_rear_passenger-1774701330787.jpg saved to cache
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dc0f7a7a-1142-576d-bd55-7618407cbfa2
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa669915310>
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b4bb6b8-69c9-509e-abf0-c8b355b0fa3c/2b4bb6b8-69c9-509e-abf0-c8b355b0fa3c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2265%252F14132265%252F14132265-interior_boot-modified-1771319373990.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2265/14132265/14132265-interior_boot-modified-1771319373990.jpeg saved to cache
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2b4bb6b8-69c9-509e-abf0-c8b355b0fa3c
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d6f5d0>
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d828c1-ecd3-53f9-8ec7-087397c0de68/e5d828c1-ecd3-53f9-8ec7-087397c0de68_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4338%252F18704338%252Fexterior_front_passenger-1774719531547.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4338/18704338/exterior_front_passenger-1774719531547.jpg saved to cache
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e5d828c1-ecd3-53f9-8ec7-087397c0de68
2026-03-29 20:10:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a4bb774-fb21-5bbb-9099-5c3a04d7469a with identifier: 16449198
2026-03-29 20:10:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a4bb774-fb21-5bbb-9099-5c3a04d7469a with scrape type 1
2026-03-29 20:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5a4bb774-fb21-5bbb-9099-5c3a04d7469a
2026-03-29 20:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9198%252F16449198%252Fexterior_front_driver-1774703016570.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9198/16449198/exterior_front_driver-1774703016570.jpg not downloaded yet
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9198%252F16449198%252Fexterior_rear_driver-1774703014888.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9198/16449198/exterior_rear_driver-1774703014888.jpg not downloaded yet
2026-03-29 20:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=144&page=4&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3228/20443228/exterior_front_passenger-1774780589884.jpg> (referer: None)
2026-03-29 20:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3228/20443228/instrument_cluster-1774791420776.jpg> (referer: None)
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9198%252F16449198%252Fexterior_front_passenger-1774703012732.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9198/16449198/exterior_front_passenger-1774703012732.jpg not downloaded yet
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9198%252F16449198%252Fexterior_rear_passenger-1774703011296.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9198/16449198/exterior_rear_passenger-1774703011296.jpg not downloaded yet
2026-03-29 20:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8190/20488190/exterior_rear_driver-1774711690794.jpg> (referer: None)
2026-03-29 20:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1154/20421154/exterior_rear_driver-1774692188468.jpeg> (referer: None)
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9198%252F16449198%252Finterior_front_seats-1774702993367.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9198/16449198/interior_front_seats-1774702993367.jpg not downloaded yet
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9198%252F16449198%252Finterior_rear_seats-1774702996639.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9198/16449198/interior_rear_seats-1774702996639.jpg not downloaded yet
2026-03-29 20:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2764/20382764/exterior_rear_driver-1774191373011.jpg> (referer: None)
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9198%252F16449198%252Finterior_dashboard-1774703010047.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9198/16449198/interior_dashboard-1774703010047.jpg not downloaded yet
2026-03-29 20:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8190/20488190/exterior_rear_passenger-1774711703005.jpg> (referer: None)
2026-03-29 20:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2764/20382764/docs_service_history-1774193017662.jpg?ixlib=js-3.8.0&auto=format&s=fa8eb46feb1af235ae6f468bb7eb477d> (referer: None)
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9198%252F16449198%252Finterior_boot-1774702998228.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9198/16449198/interior_boot-1774702998228.jpg not downloaded yet
2026-03-29 20:10:56 [motorway.uk] INFO: Found listing with ID: 20490005
2026-03-29 20:10:56 [motorway.uk] INFO: Found listing with ID: 6813303
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%276813303%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [motorway.uk] INFO: Scrape type for 6813303: 1
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584f2b50>
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbfc2172-71b7-5edf-b629-7bba3f4ede35/cbfc2172-71b7-5edf-b629-7bba3f4ede35_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3228%252F20443228%252Fexterior_front_passenger-1774780589884.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3228/20443228/exterior_front_passenger-1774780589884.jpg saved to cache
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cbfc2172-71b7-5edf-b629-7bba3f4ede35
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65830ec10>
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbfc2172-71b7-5edf-b629-7bba3f4ede35/cbfc2172-71b7-5edf-b629-7bba3f4ede35_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3228%252F20443228%252Finstrument_cluster-1774791420776.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3228/20443228/instrument_cluster-1774791420776.jpg saved to cache
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cbfc2172-71b7-5edf-b629-7bba3f4ede35
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9198%252F16449198%252Fwheels_front_driver-1774703115521.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9198/16449198/wheels_front_driver-1774703115521.jpg not downloaded yet
2026-03-29 20:10:56 [motorway.uk] INFO: Found listing with ID: 20443922
2026-03-29 20:10:56 [motorway.uk] INFO: Found listing with ID: 20487361
2026-03-29 20:10:56 [motorway.uk] INFO: Found listing with ID: 20363550
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720363550%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [motorway.uk] INFO: Scrape type for 20363550: 1
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659cf5650>
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb4abeba-0bb1-5d32-906c-02136d7225c0/cb4abeba-0bb1-5d32-906c-02136d7225c0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8190%252F20488190%252Fexterior_rear_driver-1774711690794.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8190/20488190/exterior_rear_driver-1774711690794.jpg saved to cache
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb4abeba-0bb1-5d32-906c-02136d7225c0
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659eb3310>
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd956f99-886a-54cd-a617-5b8f616c26dc/fd956f99-886a-54cd-a617-5b8f616c26dc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1154%252F20421154%252Fexterior_rear_driver-1774692188468.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1154/20421154/exterior_rear_driver-1774692188468.jpeg saved to cache
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fd956f99-886a-54cd-a617-5b8f616c26dc
2026-03-29 20:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3259/19763259/interior_boot-1774525840456.jpg> (referer: None)
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9198%252F16449198%252Fwheels_rear_driver-1774703115954.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9198/16449198/wheels_rear_driver-1774703115954.jpg not downloaded yet
2026-03-29 20:10:56 [motorway.uk] INFO: Found listing with ID: 9266502
2026-03-29 20:10:56 [motorway.uk] INFO: Found listing with ID: 19877308
2026-03-29 20:10:56 [motorway.uk] INFO: Found listing with ID: 17678385
2026-03-29 20:10:56 [motorway.uk] INFO: Found listing with ID: 20457330
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720457330%27 HTTP/1.1" 200 None
2026-03-29 20:10:56 [motorway.uk] INFO: Scrape type for 20457330: 1
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a7b950>
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5544130f-c3f2-5032-a791-daa4bd9280e6/5544130f-c3f2-5032-a791-daa4bd9280e6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2764%252F20382764%252Fexterior_rear_driver-1774191373011.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2764/20382764/exterior_rear_driver-1774191373011.jpg saved to cache
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5544130f-c3f2-5032-a791-daa4bd9280e6
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584164d0>
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb4abeba-0bb1-5d32-906c-02136d7225c0/cb4abeba-0bb1-5d32-906c-02136d7225c0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8190%252F20488190%252Fexterior_rear_passenger-1774711703005.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8190/20488190/exterior_rear_passenger-1774711703005.jpg saved to cache
2026-03-29 20:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb4abeba-0bb1-5d32-906c-02136d7225c0
2026-03-29 20:10:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659985390>
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5544130f-c3f2-5032-a791-daa4bd9280e6/5544130f-c3f2-5032-a791-daa4bd9280e6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2764%252F20382764%252Fdocs_service_history-1774193017662.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfa8eb46feb1af235ae6f468bb7eb477d') HTTP/1.1" 204 0
2026-03-29 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2764/20382764/docs_service_history-1774193017662.jpg?ixlib=js-3.8.0&auto=format&s=fa8eb46feb1af235ae6f468bb7eb477d saved to cache
2026-03-29 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5544130f-c3f2-5032-a791-daa4bd9280e6
2026-03-29 20:10:57 [motorway.uk] INFO: Found listing with ID: 10427170
2026-03-29 20:10:57 [motorway.uk] INFO: Found listing with ID: 20496977
2026-03-29 20:10:57 [motorway.uk] INFO: Found listing with ID: 20251350
2026-03-29 20:10:57 [motorway.uk] INFO: Found listing with ID: 20431049
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720431049%27 HTTP/1.1" 200 None
2026-03-29 20:10:57 [motorway.uk] INFO: Scrape type for 20431049: 1
2026-03-29 20:10:57 [motorway.uk] INFO: Found listing with ID: 20500887
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720500887%27 HTTP/1.1" 200 None
2026-03-29 20:10:57 [motorway.uk] INFO: Scrape type for 20500887: 1
2026-03-29 20:10:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599ff310>
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d71c2e1f-fcb3-582e-9908-55aa2af7754a/d71c2e1f-fcb3-582e-9908-55aa2af7754a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3259%252F19763259%252Finterior_boot-1774525840456.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3259/19763259/interior_boot-1774525840456.jpg saved to cache
2026-03-29 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d71c2e1f-fcb3-582e-9908-55aa2af7754a
2026-03-29 20:10:57 [motorway.uk] INFO: Found listing with ID: 20491991
2026-03-29 20:10:57 [motorway.uk] INFO: Found listing with ID: 19662517
2026-03-29 20:10:57 [motorway.uk] INFO: Found listing with ID: 20437069
2026-03-29 20:10:57 [motorway.uk] INFO: Found listing with ID: 20439564
2026-03-29 20:10:57 [motorway.uk] INFO: Found listing with ID: 3925743
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273925743%27 HTTP/1.1" 200 None
2026-03-29 20:10:57 [motorway.uk] INFO: Scrape type for 3925743: 1
2026-03-29 20:10:57 [motorway.uk] INFO: Found listing with ID: 20473314
2026-03-29 20:10:57 [motorway.uk] INFO: Found listing with ID: 19289424
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719289424%27 HTTP/1.1" 200 None
2026-03-29 20:10:57 [motorway.uk] INFO: Scrape type for 19289424: 1
2026-03-29 20:10:57 [motorway.uk] INFO: Found listing with ID: 13901334
2026-03-29 20:10:57 [motorway.uk] INFO: Found listing with ID: 19716040
2026-03-29 20:10:57 [motorway.uk] INFO: Found listing with ID: 19665928
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719665928%27 HTTP/1.1" 200 None
2026-03-29 20:10:57 [motorway.uk] INFO: Scrape type for 19665928: 1
2026-03-29 20:10:57 [motorway.uk] INFO: Found listing with ID: 20477540
2026-03-29 20:10:57 [motorway.uk] INFO: Found listing with ID: 20488894
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488894%27 HTTP/1.1" 200 None
2026-03-29 20:10:57 [motorway.uk] INFO: Scrape type for 20488894: 1
2026-03-29 20:10:57 [motorway.uk] INFO: Found listing with ID: 20392952
2026-03-29 20:10:57 [motorway.uk] INFO: Found listing with ID: 20448956
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720448956%27 HTTP/1.1" 200 None
2026-03-29 20:10:57 [motorway.uk] INFO: Scrape type for 20448956: 1
2026-03-29 20:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1154/20421154/docs_service_history-1774703439091.jpeg?ixlib=js-3.8.0&auto=format&s=c5e747a624c15f5f13972d5a1426ba50> (referer: None)
2026-03-29 20:10:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:57 [motorway.uk] INFO: Found listing with ID: 4497838
2026-03-29 20:10:57 [motorway.uk] INFO: Found listing with ID: 20408834
2026-03-29 20:10:57 [motorway.uk] INFO: Found listing with ID: 20494023
2026-03-29 20:10:57 [motorway.uk] INFO: Found listing with ID: 19574622
2026-03-29 20:10:57 [motorway.uk] INFO: Found listing with ID: 20483061
2026-03-29 20:10:57 [motorway.uk] INFO: Found listing with ID: 20487257
2026-03-29 20:10:57 [motorway.uk] INFO: Found listing with ID: 19110205
2026-03-29 20:10:57 [motorway.uk] INFO: Found listing with ID: 7326413
2026-03-29 20:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2764/20382764/interior_rear_seats-1774191983224.jpg> (referer: None)
2026-03-29 20:10:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3228/20443228/interior_boot-1774781195845.jpg> (referer: None)
2026-03-29 20:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1154/20421154/20421154-interior_boot-modified-1774704031806.jpeg> (referer: None)
2026-03-29 20:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9198/16449198/exterior_rear_driver-1774703014888.jpg> (referer: None)
2026-03-29 20:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9411/6579411/docs_service_history-1774010492828.jpg?ixlib=js-3.8.0&auto=format&s=778966c75fec340da6c4a96ebca1eb44> (referer: None)
2026-03-29 20:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9198/16449198/exterior_front_driver-1774703016570.jpg> (referer: None)
2026-03-29 20:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2764/20382764/docs_service_history-1774192278591.jpg?ixlib=js-3.8.0&auto=format&s=d7fa27031db40a44f4833c55e8764b9b> (referer: None)
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b2cc90>
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd956f99-886a-54cd-a617-5b8f616c26dc/fd956f99-886a-54cd-a617-5b8f616c26dc_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1154%252F20421154%252Fdocs_service_history-1774703439091.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc5e747a624c15f5f13972d5a1426ba50') HTTP/1.1" 204 0
2026-03-29 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1154/20421154/docs_service_history-1774703439091.jpeg?ixlib=js-3.8.0&auto=format&s=c5e747a624c15f5f13972d5a1426ba50 saved to cache
2026-03-29 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fd956f99-886a-54cd-a617-5b8f616c26dc
2026-03-29 20:10:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d7f710>
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5544130f-c3f2-5032-a791-daa4bd9280e6/5544130f-c3f2-5032-a791-daa4bd9280e6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2764%252F20382764%252Finterior_rear_seats-1774191983224.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2764/20382764/interior_rear_seats-1774191983224.jpg saved to cache
2026-03-29 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5544130f-c3f2-5032-a791-daa4bd9280e6
2026-03-29 20:10:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:10:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d88e10>
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cbfc2172-71b7-5edf-b629-7bba3f4ede35/cbfc2172-71b7-5edf-b629-7bba3f4ede35_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3228%252F20443228%252Finterior_boot-1774781195845.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3228/20443228/interior_boot-1774781195845.jpg saved to cache
2026-03-29 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cbfc2172-71b7-5edf-b629-7bba3f4ede35
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65901d590>
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd956f99-886a-54cd-a617-5b8f616c26dc/fd956f99-886a-54cd-a617-5b8f616c26dc_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1154%252F20421154%252F20421154-interior_boot-modified-1774704031806.jpeg') HTTP/1.1" 204 0
2026-03-29 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1154/20421154/20421154-interior_boot-modified-1774704031806.jpeg saved to cache
2026-03-29 20:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fd956f99-886a-54cd-a617-5b8f616c26dc
2026-03-29 20:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bed050>
2026-03-29 20:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a4bb774-fb21-5bbb-9099-5c3a04d7469a/5a4bb774-fb21-5bbb-9099-5c3a04d7469a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9198%252F16449198%252Fexterior_rear_driver-1774703014888.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9198/16449198/exterior_rear_driver-1774703014888.jpg saved to cache
2026-03-29 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5a4bb774-fb21-5bbb-9099-5c3a04d7469a
2026-03-29 20:10:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599fc810>
2026-03-29 20:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc90a8eb-953b-59a1-b8f5-1455e87fb37a/cc90a8eb-953b-59a1-b8f5-1455e87fb37a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9411%252F6579411%252Fdocs_service_history-1774010492828.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D778966c75fec340da6c4a96ebca1eb44') HTTP/1.1" 204 0
2026-03-29 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9411/6579411/docs_service_history-1774010492828.jpg?ixlib=js-3.8.0&auto=format&s=778966c75fec340da6c4a96ebca1eb44 saved to cache
2026-03-29 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cc90a8eb-953b-59a1-b8f5-1455e87fb37a
2026-03-29 20:10:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65830a750>
2026-03-29 20:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a4bb774-fb21-5bbb-9099-5c3a04d7469a/5a4bb774-fb21-5bbb-9099-5c3a04d7469a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9198%252F16449198%252Fexterior_front_driver-1774703016570.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9198/16449198/exterior_front_driver-1774703016570.jpg saved to cache
2026-03-29 20:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5a4bb774-fb21-5bbb-9099-5c3a04d7469a
2026-03-29 20:10:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:10:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:10:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:10:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:10:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e5e8d0>
2026-03-29 20:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5544130f-c3f2-5032-a791-daa4bd9280e6/5544130f-c3f2-5032-a791-daa4bd9280e6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2764%252F20382764%252Fdocs_service_history-1774192278591.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd7fa27031db40a44f4833c55e8764b9b') HTTP/1.1" 204 0
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2764/20382764/docs_service_history-1774192278591.jpg?ixlib=js-3.8.0&auto=format&s=d7fa27031db40a44f4833c55e8764b9b saved to cache
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5544130f-c3f2-5032-a791-daa4bd9280e6
2026-03-29 20:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9198/16449198/wheels_front_driver-1774703115521.jpg> (referer: None)
2026-03-29 20:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9198/16449198/wheels_rear_driver-1774703115954.jpg> (referer: None)
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ff4810>
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a4bb774-fb21-5bbb-9099-5c3a04d7469a/5a4bb774-fb21-5bbb-9099-5c3a04d7469a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9198%252F16449198%252Fwheels_front_driver-1774703115521.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9198/16449198/wheels_front_driver-1774703115521.jpg saved to cache
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5a4bb774-fb21-5bbb-9099-5c3a04d7469a
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65bc44190>
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a4bb774-fb21-5bbb-9099-5c3a04d7469a/5a4bb774-fb21-5bbb-9099-5c3a04d7469a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9198%252F16449198%252Fwheels_rear_driver-1774703115954.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9198/16449198/wheels_rear_driver-1774703115954.jpg saved to cache
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5a4bb774-fb21-5bbb-9099-5c3a04d7469a
2026-03-29 20:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20431049.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:10:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9198/16449198/interior_rear_seats-1774702996639.jpg> (referer: None)
2026-03-29 20:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9198/16449198/interior_dashboard-1774703010047.jpg> (referer: None)
2026-03-29 20:10:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7f7deca-cf33-54fc-8cac-1b599d6a23af with identifier: 20431049
2026-03-29 20:10:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7f7deca-cf33-54fc-8cac-1b599d6a23af with scrape type 1
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f7f7deca-cf33-54fc-8cac-1b599d6a23af
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1049%252F20431049%252Fexterior_front_driver-1774722162605.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1049/20431049/exterior_front_driver-1774722162605.jpg not downloaded yet
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1049%252F20431049%252Fexterior_rear_driver-1774722180068.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1049/20431049/exterior_rear_driver-1774722180068.jpg not downloaded yet
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1049%252F20431049%252Fexterior_front_passenger-1774722201407.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1049/20431049/exterior_front_passenger-1774722201407.jpg not downloaded yet
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65852d2d0>
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a4bb774-fb21-5bbb-9099-5c3a04d7469a/5a4bb774-fb21-5bbb-9099-5c3a04d7469a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9198%252F16449198%252Finterior_rear_seats-1774702996639.jpg') HTTP/1.1" 204 0
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9198/16449198/interior_rear_seats-1774702996639.jpg saved to cache
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5a4bb774-fb21-5bbb-9099-5c3a04d7469a
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1049%252F20431049%252Fexterior_rear_passenger-1774722187469.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1049/20431049/exterior_rear_passenger-1774722187469.jpg not downloaded yet
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658536c10>
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:10:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a4bb774-fb21-5bbb-9099-5c3a04d7469a/5a4bb774-fb21-5bbb-9099-5c3a04d7469a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9198%252F16449198%252Finterior_dashboard-1774703010047.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9198/16449198/interior_dashboard-1774703010047.jpg saved to cache
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5a4bb774-fb21-5bbb-9099-5c3a04d7469a
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1049%252F20431049%252Finterior_front_seats-1774722550095.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1049/20431049/interior_front_seats-1774722550095.jpg not downloaded yet
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1049%252F20431049%252Finterior_rear_seats-1774722561302.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1049/20431049/interior_rear_seats-1774722561302.jpg not downloaded yet
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1049%252F20431049%252Finterior_dashboard-1774722614318.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1049/20431049/interior_dashboard-1774722614318.jpg not downloaded yet
2026-03-29 20:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9198/16449198/interior_boot-1774702998228.jpg> (referer: None)
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1049%252F20431049%252Finstrument_cluster-1774722850639.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1049/20431049/instrument_cluster-1774722850639.jpg not downloaded yet
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1049%252F20431049%252Finterior_boot-1774722668729.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1049/20431049/interior_boot-1774722668729.jpg not downloaded yet
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1049%252F20431049%252Fdocs_service_history-1774722813131.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3482b968c0b5b1c166d1947f23c5fb23%27 HTTP/1.1" 200 None
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1049/20431049/docs_service_history-1774722813131.jpg?ixlib=js-3.8.0&auto=format&s=3482b968c0b5b1c166d1947f23c5fb23 not downloaded yet
2026-03-29 20:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=180&page=5&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a82590>
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a4bb774-fb21-5bbb-9099-5c3a04d7469a/5a4bb774-fb21-5bbb-9099-5c3a04d7469a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9198%252F16449198%252Finterior_boot-1774702998228.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9198/16449198/interior_boot-1774702998228.jpg saved to cache
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5a4bb774-fb21-5bbb-9099-5c3a04d7469a
2026-03-29 20:11:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20457330.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 12933192
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 19413644
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 20447824
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 20458673
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720458673%27 HTTP/1.1" 200 None
2026-03-29 20:11:00 [motorway.uk] INFO: Scrape type for 20458673: 1
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 20493712
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720493712%27 HTTP/1.1" 200 None
2026-03-29 20:11:00 [motorway.uk] INFO: Scrape type for 20493712: 1
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 19203575
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719203575%27 HTTP/1.1" 200 None
2026-03-29 20:11:00 [motorway.uk] INFO: Scrape type for 19203575: 2
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 20421091
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 13065298
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 18832352
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 19439933
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719439933%27 HTTP/1.1" 200 None
2026-03-29 20:11:00 [motorway.uk] INFO: Scrape type for 19439933: 1
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 20275909
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 20423182
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 20445222
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720445222%27 HTTP/1.1" 200 None
2026-03-29 20:11:00 [motorway.uk] INFO: Scrape type for 20445222: 1
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 20488693
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 19816072
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 20478238
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 13689897
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 20446195
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720446195%27 HTTP/1.1" 200 None
2026-03-29 20:11:00 [motorway.uk] INFO: Scrape type for 20446195: 1
2026-03-29 20:11:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a8ba427-80c3-5ddf-8db8-2bccde8b1f29 with identifier: 20457330
2026-03-29 20:11:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a8ba427-80c3-5ddf-8db8-2bccde8b1f29 with scrape type 1
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8a8ba427-80c3-5ddf-8db8-2bccde8b1f29
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7330%252F20457330%252Fexterior_front_driver-1774707520891.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7330/20457330/exterior_front_driver-1774707520891.jpg not downloaded yet
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 17461058
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 20421275
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 3909564
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273909564%27 HTTP/1.1" 200 None
2026-03-29 20:11:00 [motorway.uk] INFO: Scrape type for 3909564: 1
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7330%252F20457330%252Fexterior_rear_driver-1774707569145.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7330/20457330/exterior_rear_driver-1774707569145.jpg not downloaded yet
2026-03-29 20:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/6813303.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 19490864
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 18327972
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 20286049
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 4371469
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 20404359
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720404359%27 HTTP/1.1" 200 None
2026-03-29 20:11:00 [motorway.uk] INFO: Scrape type for 20404359: 1
2026-03-29 20:11:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7330%252F20457330%252Fexterior_front_passenger-1774707695743.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7330/20457330/exterior_front_passenger-1774707695743.jpg not downloaded yet
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 9314864
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279314864%27 HTTP/1.1" 200 None
2026-03-29 20:11:00 [motorway.uk] INFO: Scrape type for 9314864: 1
2026-03-29 20:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9198/16449198/exterior_rear_passenger-1774703011296.jpg> (referer: None)
2026-03-29 20:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1049/20431049/docs_service_history-1774722813131.jpg?ixlib=js-3.8.0&auto=format&s=3482b968c0b5b1c166d1947f23c5fb23> (referer: None)
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7330%252F20457330%252Fexterior_rear_passenger-1774707657702.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7330/20457330/exterior_rear_passenger-1774707657702.jpg not downloaded yet
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 20489620
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 18663443
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 18821611
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 5937182
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%275937182%27 HTTP/1.1" 200 None
2026-03-29 20:11:00 [motorway.uk] INFO: Scrape type for 5937182: 1
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7330%252F20457330%252Finterior_front_seats-1774708297176.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7330/20457330/interior_front_seats-1774708297176.jpg not downloaded yet
2026-03-29 20:11:00 [motorway.uk] INFO: Found listing with ID: 19115404
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719115404%27 HTTP/1.1" 200 None
2026-03-29 20:11:00 [motorway.uk] INFO: Scrape type for 19115404: 1
2026-03-29 20:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7330%252F20457330%252Finterior_rear_seats-1774708315015.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7330/20457330/interior_rear_seats-1774708315015.jpg not downloaded yet
2026-03-29 20:11:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8be4dd32-0a36-5821-aac8-df81d38bdcad with identifier: 6813303
2026-03-29 20:11:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8be4dd32-0a36-5821-aac8-df81d38bdcad with scrape type 1
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8be4dd32-0a36-5821-aac8-df81d38bdcad
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3303%252F6813303%252Fexterior_front_driver-1774620129419.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3303/6813303/exterior_front_driver-1774620129419.jpg not downloaded yet
2026-03-29 20:11:01 [motorway.uk] INFO: Found listing with ID: 20341600
2026-03-29 20:11:01 [motorway.uk] INFO: Found listing with ID: 19718816
2026-03-29 20:11:01 [motorway.uk] INFO: Found listing with ID: 19360225
2026-03-29 20:11:01 [motorway.uk] INFO: Found listing with ID: 20098323
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7330%252F20457330%252Finterior_dashboard-1774708405406.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7330/20457330/interior_dashboard-1774708405406.jpg not downloaded yet
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3303%252F6813303%252Fexterior_rear_driver-1774620147264.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3303/6813303/exterior_rear_driver-1774620147264.jpg not downloaded yet
2026-03-29 20:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1049/20431049/interior_dashboard-1774722614318.jpg> (referer: None)
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7330%252F20457330%252Finstrument_cluster-1774708324171.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7330/20457330/instrument_cluster-1774708324171.jpg not downloaded yet
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3303%252F6813303%252Fexterior_front_passenger-1774620174889.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3303/6813303/exterior_front_passenger-1774620174889.jpg not downloaded yet
2026-03-29 20:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a83e90>
2026-03-29 20:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a4bb774-fb21-5bbb-9099-5c3a04d7469a/5a4bb774-fb21-5bbb-9099-5c3a04d7469a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9198%252F16449198%252Fexterior_rear_passenger-1774703011296.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9198/16449198/exterior_rear_passenger-1774703011296.jpg saved to cache
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5a4bb774-fb21-5bbb-9099-5c3a04d7469a
2026-03-29 20:11:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d33510>
2026-03-29 20:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7f7deca-cf33-54fc-8cac-1b599d6a23af/f7f7deca-cf33-54fc-8cac-1b599d6a23af_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1049%252F20431049%252Fdocs_service_history-1774722813131.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3482b968c0b5b1c166d1947f23c5fb23') HTTP/1.1" 204 0
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1049/20431049/docs_service_history-1774722813131.jpg?ixlib=js-3.8.0&auto=format&s=3482b968c0b5b1c166d1947f23c5fb23 saved to cache
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f7f7deca-cf33-54fc-8cac-1b599d6a23af
2026-03-29 20:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9198/16449198/interior_front_seats-1774702993367.jpg> (referer: None)
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7330%252F20457330%252Finterior_boot-1774708518283.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7330/20457330/interior_boot-1774708518283.jpg not downloaded yet
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3303%252F6813303%252Fexterior_rear_passenger-1774620163293.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3303/6813303/exterior_rear_passenger-1774620163293.jpg not downloaded yet
2026-03-29 20:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1049/20431049/exterior_rear_passenger-1774722187469.jpg> (referer: None)
2026-03-29 20:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20488894.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7330%252F20457330%252Fdocs_service_history-1774771173186-1.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df6b674a368bd428ba352e040958734b8%27 HTTP/1.1" 200 None
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7330/20457330/docs_service_history-1774771173186-1.jpeg?ixlib=js-3.8.0&auto=format&s=f6b674a368bd428ba352e040958734b8 not downloaded yet
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3303%252F6813303%252Finterior_front_seats-1774622916907.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3303/6813303/interior_front_seats-1774622916907.jpg not downloaded yet
2026-03-29 20:11:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d42050>
2026-03-29 20:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7f7deca-cf33-54fc-8cac-1b599d6a23af/f7f7deca-cf33-54fc-8cac-1b599d6a23af_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1049%252F20431049%252Finterior_dashboard-1774722614318.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1049/20431049/interior_dashboard-1774722614318.jpg saved to cache
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f7f7deca-cf33-54fc-8cac-1b599d6a23af
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3303%252F6813303%252Finterior_rear_seats-1774620686398.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3303/6813303/interior_rear_seats-1774620686398.jpg not downloaded yet
2026-03-29 20:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586d8f50>
2026-03-29 20:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a4bb774-fb21-5bbb-9099-5c3a04d7469a/5a4bb774-fb21-5bbb-9099-5c3a04d7469a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9198%252F16449198%252Finterior_front_seats-1774702993367.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9198/16449198/interior_front_seats-1774702993367.jpg saved to cache
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5a4bb774-fb21-5bbb-9099-5c3a04d7469a
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3303%252F6813303%252Finterior_dashboard-1774620625076.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3303/6813303/interior_dashboard-1774620625076.jpg not downloaded yet
2026-03-29 20:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582d7c10>
2026-03-29 20:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7f7deca-cf33-54fc-8cac-1b599d6a23af/f7f7deca-cf33-54fc-8cac-1b599d6a23af_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1049%252F20431049%252Fexterior_rear_passenger-1774722187469.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1049/20431049/exterior_rear_passenger-1774722187469.jpg saved to cache
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f7f7deca-cf33-54fc-8cac-1b599d6a23af
2026-03-29 20:11:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dda7e48d-2e8f-5866-b5cf-3bf16a011ee5 with identifier: 20488894
2026-03-29 20:11:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dda7e48d-2e8f-5866-b5cf-3bf16a011ee5 with scrape type 1
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dda7e48d-2e8f-5866-b5cf-3bf16a011ee5
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8894%252F20488894%252Fexterior_front_driver-1774705909937.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8894/20488894/exterior_front_driver-1774705909937.jpg not downloaded yet
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3303%252F6813303%252Finstrument_cluster-1774620608845.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3303/6813303/instrument_cluster-1774620608845.jpg not downloaded yet
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8894%252F20488894%252Fexterior_rear_driver-1774705925895.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8894/20488894/exterior_rear_driver-1774705925895.jpg not downloaded yet
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3303%252F6813303%252Finterior_boot-1774620604389.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3303/6813303/interior_boot-1774620604389.jpg not downloaded yet
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8894%252F20488894%252Fexterior_front_passenger-1774705947707.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8894/20488894/exterior_front_passenger-1774705947707.jpg not downloaded yet
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3303%252F6813303%252Fdocs_service_history-1774621469636.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D09034fee2969aed76e48ec70f3218139%27 HTTP/1.1" 200 None
2026-03-29 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3303/6813303/docs_service_history-1774621469636.jpg?ixlib=js-3.8.0&auto=format&s=09034fee2969aed76e48ec70f3218139 not downloaded yet
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8894%252F20488894%252Fexterior_rear_passenger-1774705938682.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8894/20488894/exterior_rear_passenger-1774705938682.jpg not downloaded yet
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8894%252F20488894%252Finterior_front_seats-1774716727885.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8894/20488894/interior_front_seats-1774716727885.jpg not downloaded yet
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8894%252F20488894%252Finterior_dashboard-1774716875503.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8894/20488894/interior_dashboard-1774716875503.jpg not downloaded yet
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8894%252F20488894%252Finstrument_cluster-1774716797807.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8894/20488894/instrument_cluster-1774716797807.jpg not downloaded yet
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8894%252F20488894%252Finterior_boot-1774716838716.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8894/20488894/interior_boot-1774716838716.jpg not downloaded yet
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8894%252F20488894%252Fdocs_service_history-1774717076326.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dba0b75f1bb02ae2e7a94f034276d2211%27 HTTP/1.1" 200 None
2026-03-29 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8894/20488894/docs_service_history-1774717076326.jpg?ixlib=js-3.8.0&auto=format&s=ba0b75f1bb02ae2e7a94f034276d2211 not downloaded yet
2026-03-29 20:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7330/20457330/exterior_rear_driver-1774707569145.jpg> (referer: None)
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8894%252F20488894%252Fdocs_service_history-1774790270054.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc6cefd9da3333ab5945f47ce323f84bc%27 HTTP/1.1" 200 None
2026-03-29 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8894/20488894/docs_service_history-1774790270054.jpg?ixlib=js-3.8.0&auto=format&s=c6cefd9da3333ab5945f47ce323f84bc not downloaded yet
2026-03-29 20:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7330/20457330/exterior_front_passenger-1774707695743.jpg> (referer: None)
2026-03-29 20:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1049/20431049/interior_boot-1774722668729.jpg> (referer: None)
2026-03-29 20:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3303/6813303/interior_front_seats-1774622916907.jpg> (referer: None)
2026-03-29 20:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7330/20457330/docs_service_history-1774771173186-1.jpeg?ixlib=js-3.8.0&auto=format&s=f6b674a368bd428ba352e040958734b8> (referer: None)
2026-03-29 20:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e5c8d0>
2026-03-29 20:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a8ba427-80c3-5ddf-8db8-2bccde8b1f29/8a8ba427-80c3-5ddf-8db8-2bccde8b1f29_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7330%252F20457330%252Fexterior_rear_driver-1774707569145.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7330/20457330/exterior_rear_driver-1774707569145.jpg saved to cache
2026-03-29 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8a8ba427-80c3-5ddf-8db8-2bccde8b1f29
2026-03-29 20:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586e1c90>
2026-03-29 20:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a8ba427-80c3-5ddf-8db8-2bccde8b1f29/8a8ba427-80c3-5ddf-8db8-2bccde8b1f29_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7330%252F20457330%252Fexterior_front_passenger-1774707695743.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7330/20457330/exterior_front_passenger-1774707695743.jpg saved to cache
2026-03-29 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8a8ba427-80c3-5ddf-8db8-2bccde8b1f29
2026-03-29 20:11:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c27010>
2026-03-29 20:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7f7deca-cf33-54fc-8cac-1b599d6a23af/f7f7deca-cf33-54fc-8cac-1b599d6a23af_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1049%252F20431049%252Finterior_boot-1774722668729.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1049/20431049/interior_boot-1774722668729.jpg saved to cache
2026-03-29 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f7f7deca-cf33-54fc-8cac-1b599d6a23af
2026-03-29 20:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bc9dd0>
2026-03-29 20:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8be4dd32-0a36-5821-aac8-df81d38bdcad/8be4dd32-0a36-5821-aac8-df81d38bdcad_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3303%252F6813303%252Finterior_front_seats-1774622916907.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3303/6813303/interior_front_seats-1774622916907.jpg saved to cache
2026-03-29 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8be4dd32-0a36-5821-aac8-df81d38bdcad
2026-03-29 20:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659bf7110>
2026-03-29 20:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a8ba427-80c3-5ddf-8db8-2bccde8b1f29/8a8ba427-80c3-5ddf-8db8-2bccde8b1f29_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7330%252F20457330%252Fdocs_service_history-1774771173186-1.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df6b674a368bd428ba352e040958734b8') HTTP/1.1" 204 0
2026-03-29 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7330/20457330/docs_service_history-1774771173186-1.jpeg?ixlib=js-3.8.0&auto=format&s=f6b674a368bd428ba352e040958734b8 saved to cache
2026-03-29 20:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8a8ba427-80c3-5ddf-8db8-2bccde8b1f29
2026-03-29 20:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20448956.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8894/20488894/docs_service_history-1774717076326.jpg?ixlib=js-3.8.0&auto=format&s=ba0b75f1bb02ae2e7a94f034276d2211> (referer: None)
2026-03-29 20:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3303/6813303/interior_rear_seats-1774620686398.jpg> (referer: None)
2026-03-29 20:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8894/20488894/interior_boot-1774716838716.jpg> (referer: None)
2026-03-29 20:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3303/6813303/interior_dashboard-1774620625076.jpg> (referer: None)
2026-03-29 20:11:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9252b9bb-3600-5be5-8f24-5d9eb2fadf88 with identifier: 20448956
2026-03-29 20:11:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9252b9bb-3600-5be5-8f24-5d9eb2fadf88 with scrape type 1
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9252b9bb-3600-5be5-8f24-5d9eb2fadf88
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8956%252F20448956%252Fexterior_front_driver-1774690403536.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8956/20448956/exterior_front_driver-1774690403536.jpg not downloaded yet
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8956%252F20448956%252Fexterior_rear_driver-1774690420016.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8956/20448956/exterior_rear_driver-1774690420016.jpg not downloaded yet
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8956%252F20448956%252Fexterior_front_passenger-1774690443101.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8956/20448956/exterior_front_passenger-1774690443101.jpg not downloaded yet
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bc8310>
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dda7e48d-2e8f-5866-b5cf-3bf16a011ee5/dda7e48d-2e8f-5866-b5cf-3bf16a011ee5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8894%252F20488894%252Fdocs_service_history-1774717076326.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dba0b75f1bb02ae2e7a94f034276d2211') HTTP/1.1" 204 0
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8894/20488894/docs_service_history-1774717076326.jpg?ixlib=js-3.8.0&auto=format&s=ba0b75f1bb02ae2e7a94f034276d2211 saved to cache
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dda7e48d-2e8f-5866-b5cf-3bf16a011ee5
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8956%252F20448956%252Fexterior_rear_passenger-1774690431831.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8956/20448956/exterior_rear_passenger-1774690431831.jpg not downloaded yet
2026-03-29 20:11:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65853f090>
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8be4dd32-0a36-5821-aac8-df81d38bdcad/8be4dd32-0a36-5821-aac8-df81d38bdcad_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3303%252F6813303%252Finterior_rear_seats-1774620686398.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3303/6813303/interior_rear_seats-1774620686398.jpg saved to cache
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8be4dd32-0a36-5821-aac8-df81d38bdcad
2026-03-29 20:11:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c122d0>
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dda7e48d-2e8f-5866-b5cf-3bf16a011ee5/dda7e48d-2e8f-5866-b5cf-3bf16a011ee5_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8894%252F20488894%252Finterior_boot-1774716838716.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8894/20488894/interior_boot-1774716838716.jpg saved to cache
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dda7e48d-2e8f-5866-b5cf-3bf16a011ee5
2026-03-29 20:11:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658aa1dd0>
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8be4dd32-0a36-5821-aac8-df81d38bdcad/8be4dd32-0a36-5821-aac8-df81d38bdcad_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3303%252F6813303%252Finterior_dashboard-1774620625076.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3303/6813303/interior_dashboard-1774620625076.jpg saved to cache
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8be4dd32-0a36-5821-aac8-df81d38bdcad
2026-03-29 20:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/8894/20488894/docs_service_history-1774790270054.jpg?ixlib=js-3.8.0&auto=format&s=c6cefd9da3333ab5945f47ce323f84bc> (referer: None)
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8956%252F20448956%252Finterior_front_seats-1774690778106.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8956/20448956/interior_front_seats-1774690778106.jpg not downloaded yet
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8956%252F20448956%252Finterior_rear_seats-1774692799637.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8956/20448956/interior_rear_seats-1774692799637.jpg not downloaded yet
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8956%252F20448956%252Finterior_dashboard-1774690825512.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8956/20448956/interior_dashboard-1774690825512.jpg not downloaded yet
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8956%252F20448956%252Finterior_boot-1774690843769.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8956/20448956/interior_boot-1774690843769.jpg not downloaded yet
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8956%252F20448956%252Fdocs_service_history-1774691167835.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db66ef138ad7672f4da7261999fb42d98%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8956/20448956/docs_service_history-1774691167835.jpg?ixlib=js-3.8.0&auto=format&s=b66ef138ad7672f4da7261999fb42d98 not downloaded yet
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582e5d90>
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dda7e48d-2e8f-5866-b5cf-3bf16a011ee5/dda7e48d-2e8f-5866-b5cf-3bf16a011ee5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8894%252F20488894%252Fdocs_service_history-1774790270054.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc6cefd9da3333ab5945f47ce323f84bc') HTTP/1.1" 204 0
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8894/20488894/docs_service_history-1774790270054.jpg?ixlib=js-3.8.0&auto=format&s=c6cefd9da3333ab5945f47ce323f84bc saved to cache
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dda7e48d-2e8f-5866-b5cf-3bf16a011ee5
2026-03-29 20:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8894/20488894/instrument_cluster-1774716797807.jpg> (referer: None)
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8956%252F20448956%252Fdocs_service_history-1774691188451.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3efd23e4b5d81452bbf895b399d96c48%27 HTTP/1.1" 200 None
2026-03-29 20:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8956/20448956/docs_service_history-1774691188451.jpg?ixlib=js-3.8.0&auto=format&s=3efd23e4b5d81452bbf895b399d96c48 not downloaded yet
2026-03-29 20:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19289424.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/9335437.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8894/20488894/exterior_rear_passenger-1774705938682.jpg> (referer: None)
2026-03-29 20:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8894/20488894/interior_dashboard-1774716875503.jpg> (referer: None)
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a123d0>
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dda7e48d-2e8f-5866-b5cf-3bf16a011ee5/dda7e48d-2e8f-5866-b5cf-3bf16a011ee5_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8894%252F20488894%252Finstrument_cluster-1774716797807.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8894/20488894/instrument_cluster-1774716797807.jpg saved to cache
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dda7e48d-2e8f-5866-b5cf-3bf16a011ee5
2026-03-29 20:11:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 358863f8-df6e-5358-b55f-de470ad6d423 with identifier: 19289424
2026-03-29 20:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 358863f8-df6e-5358-b55f-de470ad6d423 with scrape type 1
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 358863f8-df6e-5358-b55f-de470ad6d423
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9424%252F19289424%252Fexterior_front_driver-1770221759380.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9424/19289424/exterior_front_driver-1770221759380.jpg not downloaded yet
2026-03-29 20:11:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 001b9a53-6b15-56a3-9f2d-2d3f40807698 with identifier: 9335437
2026-03-29 20:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 001b9a53-6b15-56a3-9f2d-2d3f40807698 with scrape type 1
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 001b9a53-6b15-56a3-9f2d-2d3f40807698
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5437%252F9335437%252Fexterior_front_driver-1774771546403.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5437/9335437/exterior_front_driver-1774771546403.jpg not downloaded yet
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d14ad0>
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dda7e48d-2e8f-5866-b5cf-3bf16a011ee5/dda7e48d-2e8f-5866-b5cf-3bf16a011ee5_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8894%252F20488894%252Fexterior_rear_passenger-1774705938682.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8894/20488894/exterior_rear_passenger-1774705938682.jpg saved to cache
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dda7e48d-2e8f-5866-b5cf-3bf16a011ee5
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65836c390>
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dda7e48d-2e8f-5866-b5cf-3bf16a011ee5/dda7e48d-2e8f-5866-b5cf-3bf16a011ee5_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8894%252F20488894%252Finterior_dashboard-1774716875503.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8894/20488894/interior_dashboard-1774716875503.jpg saved to cache
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dda7e48d-2e8f-5866-b5cf-3bf16a011ee5
2026-03-29 20:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20363550.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9424%252F19289424%252Fexterior_rear_driver-1770134430884.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9424/19289424/exterior_rear_driver-1770134430884.jpg not downloaded yet
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5437%252F9335437%252Fexterior_rear_driver-1774771575009.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5437/9335437/exterior_rear_driver-1774771575009.jpg not downloaded yet
2026-03-29 20:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/3925743.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9424%252F19289424%252Fexterior_front_passenger-1770134461518.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9424/19289424/exterior_front_passenger-1770134461518.jpg not downloaded yet
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5437%252F9335437%252Fexterior_front_passenger-1774771607107.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5437/9335437/exterior_front_passenger-1774771607107.jpg not downloaded yet
2026-03-29 20:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8956/20448956/exterior_rear_driver-1774690420016.jpg> (referer: None)
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9424%252F19289424%252Fexterior_rear_passenger-1770134412062.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9424/19289424/exterior_rear_passenger-1770134412062.jpg not downloaded yet
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5437%252F9335437%252Fexterior_rear_passenger-1774771591797.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5437/9335437/exterior_rear_passenger-1774771591797.jpg not downloaded yet
2026-03-29 20:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8956/20448956/exterior_front_passenger-1774690443101.jpg> (referer: None)
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9424%252F19289424%252Finterior_front_seats-1770221746299.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9424/19289424/interior_front_seats-1770221746299.jpg not downloaded yet
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5437%252F9335437%252Finterior_front_seats-1774772187741.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5437/9335437/interior_front_seats-1774772187741.jpg not downloaded yet
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9424%252F19289424%252Finterior_rear_seats-1770134898303.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9424/19289424/interior_rear_seats-1770134898303.jpg not downloaded yet
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5437%252F9335437%252Finterior_rear_seats-1774772269603.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5437/9335437/interior_rear_seats-1774772269603.jpg not downloaded yet
2026-03-29 20:11:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 790385b3-332b-5ebf-a4bf-0a9cfc71309b with identifier: 20363550
2026-03-29 20:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 790385b3-332b-5ebf-a4bf-0a9cfc71309b with scrape type 1
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 790385b3-332b-5ebf-a4bf-0a9cfc71309b
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3550%252F20363550%252Fexterior_front_driver-1774714179474.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3550/20363550/exterior_front_driver-1774714179474.jpg not downloaded yet
2026-03-29 20:11:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67bb108f-10c6-5b79-8498-45e25103b0e9 with identifier: 3925743
2026-03-29 20:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67bb108f-10c6-5b79-8498-45e25103b0e9 with scrape type 1
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 67bb108f-10c6-5b79-8498-45e25103b0e9
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5743%252F3925743%252Fexterior_front_driver-1769699844739.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5743/3925743/exterior_front_driver-1769699844739.jpeg not downloaded yet
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9424%252F19289424%252Finterior_dashboard-1770134834036.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9424/19289424/interior_dashboard-1770134834036.jpg not downloaded yet
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5437%252F9335437%252Finterior_dashboard-1774774859394.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5437/9335437/interior_dashboard-1774774859394.jpg not downloaded yet
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3550%252F20363550%252Fexterior_rear_driver-1774714177403.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3550/20363550/exterior_rear_driver-1774714177403.jpg not downloaded yet
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5743%252F3925743%252Fexterior_rear_driver-1774537796394.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5743/3925743/exterior_rear_driver-1774537796394.jpeg not downloaded yet
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65837bb90>
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9252b9bb-3600-5be5-8f24-5d9eb2fadf88/9252b9bb-3600-5be5-8f24-5d9eb2fadf88_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8956%252F20448956%252Fexterior_rear_driver-1774690420016.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8956/20448956/exterior_rear_driver-1774690420016.jpg saved to cache
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9252b9bb-3600-5be5-8f24-5d9eb2fadf88
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9424%252F19289424%252Finterior_boot-1770134876937.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9424/19289424/interior_boot-1770134876937.jpg not downloaded yet
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5437%252F9335437%252Finstrument_cluster-1774772326015.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5437/9335437/instrument_cluster-1774772326015.jpg not downloaded yet
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3550%252F20363550%252Fexterior_front_passenger-1774714177103.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3550/20363550/exterior_front_passenger-1774714177103.jpg not downloaded yet
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5743%252F3925743%252Fexterior_front_passenger-1769699860328.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5743/3925743/exterior_front_passenger-1769699860328.jpeg not downloaded yet
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf613d0>
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9252b9bb-3600-5be5-8f24-5d9eb2fadf88/9252b9bb-3600-5be5-8f24-5d9eb2fadf88_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8956%252F20448956%252Fexterior_front_passenger-1774690443101.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8956/20448956/exterior_front_passenger-1774690443101.jpg saved to cache
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9252b9bb-3600-5be5-8f24-5d9eb2fadf88
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F9424%252F19289424%252Fdocs_service_history-1770134949519.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D143b7f23f5ddad80803805857d7c823e%27 HTTP/1.1" 200 None
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/9424/19289424/docs_service_history-1770134949519.jpg?ixlib=js-3.8.0&auto=format&s=143b7f23f5ddad80803805857d7c823e not downloaded yet
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5437%252F9335437%252Finterior_boot-1774772251671.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5437/9335437/interior_boot-1774772251671.jpg not downloaded yet
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3550%252F20363550%252Fexterior_rear_passenger-1774714181972.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3550/20363550/exterior_rear_passenger-1774714181972.jpg not downloaded yet
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5743%252F3925743%252Fexterior_rear_passenger-1774537842725.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5743/3925743/exterior_rear_passenger-1774537842725.jpeg not downloaded yet
2026-03-29 20:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8956/20448956/exterior_rear_passenger-1774690431831.jpg> (referer: None)
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F9424%252F19289424%252Fdocs_service_history-1770134968477.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfaa377dbc32c79561826f88c8e05a72c%27 HTTP/1.1" 200 None
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/9424/19289424/docs_service_history-1770134968477.jpg?ixlib=js-3.8.0&auto=format&s=faa377dbc32c79561826f88c8e05a72c not downloaded yet
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5437%252F9335437%252Fdocs_service_history-1774772447627.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcf6804c4935b86cf6a9f2af332a49fc3%27 HTTP/1.1" 200 None
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5437/9335437/docs_service_history-1774772447627.jpg?ixlib=js-3.8.0&auto=format&s=cf6804c4935b86cf6a9f2af332a49fc3 not downloaded yet
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3550%252F20363550%252Finterior_front_seats-1774714915526.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3550/20363550/interior_front_seats-1774714915526.jpg not downloaded yet
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5743%252F3925743%252Finterior_front_seats-1774537225614.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5743/3925743/interior_front_seats-1774537225614.jpeg not downloaded yet
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3550%252F20363550%252Finterior_rear_seats-1774714788997.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3550/20363550/interior_rear_seats-1774714788997.jpg not downloaded yet
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5743%252F3925743%252Finterior_rear_seats-1774537263611.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5743/3925743/interior_rear_seats-1774537263611.jpeg not downloaded yet
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3550%252F20363550%252Finterior_dashboard-1774714795939.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3550/20363550/interior_dashboard-1774714795939.jpg not downloaded yet
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5743%252F3925743%252Finterior_dashboard-1774537099373.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5743/3925743/interior_dashboard-1774537099373.jpeg not downloaded yet
2026-03-29 20:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8956/20448956/interior_front_seats-1774690778106.jpg> (referer: None)
2026-03-29 20:11:05 [scrapy.extensions.logstats] INFO: Crawled 49 pages (at 49 pages/min), scraped 7 items (at 7 items/min)
2026-03-29 20:11:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 224MiB
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d8e5d0>
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9252b9bb-3600-5be5-8f24-5d9eb2fadf88/9252b9bb-3600-5be5-8f24-5d9eb2fadf88_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8956%252F20448956%252Fexterior_rear_passenger-1774690431831.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8956/20448956/exterior_rear_passenger-1774690431831.jpg saved to cache
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9252b9bb-3600-5be5-8f24-5d9eb2fadf88
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3550%252F20363550%252Finterior_boot-1774714790809.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3550/20363550/interior_boot-1774714790809.jpg not downloaded yet
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5743%252F3925743%252Finstrument_cluster-1774537261673.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5743/3925743/instrument_cluster-1774537261673.jpeg not downloaded yet
2026-03-29 20:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8956/20448956/interior_dashboard-1774690825512.jpg> (referer: None)
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3550%252F20363550%252Fdocs_service_history-1774715018441.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D18ac8053025b25d06dae6bffd8d0c03c%27 HTTP/1.1" 200 None
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3550/20363550/docs_service_history-1774715018441.jpg?ixlib=js-3.8.0&auto=format&s=18ac8053025b25d06dae6bffd8d0c03c not downloaded yet
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5743%252F3925743%252Finterior_boot-1774538030283.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5743/3925743/interior_boot-1774538030283.jpeg not downloaded yet
2026-03-29 20:11:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583641d0>
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9252b9bb-3600-5be5-8f24-5d9eb2fadf88/9252b9bb-3600-5be5-8f24-5d9eb2fadf88_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8956%252F20448956%252Finterior_front_seats-1774690778106.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8956/20448956/interior_front_seats-1774690778106.jpg saved to cache
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9252b9bb-3600-5be5-8f24-5d9eb2fadf88
2026-03-29 20:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8894/20488894/interior_front_seats-1774716727885.jpg> (referer: None)
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3550%252F20363550%252Fdamage_scratches-1774714331377.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3550/20363550/damage_scratches-1774714331377.jpg not downloaded yet
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F5743%252F3925743%252F3925743-docs_service_history-modified-1769775542743.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da73350cb5c8ce52e765901efcbb137e6%27 HTTP/1.1" 200 None
2026-03-29 20:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/5743/3925743/3925743-docs_service_history-modified-1769775542743.jpeg?ixlib=js-3.8.0&auto=format&s=a73350cb5c8ce52e765901efcbb137e6 not downloaded yet
2026-03-29 20:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5437/9335437/exterior_front_passenger-1774771607107.jpg> (referer: None)
2026-03-29 20:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9424/19289424/exterior_front_driver-1770221759380.jpg> (referer: None)
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfaab90>
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9252b9bb-3600-5be5-8f24-5d9eb2fadf88/9252b9bb-3600-5be5-8f24-5d9eb2fadf88_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8956%252F20448956%252Finterior_dashboard-1774690825512.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8956/20448956/interior_dashboard-1774690825512.jpg saved to cache
2026-03-29 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9252b9bb-3600-5be5-8f24-5d9eb2fadf88
2026-03-29 20:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5437/9335437/exterior_front_driver-1774771546403.jpg> (referer: None)
2026-03-29 20:11:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f1e710>
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dda7e48d-2e8f-5866-b5cf-3bf16a011ee5/dda7e48d-2e8f-5866-b5cf-3bf16a011ee5_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8894%252F20488894%252Finterior_front_seats-1774716727885.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8894/20488894/interior_front_seats-1774716727885.jpg saved to cache
2026-03-29 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dda7e48d-2e8f-5866-b5cf-3bf16a011ee5
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599a6a50>
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_001b9a53-6b15-56a3-9f2d-2d3f40807698/001b9a53-6b15-56a3-9f2d-2d3f40807698_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5437%252F9335437%252Fexterior_front_passenger-1774771607107.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5437/9335437/exterior_front_passenger-1774771607107.jpg saved to cache
2026-03-29 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 001b9a53-6b15-56a3-9f2d-2d3f40807698
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658327510>
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_358863f8-df6e-5358-b55f-de470ad6d423/358863f8-df6e-5358-b55f-de470ad6d423_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9424%252F19289424%252Fexterior_front_driver-1770221759380.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9424/19289424/exterior_front_driver-1770221759380.jpg saved to cache
2026-03-29 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 358863f8-df6e-5358-b55f-de470ad6d423
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d5fcd0>
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_001b9a53-6b15-56a3-9f2d-2d3f40807698/001b9a53-6b15-56a3-9f2d-2d3f40807698_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5437%252F9335437%252Fexterior_front_driver-1774771546403.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5437/9335437/exterior_front_driver-1774771546403.jpg saved to cache
2026-03-29 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 001b9a53-6b15-56a3-9f2d-2d3f40807698
2026-03-29 20:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8956/20448956/docs_service_history-1774691167835.jpg?ixlib=js-3.8.0&auto=format&s=b66ef138ad7672f4da7261999fb42d98> (referer: None)
2026-03-29 20:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8956/20448956/interior_rear_seats-1774692799637.jpg> (referer: None)
2026-03-29 20:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8956/20448956/docs_service_history-1774691188451.jpg?ixlib=js-3.8.0&auto=format&s=3efd23e4b5d81452bbf895b399d96c48> (referer: None)
2026-03-29 20:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8956/20448956/interior_boot-1774690843769.jpg> (referer: None)
2026-03-29 20:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5743/3925743/exterior_front_passenger-1769699860328.jpeg> (referer: None)
2026-03-29 20:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5743/3925743/exterior_rear_passenger-1774537842725.jpeg> (referer: None)
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658da0e10>
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9252b9bb-3600-5be5-8f24-5d9eb2fadf88/9252b9bb-3600-5be5-8f24-5d9eb2fadf88_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8956%252F20448956%252Fdocs_service_history-1774691167835.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db66ef138ad7672f4da7261999fb42d98') HTTP/1.1" 204 0
2026-03-29 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8956/20448956/docs_service_history-1774691167835.jpg?ixlib=js-3.8.0&auto=format&s=b66ef138ad7672f4da7261999fb42d98 saved to cache
2026-03-29 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9252b9bb-3600-5be5-8f24-5d9eb2fadf88
2026-03-29 20:11:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf38a50>
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9252b9bb-3600-5be5-8f24-5d9eb2fadf88/9252b9bb-3600-5be5-8f24-5d9eb2fadf88_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8956%252F20448956%252Finterior_rear_seats-1774692799637.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8956/20448956/interior_rear_seats-1774692799637.jpg saved to cache
2026-03-29 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9252b9bb-3600-5be5-8f24-5d9eb2fadf88
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b21710>
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9252b9bb-3600-5be5-8f24-5d9eb2fadf88/9252b9bb-3600-5be5-8f24-5d9eb2fadf88_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8956%252F20448956%252Fdocs_service_history-1774691188451.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3efd23e4b5d81452bbf895b399d96c48') HTTP/1.1" 204 0
2026-03-29 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8956/20448956/docs_service_history-1774691188451.jpg?ixlib=js-3.8.0&auto=format&s=3efd23e4b5d81452bbf895b399d96c48 saved to cache
2026-03-29 20:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9252b9bb-3600-5be5-8f24-5d9eb2fadf88
2026-03-29 20:11:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ccfdd0>
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9252b9bb-3600-5be5-8f24-5d9eb2fadf88/9252b9bb-3600-5be5-8f24-5d9eb2fadf88_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8956%252F20448956%252Finterior_boot-1774690843769.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8956/20448956/interior_boot-1774690843769.jpg saved to cache
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9252b9bb-3600-5be5-8f24-5d9eb2fadf88
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b64910>
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67bb108f-10c6-5b79-8498-45e25103b0e9/67bb108f-10c6-5b79-8498-45e25103b0e9_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5743%252F3925743%252Fexterior_front_passenger-1769699860328.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5743/3925743/exterior_front_passenger-1769699860328.jpeg saved to cache
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 67bb108f-10c6-5b79-8498-45e25103b0e9
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d64250>
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67bb108f-10c6-5b79-8498-45e25103b0e9/67bb108f-10c6-5b79-8498-45e25103b0e9_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5743%252F3925743%252Fexterior_rear_passenger-1774537842725.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5743/3925743/exterior_rear_passenger-1774537842725.jpeg saved to cache
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 67bb108f-10c6-5b79-8498-45e25103b0e9
2026-03-29 20:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/5743/3925743/3925743-docs_service_history-modified-1769775542743.jpeg?ixlib=js-3.8.0&auto=format&s=a73350cb5c8ce52e765901efcbb137e6> (referer: None)
2026-03-29 20:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3550/20363550/damage_scratches-1774714331377.jpg> (referer: None)
2026-03-29 20:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3550/20363550/docs_service_history-1774715018441.jpg?ixlib=js-3.8.0&auto=format&s=18ac8053025b25d06dae6bffd8d0c03c> (referer: None)
2026-03-29 20:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3550/20363550/interior_boot-1774714790809.jpg> (referer: None)
2026-03-29 20:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5743/3925743/instrument_cluster-1774537261673.jpeg> (referer: None)
2026-03-29 20:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5743/3925743/interior_boot-1774538030283.jpeg> (referer: None)
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a80210>
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67bb108f-10c6-5b79-8498-45e25103b0e9/67bb108f-10c6-5b79-8498-45e25103b0e9_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F5743%252F3925743%252F3925743-docs_service_history-modified-1769775542743.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da73350cb5c8ce52e765901efcbb137e6') HTTP/1.1" 204 0
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/5743/3925743/3925743-docs_service_history-modified-1769775542743.jpeg?ixlib=js-3.8.0&auto=format&s=a73350cb5c8ce52e765901efcbb137e6 saved to cache
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 67bb108f-10c6-5b79-8498-45e25103b0e9
2026-03-29 20:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/9314864.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20477418.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599a4810>
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_790385b3-332b-5ebf-a4bf-0a9cfc71309b/790385b3-332b-5ebf-a4bf-0a9cfc71309b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3550%252F20363550%252Fdamage_scratches-1774714331377.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3550/20363550/damage_scratches-1774714331377.jpg saved to cache
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 790385b3-332b-5ebf-a4bf-0a9cfc71309b
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d93390>
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_790385b3-332b-5ebf-a4bf-0a9cfc71309b/790385b3-332b-5ebf-a4bf-0a9cfc71309b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3550%252F20363550%252Fdocs_service_history-1774715018441.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D18ac8053025b25d06dae6bffd8d0c03c') HTTP/1.1" 204 0
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3550/20363550/docs_service_history-1774715018441.jpg?ixlib=js-3.8.0&auto=format&s=18ac8053025b25d06dae6bffd8d0c03c saved to cache
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 790385b3-332b-5ebf-a4bf-0a9cfc71309b
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cca210>
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_790385b3-332b-5ebf-a4bf-0a9cfc71309b/790385b3-332b-5ebf-a4bf-0a9cfc71309b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3550%252F20363550%252Finterior_boot-1774714790809.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3550/20363550/interior_boot-1774714790809.jpg saved to cache
2026-03-29 20:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 790385b3-332b-5ebf-a4bf-0a9cfc71309b
2026-03-29 20:11:07 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:07 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:07 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x003@\xf8\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03\x12\x1d\x0036Z\x00\x00\x00\x00'
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d916d0>
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67bb108f-10c6-5b79-8498-45e25103b0e9/67bb108f-10c6-5b79-8498-45e25103b0e9_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5743%252F3925743%252Finstrument_cluster-1774537261673.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5743/3925743/instrument_cluster-1774537261673.jpeg saved to cache
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 67bb108f-10c6-5b79-8498-45e25103b0e9
2026-03-29 20:11:08 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:08 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:08 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00<\xa4\x03\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03\x07b\x00<\x99e\x00\x00\x00\x00'
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599a4810>
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67bb108f-10c6-5b79-8498-45e25103b0e9/67bb108f-10c6-5b79-8498-45e25103b0e9_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5743%252F3925743%252Finterior_boot-1774538030283.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5743/3925743/interior_boot-1774538030283.jpeg saved to cache
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 67bb108f-10c6-5b79-8498-45e25103b0e9
2026-03-29 20:11:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8 with identifier: 9314864
2026-03-29 20:11:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8 with scrape type 1
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4864%252F9314864%252Fexterior_front_driver-1774634086913.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4864/9314864/exterior_front_driver-1774634086913.jpg not downloaded yet
2026-03-29 20:11:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 024c4238-8fc6-523a-a72a-b9b816584a50 with identifier: 20477418
2026-03-29 20:11:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 024c4238-8fc6-523a-a72a-b9b816584a50 with scrape type 1
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 024c4238-8fc6-523a-a72a-b9b816584a50
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7418%252F20477418%252Fexterior_front_driver-1774634222517.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7418/20477418/exterior_front_driver-1774634222517.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4864%252F9314864%252Fexterior_rear_driver-1774645184956.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4864/9314864/exterior_rear_driver-1774645184956.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7418%252F20477418%252Fexterior_rear_driver-1774634227086.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7418/20477418/exterior_rear_driver-1774634227086.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4864%252F9314864%252Fexterior_front_passenger-1774634123785.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4864/9314864/exterior_front_passenger-1774634123785.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7418%252F20477418%252Fexterior_front_passenger-1774634217492.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7418/20477418/exterior_front_passenger-1774634217492.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4864%252F9314864%252Fexterior_rear_passenger-1774634102741.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4864/9314864/exterior_rear_passenger-1774634102741.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7418%252F20477418%252Fexterior_rear_passenger-1774634222081.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7418/20477418/exterior_rear_passenger-1774634222081.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4864%252F9314864%252Finterior_front_seats-1774629216184.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4864/9314864/interior_front_seats-1774629216184.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7418%252F20477418%252Finterior_front_seats-1774635520988.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7418/20477418/interior_front_seats-1774635520988.jpg not downloaded yet
2026-03-29 20:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/9424/19289424/docs_service_history-1770134968477.jpg?ixlib=js-3.8.0&auto=format&s=faa377dbc32c79561826f88c8e05a72c> (referer: None)
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4864%252F9314864%252Finterior_rear_seats-1774711476550.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4864/9314864/interior_rear_seats-1774711476550.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7418%252F20477418%252Finterior_rear_seats-1774635545031.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7418/20477418/interior_rear_seats-1774635545031.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4864%252F9314864%252Finterior_dashboard-1774774164351.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4864/9314864/interior_dashboard-1774774164351.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7418%252F20477418%252Finterior_dashboard-1774635426666.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7418/20477418/interior_dashboard-1774635426666.jpg not downloaded yet
2026-03-29 20:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3550/20363550/exterior_rear_passenger-1774714181972.jpg> (referer: None)
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4864%252F9314864%252Finstrument_cluster-1774629262192.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4864/9314864/instrument_cluster-1774629262192.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7418%252F20477418%252Finterior_boot-1774635383891.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7418/20477418/interior_boot-1774635383891.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4864%252F9314864%252Finterior_boot-1774711500522.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4864/9314864/interior_boot-1774711500522.jpg not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7418%252F20477418%252Fwheels_front_driver-1774634292373.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7418/20477418/wheels_front_driver-1774634292373.jpg not downloaded yet
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a022d0>
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_358863f8-df6e-5358-b55f-de470ad6d423/358863f8-df6e-5358-b55f-de470ad6d423_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F9424%252F19289424%252Fdocs_service_history-1770134968477.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfaa377dbc32c79561826f88c8e05a72c') HTTP/1.1" 204 0
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/9424/19289424/docs_service_history-1770134968477.jpg?ixlib=js-3.8.0&auto=format&s=faa377dbc32c79561826f88c8e05a72c saved to cache
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 358863f8-df6e-5358-b55f-de470ad6d423
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4864%252F9314864%252Fdocs_service_history-1774711587756.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D92ab2160dbcf9548b2a5963510a93449%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4864/9314864/docs_service_history-1774711587756.jpg?ixlib=js-3.8.0&auto=format&s=92ab2160dbcf9548b2a5963510a93449 not downloaded yet
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7418%252F20477418%252Fwheels_rear_driver-1774634289810.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7418/20477418/wheels_rear_driver-1774634289810.jpg not downloaded yet
2026-03-29 20:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3550/20363550/interior_dashboard-1774714795939.jpg> (referer: None)
2026-03-29 20:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3550/20363550/interior_front_seats-1774714915526.jpg> (referer: None)
2026-03-29 20:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3550/20363550/interior_rear_seats-1774714788997.jpg> (referer: None)
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa669901bd0>
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_790385b3-332b-5ebf-a4bf-0a9cfc71309b/790385b3-332b-5ebf-a4bf-0a9cfc71309b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3550%252F20363550%252Fexterior_rear_passenger-1774714181972.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3550/20363550/exterior_rear_passenger-1774714181972.jpg saved to cache
2026-03-29 20:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 790385b3-332b-5ebf-a4bf-0a9cfc71309b
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e2d010>
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_790385b3-332b-5ebf-a4bf-0a9cfc71309b/790385b3-332b-5ebf-a4bf-0a9cfc71309b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3550%252F20363550%252Finterior_dashboard-1774714795939.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3550/20363550/interior_dashboard-1774714795939.jpg saved to cache
2026-03-29 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 790385b3-332b-5ebf-a4bf-0a9cfc71309b
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d75e10>
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_790385b3-332b-5ebf-a4bf-0a9cfc71309b/790385b3-332b-5ebf-a4bf-0a9cfc71309b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3550%252F20363550%252Finterior_front_seats-1774714915526.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3550/20363550/interior_front_seats-1774714915526.jpg saved to cache
2026-03-29 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 790385b3-332b-5ebf-a4bf-0a9cfc71309b
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658356010>
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_790385b3-332b-5ebf-a4bf-0a9cfc71309b/790385b3-332b-5ebf-a4bf-0a9cfc71309b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3550%252F20363550%252Finterior_rear_seats-1774714788997.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3550/20363550/interior_rear_seats-1774714788997.jpg saved to cache
2026-03-29 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 790385b3-332b-5ebf-a4bf-0a9cfc71309b
2026-03-29 20:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/9424/19289424/docs_service_history-1770134949519.jpg?ixlib=js-3.8.0&auto=format&s=143b7f23f5ddad80803805857d7c823e> (referer: None)
2026-03-29 20:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3550/20363550/exterior_front_passenger-1774714177103.jpg> (referer: None)
2026-03-29 20:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7418/20477418/wheels_front_driver-1774634292373.jpg> (referer: None)
2026-03-29 20:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7418/20477418/interior_rear_seats-1774635545031.jpg> (referer: None)
2026-03-29 20:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7418/20477418/exterior_rear_passenger-1774634222081.jpg> (referer: None)
2026-03-29 20:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5437/9335437/instrument_cluster-1774772326015.jpg> (referer: None)
2026-03-29 20:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5743/3925743/interior_rear_seats-1774537263611.jpeg> (referer: None)
2026-03-29 20:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5743/3925743/interior_front_seats-1774537225614.jpeg> (referer: None)
2026-03-29 20:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5743/3925743/interior_dashboard-1774537099373.jpeg> (referer: None)
2026-03-29 20:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5437/9335437/interior_boot-1774772251671.jpg> (referer: None)
2026-03-29 20:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5437/9335437/docs_service_history-1774772447627.jpg?ixlib=js-3.8.0&auto=format&s=cf6804c4935b86cf6a9f2af332a49fc3> (referer: None)
2026-03-29 20:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9424/19289424/interior_boot-1770134876937.jpg> (referer: None)
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658376bd0>
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_358863f8-df6e-5358-b55f-de470ad6d423/358863f8-df6e-5358-b55f-de470ad6d423_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F9424%252F19289424%252Fdocs_service_history-1770134949519.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D143b7f23f5ddad80803805857d7c823e') HTTP/1.1" 204 0
2026-03-29 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/9424/19289424/docs_service_history-1770134949519.jpg?ixlib=js-3.8.0&auto=format&s=143b7f23f5ddad80803805857d7c823e saved to cache
2026-03-29 20:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 358863f8-df6e-5358-b55f-de470ad6d423
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d781d0>
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_790385b3-332b-5ebf-a4bf-0a9cfc71309b/790385b3-332b-5ebf-a4bf-0a9cfc71309b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3550%252F20363550%252Fexterior_front_passenger-1774714177103.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3550/20363550/exterior_front_passenger-1774714177103.jpg saved to cache
2026-03-29 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 790385b3-332b-5ebf-a4bf-0a9cfc71309b
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589f9b10>
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_024c4238-8fc6-523a-a72a-b9b816584a50/024c4238-8fc6-523a-a72a-b9b816584a50_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7418%252F20477418%252Fwheels_front_driver-1774634292373.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7418/20477418/wheels_front_driver-1774634292373.jpg saved to cache
2026-03-29 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 024c4238-8fc6-523a-a72a-b9b816584a50
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a016d0>
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_024c4238-8fc6-523a-a72a-b9b816584a50/024c4238-8fc6-523a-a72a-b9b816584a50_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7418%252F20477418%252Finterior_rear_seats-1774635545031.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7418/20477418/interior_rear_seats-1774635545031.jpg saved to cache
2026-03-29 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 024c4238-8fc6-523a-a72a-b9b816584a50
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c5bd10>
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_024c4238-8fc6-523a-a72a-b9b816584a50/024c4238-8fc6-523a-a72a-b9b816584a50_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7418%252F20477418%252Fexterior_rear_passenger-1774634222081.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7418/20477418/exterior_rear_passenger-1774634222081.jpg saved to cache
2026-03-29 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 024c4238-8fc6-523a-a72a-b9b816584a50
2026-03-29 20:11:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a02250>
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_001b9a53-6b15-56a3-9f2d-2d3f40807698/001b9a53-6b15-56a3-9f2d-2d3f40807698_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5437%252F9335437%252Finstrument_cluster-1774772326015.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5437/9335437/instrument_cluster-1774772326015.jpg saved to cache
2026-03-29 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 001b9a53-6b15-56a3-9f2d-2d3f40807698
2026-03-29 20:11:10 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:10 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:10 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x006\xe8\xf8\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x036\xcb\x006\xdeZ\x00\x00\x00\x00'
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c4d310>
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67bb108f-10c6-5b79-8498-45e25103b0e9/67bb108f-10c6-5b79-8498-45e25103b0e9_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5743%252F3925743%252Finterior_rear_seats-1774537263611.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5743/3925743/interior_rear_seats-1774537263611.jpeg saved to cache
2026-03-29 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 67bb108f-10c6-5b79-8498-45e25103b0e9
2026-03-29 20:11:10 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:10 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:10 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x009\xbf\xf0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03B\x0c\x009\xb5R\x00\x00\x00\x00'
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a00a10>
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67bb108f-10c6-5b79-8498-45e25103b0e9/67bb108f-10c6-5b79-8498-45e25103b0e9_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5743%252F3925743%252Finterior_front_seats-1774537225614.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5743/3925743/interior_front_seats-1774537225614.jpeg saved to cache
2026-03-29 20:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 67bb108f-10c6-5b79-8498-45e25103b0e9
2026-03-29 20:11:10 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:10 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:10 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00;j\xbb\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03\xdc5\x00;_\xd5\x00\x00\x00\x00'
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c59610>
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67bb108f-10c6-5b79-8498-45e25103b0e9/67bb108f-10c6-5b79-8498-45e25103b0e9_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5743%252F3925743%252Finterior_dashboard-1774537099373.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5743/3925743/interior_dashboard-1774537099373.jpeg saved to cache
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 67bb108f-10c6-5b79-8498-45e25103b0e9
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a01690>
2026-03-29 20:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_001b9a53-6b15-56a3-9f2d-2d3f40807698/001b9a53-6b15-56a3-9f2d-2d3f40807698_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5437%252F9335437%252Finterior_boot-1774772251671.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5437/9335437/interior_boot-1774772251671.jpg saved to cache
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 001b9a53-6b15-56a3-9f2d-2d3f40807698
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658554ed0>
2026-03-29 20:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_001b9a53-6b15-56a3-9f2d-2d3f40807698/001b9a53-6b15-56a3-9f2d-2d3f40807698_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5437%252F9335437%252Fdocs_service_history-1774772447627.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcf6804c4935b86cf6a9f2af332a49fc3') HTTP/1.1" 204 0
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5437/9335437/docs_service_history-1774772447627.jpg?ixlib=js-3.8.0&auto=format&s=cf6804c4935b86cf6a9f2af332a49fc3 saved to cache
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 001b9a53-6b15-56a3-9f2d-2d3f40807698
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 170 - value: b'samsung\x00'
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 178 - value: b'2026:02:03 16:04:44\x00'
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x00\x00\x02\\'
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 82 - Data Location: 198 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 94 - Data Location: 206 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 118 - Data Location: 214 - value: b'SM-S711B\x00'
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 130 - Data Location: 223 - value: b'S711BXXSDFZA1\x00'
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xed'
2026-03-29 20:11:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d4fdd0>
2026-03-29 20:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_358863f8-df6e-5358-b55f-de470ad6d423/358863f8-df6e-5358-b55f-de470ad6d423_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9424%252F19289424%252Finterior_boot-1770134876937.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9424/19289424/interior_boot-1770134876937.jpg saved to cache
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 358863f8-df6e-5358-b55f-de470ad6d423
2026-03-29 20:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19665928.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7418/20477418/wheels_rear_driver-1774634289810.jpg> (referer: None)
2026-03-29 20:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7418/20477418/interior_dashboard-1774635426666.jpg> (referer: None)
2026-03-29 20:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7418/20477418/interior_boot-1774635383891.jpg> (referer: None)
2026-03-29 20:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4864/9314864/instrument_cluster-1774629262192.jpg> (referer: None)
2026-03-29 20:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4864/9314864/interior_boot-1774711500522.jpg> (referer: None)
2026-03-29 20:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4864/9314864/docs_service_history-1774711587756.jpg?ixlib=js-3.8.0&auto=format&s=92ab2160dbcf9548b2a5963510a93449> (referer: None)
2026-03-29 20:11:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b72eafc-1685-52c6-8570-07f93d43a343 with identifier: 19665928
2026-03-29 20:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b72eafc-1685-52c6-8570-07f93d43a343 with scrape type 1
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2b72eafc-1685-52c6-8570-07f93d43a343
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5928%252F19665928%252Fexterior_front_driver-1774691558801.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5928/19665928/exterior_front_driver-1774691558801.jpg not downloaded yet
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5928%252F19665928%252Fexterior_rear_driver-1774691600921.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5928/19665928/exterior_rear_driver-1774691600921.jpg not downloaded yet
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5928%252F19665928%252Fexterior_front_passenger-1774692213453.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5928/19665928/exterior_front_passenger-1774692213453.jpg not downloaded yet
2026-03-29 20:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65c8cb690>
2026-03-29 20:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_024c4238-8fc6-523a-a72a-b9b816584a50/024c4238-8fc6-523a-a72a-b9b816584a50_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7418%252F20477418%252Fwheels_rear_driver-1774634289810.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7418/20477418/wheels_rear_driver-1774634289810.jpg saved to cache
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 024c4238-8fc6-523a-a72a-b9b816584a50
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5928%252F19665928%252Fexterior_rear_passenger-1774692292761.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5928/19665928/exterior_rear_passenger-1774692292761.jpg not downloaded yet
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586e1990>
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_024c4238-8fc6-523a-a72a-b9b816584a50/024c4238-8fc6-523a-a72a-b9b816584a50_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7418%252F20477418%252Finterior_dashboard-1774635426666.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7418/20477418/interior_dashboard-1774635426666.jpg saved to cache
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 024c4238-8fc6-523a-a72a-b9b816584a50
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659bbc390>
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_024c4238-8fc6-523a-a72a-b9b816584a50/024c4238-8fc6-523a-a72a-b9b816584a50_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7418%252F20477418%252Finterior_boot-1774635383891.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7418/20477418/interior_boot-1774635383891.jpg saved to cache
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 024c4238-8fc6-523a-a72a-b9b816584a50
2026-03-29 20:11:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598f0090>
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8/4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4864%252F9314864%252Finstrument_cluster-1774629262192.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4864/9314864/instrument_cluster-1774629262192.jpg saved to cache
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8
2026-03-29 20:11:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b13cd0>
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8/4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4864%252F9314864%252Finterior_boot-1774711500522.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4864/9314864/interior_boot-1774711500522.jpg saved to cache
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8
2026-03-29 20:11:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:11:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:12 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e95450>
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8/4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4864%252F9314864%252Fdocs_service_history-1774711587756.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D92ab2160dbcf9548b2a5963510a93449') HTTP/1.1" 204 0
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4864/9314864/docs_service_history-1774711587756.jpg?ixlib=js-3.8.0&auto=format&s=92ab2160dbcf9548b2a5963510a93449 saved to cache
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5928%252F19665928%252Finterior_front_seats-1774692847503.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5928/19665928/interior_front_seats-1774692847503.jpg not downloaded yet
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5928%252F19665928%252Finterior_rear_seats-1774693048857.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5928/19665928/interior_rear_seats-1774693048857.jpg not downloaded yet
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5928%252F19665928%252Finterior_dashboard-1774692911334.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5928/19665928/interior_dashboard-1774692911334.jpg not downloaded yet
2026-03-29 20:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7418/20477418/exterior_front_driver-1774634222517.jpg> (referer: None)
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5928%252F19665928%252Finstrument_cluster-1774692942854.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5928/19665928/instrument_cluster-1774692942854.jpg not downloaded yet
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5928%252F19665928%252Finterior_boot-1774692931911.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5928/19665928/interior_boot-1774692931911.jpg not downloaded yet
2026-03-29 20:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7418/20477418/exterior_front_passenger-1774634217492.jpg> (referer: None)
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5928%252F19665928%252Fdamage_paintwork-1774692479516.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5928/19665928/damage_paintwork-1774692479516.jpg not downloaded yet
2026-03-29 20:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4864/9314864/exterior_front_driver-1774634086913.jpg> (referer: None)
2026-03-29 20:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7418/20477418/interior_front_seats-1774635520988.jpg> (referer: None)
2026-03-29 20:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4864/9314864/interior_dashboard-1774774164351.jpg> (referer: None)
2026-03-29 20:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7418/20477418/exterior_rear_driver-1774634227086.jpg> (referer: None)
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65901d4d0>
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_024c4238-8fc6-523a-a72a-b9b816584a50/024c4238-8fc6-523a-a72a-b9b816584a50_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7418%252F20477418%252Fexterior_front_driver-1774634222517.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7418/20477418/exterior_front_driver-1774634222517.jpg saved to cache
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 024c4238-8fc6-523a-a72a-b9b816584a50
2026-03-29 20:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4864/9314864/exterior_front_passenger-1774634123785.jpg> (referer: None)
2026-03-29 20:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4864/9314864/exterior_rear_driver-1774645184956.jpg> (referer: None)
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b31f10>
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_024c4238-8fc6-523a-a72a-b9b816584a50/024c4238-8fc6-523a-a72a-b9b816584a50_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7418%252F20477418%252Fexterior_front_passenger-1774634217492.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7418/20477418/exterior_front_passenger-1774634217492.jpg saved to cache
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 024c4238-8fc6-523a-a72a-b9b816584a50
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c27190>
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8/4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4864%252F9314864%252Fexterior_front_driver-1774634086913.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4864/9314864/exterior_front_driver-1774634086913.jpg saved to cache
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b2ec10>
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_024c4238-8fc6-523a-a72a-b9b816584a50/024c4238-8fc6-523a-a72a-b9b816584a50_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7418%252F20477418%252Finterior_front_seats-1774635520988.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7418/20477418/interior_front_seats-1774635520988.jpg saved to cache
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 024c4238-8fc6-523a-a72a-b9b816584a50
2026-03-29 20:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4864/9314864/exterior_rear_passenger-1774634102741.jpg> (referer: None)
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659029390>
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8/4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4864%252F9314864%252Finterior_dashboard-1774774164351.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4864/9314864/interior_dashboard-1774774164351.jpg saved to cache
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65befc9d0>
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_024c4238-8fc6-523a-a72a-b9b816584a50/024c4238-8fc6-523a-a72a-b9b816584a50_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7418%252F20477418%252Fexterior_rear_driver-1774634227086.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7418/20477418/exterior_rear_driver-1774634227086.jpg saved to cache
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 024c4238-8fc6-523a-a72a-b9b816584a50
2026-03-29 20:11:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 024c4238-8fc6-523a-a72a-b9b816584a50, skipping ID generation
2026-03-29 20:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 024c4238-8fc6-523a-a72a-b9b816584a50 with scrape type 1
2026-03-29 20:11:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 024c4238-8fc6-523a-a72a-b9b816584a50 sending to next pipeline
2026-03-29 20:11:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 024c4238-8fc6-523a-a72a-b9b816584a50, identifier: 20477418
2026-03-29 20:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b2da90>
2026-03-29 20:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8/4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4864%252F9314864%252Fexterior_front_passenger-1774634123785.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4864/9314864/exterior_front_passenger-1774634123785.jpg saved to cache
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8
2026-03-29 20:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659aaae90>
2026-03-29 20:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8/4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4864%252F9314864%252Fexterior_rear_driver-1774645184956.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4864/9314864/exterior_rear_driver-1774645184956.jpg saved to cache
2026-03-29 20:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8
2026-03-29 20:11:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 024c4238-8fc6-523a-a72a-b9b816584a50 with identifier: 20477418
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Electric HTTP/1.1" 200 None
2026-03-29 20:11:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:11:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 024c4238-8fc6-523a-a72a-b9b816584a50 with identifier: 20477418
2026-03-29 20:11:14 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 024c4238-8fc6-523a-a72a-b9b816584a50 with identifier: 20477418 to the API
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7418/20477418/exterior_rear_driver-1774634227086.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Electric',
'id': '024c4238-8fc6-523a-a72a-b9b816584a50',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LC23 HHS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20477418',
'listing': 'auction',
'location': 'Hertfordshire St Albans',
'make': 'Tesla',
'model': 'Model Y',
'odometer': 8698,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_024c4238-8fc6-523a-a72a-b9b816584a50/024c4238-8fc6-523a-a72a-b9b816584a50_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 613371,
'Height': 2195,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7418/20477418/exterior_front_driver-1774634222517.jpg',
'Width': 2926},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_024c4238-8fc6-523a-a72a-b9b816584a50/024c4238-8fc6-523a-a72a-b9b816584a50_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2031217,
'Height': 2842,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7418/20477418/exterior_rear_driver-1774634227086.jpg',
'Width': 3789},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_024c4238-8fc6-523a-a72a-b9b816584a50/024c4238-8fc6-523a-a72a-b9b816584a50_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1527974,
'Height': 2649,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7418/20477418/exterior_front_passenger-1774634217492.jpg',
'Width': 3532},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_024c4238-8fc6-523a-a72a-b9b816584a50/024c4238-8fc6-523a-a72a-b9b816584a50_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2152488,
'Height': 2669,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7418/20477418/exterior_rear_passenger-1774634222081.jpg',
'Width': 3558},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_024c4238-8fc6-523a-a72a-b9b816584a50/024c4238-8fc6-523a-a72a-b9b816584a50_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1084198,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7418/20477418/interior_front_seats-1774635520988.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_024c4238-8fc6-523a-a72a-b9b816584a50/024c4238-8fc6-523a-a72a-b9b816584a50_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1501941,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7418/20477418/interior_rear_seats-1774635545031.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_024c4238-8fc6-523a-a72a-b9b816584a50/024c4238-8fc6-523a-a72a-b9b816584a50_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1355993,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7418/20477418/interior_dashboard-1774635426666.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_024c4238-8fc6-523a-a72a-b9b816584a50/024c4238-8fc6-523a-a72a-b9b816584a50_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1626606,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7418/20477418/interior_boot-1774635383891.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_024c4238-8fc6-523a-a72a-b9b816584a50/024c4238-8fc6-523a-a72a-b9b816584a50_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 861268,
'Height': 2053,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7418/20477418/wheels_front_driver-1774634292373.jpg',
'Width': 2737},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_024c4238-8fc6-523a-a72a-b9b816584a50/024c4238-8fc6-523a-a72a-b9b816584a50_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 906509,
'Height': 2060,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7418/20477418/wheels_rear_driver-1774634289810.jpg',
'Width': 2747}],
'price': 22234,
'price_includes_vat': False,
'registration_date': '2023-03-30',
'seats_number': None,
'seller_name': None,
'title': 'Tesla Model Y RWD',
'transmission': 'automatic',
'trim': 'RWD',
'vin': 'LRWYHCFS9PC719503',
'year': 2023}
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720477418%27 HTTP/1.1" 200 None
2026-03-29 20:11:14 [motorway.uk] INFO: Saving data for 20477418: {'created_time': 1774815074.871963, 'last_price_update_time': 1774815074.871974, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20477418') HTTP/1.1" 204 0
2026-03-29 20:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5743/3925743/exterior_rear_driver-1774537796394.jpeg> (referer: None)
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cea250>
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8/4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4864%252F9314864%252Fexterior_rear_passenger-1774634102741.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4864/9314864/exterior_rear_passenger-1774634102741.jpg saved to cache
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ad3210>
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67bb108f-10c6-5b79-8498-45e25103b0e9/67bb108f-10c6-5b79-8498-45e25103b0e9_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5743%252F3925743%252Fexterior_rear_driver-1774537796394.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5743/3925743/exterior_rear_driver-1774537796394.jpeg saved to cache
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 67bb108f-10c6-5b79-8498-45e25103b0e9
2026-03-29 20:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4864/9314864/interior_front_seats-1774629216184.jpg> (referer: None)
2026-03-29 20:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4864/9314864/interior_rear_seats-1774711476550.jpg> (referer: None)
2026-03-29 20:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5928/19665928/damage_paintwork-1774692479516.jpg> (referer: None)
2026-03-29 20:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5928/19665928/exterior_front_passenger-1774692213453.jpg> (referer: None)
2026-03-29 20:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5928/19665928/exterior_rear_passenger-1774692292761.jpg> (referer: None)
2026-03-29 20:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5928/19665928/exterior_front_driver-1774691558801.jpg> (referer: None)
2026-03-29 20:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5928/19665928/instrument_cluster-1774692942854.jpg> (referer: None)
2026-03-29 20:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5928/19665928/interior_front_seats-1774692847503.jpg> (referer: None)
2026-03-29 20:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5928/19665928/interior_rear_seats-1774693048857.jpg> (referer: None)
2026-03-29 20:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5437/9335437/interior_dashboard-1774774859394.jpg> (referer: None)
2026-03-29 20:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5928/19665928/interior_boot-1774692931911.jpg> (referer: None)
2026-03-29 20:11:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c947d0>
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8/4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4864%252F9314864%252Finterior_front_seats-1774629216184.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4864/9314864/interior_front_seats-1774629216184.jpg saved to cache
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8
2026-03-29 20:11:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cb9b50>
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8/4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4864%252F9314864%252Finterior_rear_seats-1774711476550.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4864/9314864/interior_rear_seats-1774711476550.jpg saved to cache
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8
2026-03-29 20:11:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8, skipping ID generation
2026-03-29 20:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8 with scrape type 1
2026-03-29 20:11:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8 sending to next pipeline
2026-03-29 20:11:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8, identifier: 9314864
2026-03-29 20:11:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8 with identifier: 9314864
2026-03-29 20:11:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8 with identifier: 9314864
2026-03-29 20:11:15 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8 with identifier: 9314864 to the API
2026-03-29 20:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/4864/9314864/interior_rear_seats-1774711476550.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'B9 NCX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/9314864',
'listing': 'auction',
'location': 'Cambridgeshire Huntingdon',
'make': 'Audi',
'model': 'Q7',
'odometer': 55934,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8/4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1456283,
'Height': 2244,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4864/9314864/exterior_front_driver-1774634086913.jpg',
'Width': 2992},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8/4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1708636,
'Height': 2486,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4864/9314864/exterior_rear_driver-1774645184956.jpg',
'Width': 3314},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8/4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1701779,
'Height': 2459,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4864/9314864/exterior_front_passenger-1774634123785.jpg',
'Width': 3279},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8/4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1927270,
'Height': 2615,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4864/9314864/exterior_rear_passenger-1774634102741.jpg',
'Width': 3487},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8/4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3144051,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4864/9314864/interior_front_seats-1774629216184.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8/4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2988926,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4864/9314864/interior_rear_seats-1774711476550.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8/4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1972850,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4864/9314864/interior_dashboard-1774774164351.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8/4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2402556,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4864/9314864/instrument_cluster-1774629262192.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8/4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3950496,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4864/9314864/interior_boot-1774711500522.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8/4e57d49e-e04c-58b7-9fdd-fd1bd76ceab8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5098950,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4864/9314864/docs_service_history-1774711587756.jpg?ixlib=js-3.8.0&auto=format&s=92ab2160dbcf9548b2a5963510a93449',
'Width': 4032}],
'price': 35829,
'price_includes_vat': False,
'registration_date': '2021-07-13',
'seats_number': None,
'seller_name': None,
'title': 'Audi Q7 SLN BLK ED 50TDI MHEV QTO A',
'transmission': 'automatic',
'trim': 'SLN BLK ED 50TDI MHEV QTO A',
'vin': 'WAUZZZ4M3MD029275',
'year': 2021}
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279314864%27 HTTP/1.1" 200 None
2026-03-29 20:11:16 [motorway.uk] INFO: Saving data for 9314864: {'created_time': 1774815076.147562, 'last_price_update_time': 1774815076.147573, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='9314864') HTTP/1.1" 204 0
2026-03-29 20:11:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c1ac50>
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b72eafc-1685-52c6-8570-07f93d43a343/2b72eafc-1685-52c6-8570-07f93d43a343_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5928%252F19665928%252Fdamage_paintwork-1774692479516.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5928/19665928/damage_paintwork-1774692479516.jpg saved to cache
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2b72eafc-1685-52c6-8570-07f93d43a343
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599f00d0>
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b72eafc-1685-52c6-8570-07f93d43a343/2b72eafc-1685-52c6-8570-07f93d43a343_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5928%252F19665928%252Fexterior_front_passenger-1774692213453.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5928/19665928/exterior_front_passenger-1774692213453.jpg saved to cache
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2b72eafc-1685-52c6-8570-07f93d43a343
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fec990>
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b72eafc-1685-52c6-8570-07f93d43a343/2b72eafc-1685-52c6-8570-07f93d43a343_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5928%252F19665928%252Fexterior_rear_passenger-1774692292761.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5928/19665928/exterior_rear_passenger-1774692292761.jpg saved to cache
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2b72eafc-1685-52c6-8570-07f93d43a343
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582e5e90>
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b72eafc-1685-52c6-8570-07f93d43a343/2b72eafc-1685-52c6-8570-07f93d43a343_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5928%252F19665928%252Fexterior_front_driver-1774691558801.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5928/19665928/exterior_front_driver-1774691558801.jpg saved to cache
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2b72eafc-1685-52c6-8570-07f93d43a343
2026-03-29 20:11:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:11:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fad810>
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b72eafc-1685-52c6-8570-07f93d43a343/2b72eafc-1685-52c6-8570-07f93d43a343_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5928%252F19665928%252Finstrument_cluster-1774692942854.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5928/19665928/instrument_cluster-1774692942854.jpg saved to cache
2026-03-29 20:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2b72eafc-1685-52c6-8570-07f93d43a343
2026-03-29 20:11:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:11:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fd1bd0>
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b72eafc-1685-52c6-8570-07f93d43a343/2b72eafc-1685-52c6-8570-07f93d43a343_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5928%252F19665928%252Finterior_front_seats-1774692847503.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5928/19665928/interior_front_seats-1774692847503.jpg saved to cache
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2b72eafc-1685-52c6-8570-07f93d43a343
2026-03-29 20:11:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:11:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658faccd0>
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b72eafc-1685-52c6-8570-07f93d43a343/2b72eafc-1685-52c6-8570-07f93d43a343_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5928%252F19665928%252Finterior_rear_seats-1774693048857.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5928/19665928/interior_rear_seats-1774693048857.jpg saved to cache
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2b72eafc-1685-52c6-8570-07f93d43a343
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582e6050>
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_001b9a53-6b15-56a3-9f2d-2d3f40807698/001b9a53-6b15-56a3-9f2d-2d3f40807698_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5437%252F9335437%252Finterior_dashboard-1774774859394.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5437/9335437/interior_dashboard-1774774859394.jpg saved to cache
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 001b9a53-6b15-56a3-9f2d-2d3f40807698
2026-03-29 20:11:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:11:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658db3f10>
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b72eafc-1685-52c6-8570-07f93d43a343/2b72eafc-1685-52c6-8570-07f93d43a343_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5928%252F19665928%252Finterior_boot-1774692931911.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5928/19665928/interior_boot-1774692931911.jpg saved to cache
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2b72eafc-1685-52c6-8570-07f93d43a343
2026-03-29 20:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20500887.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9424/19289424/interior_dashboard-1770134834036.jpg> (referer: None)
2026-03-29 20:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3550/20363550/exterior_rear_driver-1774714177403.jpg> (referer: None)
2026-03-29 20:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5928/19665928/exterior_rear_driver-1774691600921.jpg> (referer: None)
2026-03-29 20:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5928/19665928/interior_dashboard-1774692911334.jpg> (referer: None)
2026-03-29 20:11:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00195e10-d0ed-55ac-ade3-7a23dc3c02f9 with identifier: 20500887
2026-03-29 20:11:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00195e10-d0ed-55ac-ade3-7a23dc3c02f9 with scrape type 1
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 00195e10-d0ed-55ac-ade3-7a23dc3c02f9
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0887%252F20500887%252Fexterior_front_driver-1774779496468.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0887/20500887/exterior_front_driver-1774779496468.jpg not downloaded yet
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0887%252F20500887%252Fexterior_rear_driver-1774779510150.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0887/20500887/exterior_rear_driver-1774779510150.jpg not downloaded yet
2026-03-29 20:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3303/6813303/docs_service_history-1774621469636.jpg?ixlib=js-3.8.0&auto=format&s=09034fee2969aed76e48ec70f3218139> (referer: None)
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0887%252F20500887%252Fexterior_front_passenger-1774779550355.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0887/20500887/exterior_front_passenger-1774779550355.jpg not downloaded yet
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586cfcd0>
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_358863f8-df6e-5358-b55f-de470ad6d423/358863f8-df6e-5358-b55f-de470ad6d423_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9424%252F19289424%252Finterior_dashboard-1770134834036.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9424/19289424/interior_dashboard-1770134834036.jpg saved to cache
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 358863f8-df6e-5358-b55f-de470ad6d423
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fdb6d0>
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_790385b3-332b-5ebf-a4bf-0a9cfc71309b/790385b3-332b-5ebf-a4bf-0a9cfc71309b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3550%252F20363550%252Fexterior_rear_driver-1774714177403.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3550/20363550/exterior_rear_driver-1774714177403.jpg saved to cache
2026-03-29 20:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 790385b3-332b-5ebf-a4bf-0a9cfc71309b
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659bdab50>
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b72eafc-1685-52c6-8570-07f93d43a343/2b72eafc-1685-52c6-8570-07f93d43a343_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5928%252F19665928%252Fexterior_rear_driver-1774691600921.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5928/19665928/exterior_rear_driver-1774691600921.jpg saved to cache
2026-03-29 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2b72eafc-1685-52c6-8570-07f93d43a343
2026-03-29 20:11:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:11:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586f96d0>
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b72eafc-1685-52c6-8570-07f93d43a343/2b72eafc-1685-52c6-8570-07f93d43a343_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5928%252F19665928%252Finterior_dashboard-1774692911334.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5928/19665928/interior_dashboard-1774692911334.jpg saved to cache
2026-03-29 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2b72eafc-1685-52c6-8570-07f93d43a343
2026-03-29 20:11:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2b72eafc-1685-52c6-8570-07f93d43a343, skipping ID generation
2026-03-29 20:11:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b72eafc-1685-52c6-8570-07f93d43a343 with scrape type 1
2026-03-29 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2b72eafc-1685-52c6-8570-07f93d43a343 sending to next pipeline
2026-03-29 20:11:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 2b72eafc-1685-52c6-8570-07f93d43a343, identifier: 19665928
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0887%252F20500887%252Fexterior_rear_passenger-1774779525416.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0887/20500887/exterior_rear_passenger-1774779525416.jpg not downloaded yet
2026-03-29 20:11:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 2b72eafc-1685-52c6-8570-07f93d43a343 with identifier: 19665928
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=White HTTP/1.1" 200 None
2026-03-29 20:11:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:11:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 2b72eafc-1685-52c6-8570-07f93d43a343 with identifier: 19665928
2026-03-29 20:11:18 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 2b72eafc-1685-52c6-8570-07f93d43a343 with identifier: 19665928 to the API
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5928/19665928/interior_dashboard-1774692911334.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '2b72eafc-1685-52c6-8570-07f93d43a343',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GU20 RXY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19665928',
'listing': 'auction',
'location': 'Essex Braintree',
'make': 'Audi',
'model': 'A1',
'odometer': 47675,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b72eafc-1685-52c6-8570-07f93d43a343/2b72eafc-1685-52c6-8570-07f93d43a343_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1403285,
'Height': 2242,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5928/19665928/exterior_front_driver-1774691558801.jpg',
'Width': 2989},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b72eafc-1685-52c6-8570-07f93d43a343/2b72eafc-1685-52c6-8570-07f93d43a343_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1642956,
'Height': 2627,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5928/19665928/exterior_rear_driver-1774691600921.jpg',
'Width': 3503},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b72eafc-1685-52c6-8570-07f93d43a343/2b72eafc-1685-52c6-8570-07f93d43a343_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2293885,
'Height': 2812,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5928/19665928/exterior_front_passenger-1774692213453.jpg',
'Width': 3749},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b72eafc-1685-52c6-8570-07f93d43a343/2b72eafc-1685-52c6-8570-07f93d43a343_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2370578,
'Height': 2710,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5928/19665928/exterior_rear_passenger-1774692292761.jpg',
'Width': 3613},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b72eafc-1685-52c6-8570-07f93d43a343/2b72eafc-1685-52c6-8570-07f93d43a343_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3419233,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5928/19665928/interior_front_seats-1774692847503.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b72eafc-1685-52c6-8570-07f93d43a343/2b72eafc-1685-52c6-8570-07f93d43a343_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4078294,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5928/19665928/interior_rear_seats-1774693048857.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b72eafc-1685-52c6-8570-07f93d43a343/2b72eafc-1685-52c6-8570-07f93d43a343_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3040109,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5928/19665928/interior_dashboard-1774692911334.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b72eafc-1685-52c6-8570-07f93d43a343/2b72eafc-1685-52c6-8570-07f93d43a343_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2871167,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5928/19665928/instrument_cluster-1774692942854.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b72eafc-1685-52c6-8570-07f93d43a343/2b72eafc-1685-52c6-8570-07f93d43a343_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4711181,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5928/19665928/interior_boot-1774692931911.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b72eafc-1685-52c6-8570-07f93d43a343/2b72eafc-1685-52c6-8570-07f93d43a343_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1219338,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5928/19665928/damage_paintwork-1774692479516.jpg',
'Width': 4032}],
'price': 12863,
'price_includes_vat': False,
'registration_date': '2020-05-29',
'seats_number': None,
'seller_name': None,
'title': 'Audi A1 Sport 30 TFSI S-A',
'transmission': 'automatic',
'trim': 'Sport 30 TFSI S-A',
'vin': 'WAUZZZGB0LR043596',
'year': 2020}
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719665928%27 HTTP/1.1" 200 None
2026-03-29 20:11:18 [motorway.uk] INFO: Saving data for 19665928: {'created_time': 1774815078.813493, 'last_price_update_time': 1774815078.813503, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19665928') HTTP/1.1" 204 0
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0887%252F20500887%252Finterior_front_seats-1774779913660.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0887/20500887/interior_front_seats-1774779913660.jpg not downloaded yet
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0887%252F20500887%252Finterior_rear_seats-1774779949457.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0887/20500887/interior_rear_seats-1774779949457.jpg not downloaded yet
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ca3090>
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8be4dd32-0a36-5821-aac8-df81d38bdcad/8be4dd32-0a36-5821-aac8-df81d38bdcad_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3303%252F6813303%252Fdocs_service_history-1774621469636.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D09034fee2969aed76e48ec70f3218139') HTTP/1.1" 204 0
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3303/6813303/docs_service_history-1774621469636.jpg?ixlib=js-3.8.0&auto=format&s=09034fee2969aed76e48ec70f3218139 saved to cache
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8be4dd32-0a36-5821-aac8-df81d38bdcad
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0887%252F20500887%252Finterior_dashboard-1774781056774.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0887/20500887/interior_dashboard-1774781056774.jpg not downloaded yet
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0887%252F20500887%252Finterior_boot-1774780648851.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0887/20500887/interior_boot-1774780648851.jpg not downloaded yet
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0887%252F20500887%252Fdocs_service_history-1774780752640.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D603604af18df076dbf64e4ea16188904%27 HTTP/1.1" 200 None
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0887/20500887/docs_service_history-1774780752640.png?ixlib=js-3.8.0&auto=format&s=603604af18df076dbf64e4ea16188904 not downloaded yet
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0887%252F20500887%252Fdamage_scratches-1774780912361.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0887/20500887/damage_scratches-1774780912361.jpg not downloaded yet
2026-03-29 20:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5743/3925743/exterior_front_driver-1769699844739.jpeg> (referer: None)
2026-03-29 20:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8956/20448956/exterior_front_driver-1774690403536.jpg> (referer: None)
2026-03-29 20:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3550/20363550/exterior_front_driver-1774714179474.jpg> (referer: None)
2026-03-29 20:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9424/19289424/exterior_rear_driver-1770134430884.jpg> (referer: None)
2026-03-29 20:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9424/19289424/exterior_front_passenger-1770134461518.jpg> (referer: None)
2026-03-29 20:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9424/19289424/exterior_rear_passenger-1770134412062.jpg> (referer: None)
2026-03-29 20:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5437/9335437/exterior_rear_driver-1774771575009.jpg> (referer: None)
2026-03-29 20:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5437/9335437/exterior_rear_passenger-1774771591797.jpg> (referer: None)
2026-03-29 20:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5437/9335437/interior_rear_seats-1774772269603.jpg> (referer: None)
2026-03-29 20:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5437/9335437/interior_front_seats-1774772187741.jpg> (referer: None)
2026-03-29 20:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3303/6813303/interior_boot-1774620604389.jpg> (referer: None)
2026-03-29 20:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9424/19289424/interior_rear_seats-1770134898303.jpg> (referer: None)
2026-03-29 20:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9424/19289424/interior_front_seats-1770221746299.jpg> (referer: None)
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a186d0>
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67bb108f-10c6-5b79-8498-45e25103b0e9/67bb108f-10c6-5b79-8498-45e25103b0e9_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5743%252F3925743%252Fexterior_front_driver-1769699844739.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5743/3925743/exterior_front_driver-1769699844739.jpeg saved to cache
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67bb108f-10c6-5b79-8498-45e25103b0e9
2026-03-29 20:11:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67bb108f-10c6-5b79-8498-45e25103b0e9, skipping ID generation
2026-03-29 20:11:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67bb108f-10c6-5b79-8498-45e25103b0e9 with scrape type 1
2026-03-29 20:11:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67bb108f-10c6-5b79-8498-45e25103b0e9 sending to next pipeline
2026-03-29 20:11:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 67bb108f-10c6-5b79-8498-45e25103b0e9, identifier: 3925743
2026-03-29 20:11:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 67bb108f-10c6-5b79-8498-45e25103b0e9 with identifier: 3925743
2026-03-29 20:11:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 67bb108f-10c6-5b79-8498-45e25103b0e9 with identifier: 3925743
2026-03-29 20:11:19 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 67bb108f-10c6-5b79-8498-45e25103b0e9 with identifier: 3925743 to the API
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5743/3925743/exterior_front_driver-1769699844739.jpeg>
{'auction_title': '',
'category': None,
'color': 'Green',
'currency': 'GBP',
'doors_number': None,
'engine': '2.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '67bb108f-10c6-5b79-8498-45e25103b0e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OE15 UTM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/3925743',
'listing': 'auction',
'location': 'Swindon Swindon',
'make': 'Land Rover',
'model': 'Defender',
'odometer': 29246,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67bb108f-10c6-5b79-8498-45e25103b0e9/67bb108f-10c6-5b79-8498-45e25103b0e9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2113929,
'Height': 2546,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5743/3925743/exterior_front_driver-1769699844739.jpeg',
'Width': 3395},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67bb108f-10c6-5b79-8498-45e25103b0e9/67bb108f-10c6-5b79-8498-45e25103b0e9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2267924,
'Height': 2639,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5743/3925743/exterior_rear_driver-1774537796394.jpeg',
'Width': 3519},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67bb108f-10c6-5b79-8498-45e25103b0e9/67bb108f-10c6-5b79-8498-45e25103b0e9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2458060,
'Height': 2870,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5743/3925743/exterior_front_passenger-1769699860328.jpeg',
'Width': 3827},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67bb108f-10c6-5b79-8498-45e25103b0e9/67bb108f-10c6-5b79-8498-45e25103b0e9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2677260,
'Height': 2974,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5743/3925743/exterior_rear_passenger-1774537842725.jpeg',
'Width': 3965},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67bb108f-10c6-5b79-8498-45e25103b0e9/67bb108f-10c6-5b79-8498-45e25103b0e9_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3998204,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5743/3925743/interior_front_seats-1774537225614.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67bb108f-10c6-5b79-8498-45e25103b0e9/67bb108f-10c6-5b79-8498-45e25103b0e9_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3809219,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5743/3925743/interior_rear_seats-1774537263611.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67bb108f-10c6-5b79-8498-45e25103b0e9/67bb108f-10c6-5b79-8498-45e25103b0e9_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4146928,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5743/3925743/interior_dashboard-1774537099373.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67bb108f-10c6-5b79-8498-45e25103b0e9/67bb108f-10c6-5b79-8498-45e25103b0e9_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3560213,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5743/3925743/instrument_cluster-1774537261673.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67bb108f-10c6-5b79-8498-45e25103b0e9/67bb108f-10c6-5b79-8498-45e25103b0e9_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4172645,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5743/3925743/interior_boot-1774538030283.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67bb108f-10c6-5b79-8498-45e25103b0e9/67bb108f-10c6-5b79-8498-45e25103b0e9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1391759,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/5743/3925743/3925743-docs_service_history-modified-1769775542743.jpeg?ixlib=js-3.8.0&auto=format&s=a73350cb5c8ce52e765901efcbb137e6',
'Width': 4032}],
'price': 39856,
'price_includes_vat': False,
'registration_date': '2015-06-16',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Defender 110 XS TD D/C',
'transmission': 'manual',
'trim': '110 XS TD D/C',
'vin': 'SALLDHMP7EA455914',
'year': 2015}
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273925743%27 HTTP/1.1" 200 None
2026-03-29 20:11:19 [motorway.uk] INFO: Saving data for 3925743: {'created_time': 1774815079.870285, 'last_price_update_time': 1774815079.870295, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='3925743') HTTP/1.1" 204 0
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d99790>
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9252b9bb-3600-5be5-8f24-5d9eb2fadf88/9252b9bb-3600-5be5-8f24-5d9eb2fadf88_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8956%252F20448956%252Fexterior_front_driver-1774690403536.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8956/20448956/exterior_front_driver-1774690403536.jpg saved to cache
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9252b9bb-3600-5be5-8f24-5d9eb2fadf88
2026-03-29 20:11:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9252b9bb-3600-5be5-8f24-5d9eb2fadf88, skipping ID generation
2026-03-29 20:11:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9252b9bb-3600-5be5-8f24-5d9eb2fadf88 with scrape type 1
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9252b9bb-3600-5be5-8f24-5d9eb2fadf88 sending to next pipeline
2026-03-29 20:11:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9252b9bb-3600-5be5-8f24-5d9eb2fadf88, identifier: 20448956
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659bbd9d0>
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_790385b3-332b-5ebf-a4bf-0a9cfc71309b/790385b3-332b-5ebf-a4bf-0a9cfc71309b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3550%252F20363550%252Fexterior_front_driver-1774714179474.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3550/20363550/exterior_front_driver-1774714179474.jpg saved to cache
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 790385b3-332b-5ebf-a4bf-0a9cfc71309b
2026-03-29 20:11:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 790385b3-332b-5ebf-a4bf-0a9cfc71309b, skipping ID generation
2026-03-29 20:11:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 790385b3-332b-5ebf-a4bf-0a9cfc71309b with scrape type 1
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 790385b3-332b-5ebf-a4bf-0a9cfc71309b sending to next pipeline
2026-03-29 20:11:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 790385b3-332b-5ebf-a4bf-0a9cfc71309b, identifier: 20363550
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659bbde10>
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_358863f8-df6e-5358-b55f-de470ad6d423/358863f8-df6e-5358-b55f-de470ad6d423_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9424%252F19289424%252Fexterior_rear_driver-1770134430884.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9424/19289424/exterior_rear_driver-1770134430884.jpg saved to cache
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 358863f8-df6e-5358-b55f-de470ad6d423
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a846d0>
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_358863f8-df6e-5358-b55f-de470ad6d423/358863f8-df6e-5358-b55f-de470ad6d423_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9424%252F19289424%252Fexterior_front_passenger-1770134461518.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9424/19289424/exterior_front_passenger-1770134461518.jpg saved to cache
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 358863f8-df6e-5358-b55f-de470ad6d423
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fb1010>
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_358863f8-df6e-5358-b55f-de470ad6d423/358863f8-df6e-5358-b55f-de470ad6d423_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9424%252F19289424%252Fexterior_rear_passenger-1770134412062.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9424/19289424/exterior_rear_passenger-1770134412062.jpg saved to cache
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 358863f8-df6e-5358-b55f-de470ad6d423
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d99910>
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_001b9a53-6b15-56a3-9f2d-2d3f40807698/001b9a53-6b15-56a3-9f2d-2d3f40807698_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5437%252F9335437%252Fexterior_rear_driver-1774771575009.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5437/9335437/exterior_rear_driver-1774771575009.jpg saved to cache
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 001b9a53-6b15-56a3-9f2d-2d3f40807698
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d16f90>
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_001b9a53-6b15-56a3-9f2d-2d3f40807698/001b9a53-6b15-56a3-9f2d-2d3f40807698_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5437%252F9335437%252Fexterior_rear_passenger-1774771591797.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5437/9335437/exterior_rear_passenger-1774771591797.jpg saved to cache
2026-03-29 20:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 001b9a53-6b15-56a3-9f2d-2d3f40807698
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ff7910>
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_001b9a53-6b15-56a3-9f2d-2d3f40807698/001b9a53-6b15-56a3-9f2d-2d3f40807698_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5437%252F9335437%252Finterior_rear_seats-1774772269603.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5437/9335437/interior_rear_seats-1774772269603.jpg saved to cache
2026-03-29 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 001b9a53-6b15-56a3-9f2d-2d3f40807698
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d14250>
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_001b9a53-6b15-56a3-9f2d-2d3f40807698/001b9a53-6b15-56a3-9f2d-2d3f40807698_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5437%252F9335437%252Finterior_front_seats-1774772187741.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5437/9335437/interior_front_seats-1774772187741.jpg saved to cache
2026-03-29 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 001b9a53-6b15-56a3-9f2d-2d3f40807698
2026-03-29 20:11:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 001b9a53-6b15-56a3-9f2d-2d3f40807698, skipping ID generation
2026-03-29 20:11:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 001b9a53-6b15-56a3-9f2d-2d3f40807698 with scrape type 1
2026-03-29 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 001b9a53-6b15-56a3-9f2d-2d3f40807698 sending to next pipeline
2026-03-29 20:11:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 001b9a53-6b15-56a3-9f2d-2d3f40807698, identifier: 9335437
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598f03d0>
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8be4dd32-0a36-5821-aac8-df81d38bdcad/8be4dd32-0a36-5821-aac8-df81d38bdcad_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3303%252F6813303%252Finterior_boot-1774620604389.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3303/6813303/interior_boot-1774620604389.jpg saved to cache
2026-03-29 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8be4dd32-0a36-5821-aac8-df81d38bdcad
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 170 - value: b'samsung\x00'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 178 - value: b'2026:02:03 16:05:18\x00'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x00\x00\x02\\'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 82 - Data Location: 198 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 94 - Data Location: 206 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 118 - Data Location: 214 - value: b'SM-S711B\x00'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 130 - Data Location: 223 - value: b'S711BXXSDFZA1\x00'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xed'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658314810>
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_358863f8-df6e-5358-b55f-de470ad6d423/358863f8-df6e-5358-b55f-de470ad6d423_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9424%252F19289424%252Finterior_rear_seats-1770134898303.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9424/19289424/interior_rear_seats-1770134898303.jpg saved to cache
2026-03-29 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 358863f8-df6e-5358-b55f-de470ad6d423
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 170 - value: b'samsung\x00'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 178 - value: b'2026:02:04 16:14:51\x00'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: GPSInfoIFD (34853) - type: long (4) - value: b'\x00\x00\x02\\'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 82 - Data Location: 198 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 94 - Data Location: 206 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 118 - Data Location: 214 - value: b'SM-S711B\x00'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 130 - Data Location: 223 - value: b'S711BXXSDFZA1\x00'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xed'
2026-03-29 20:11:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d375d0>
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_358863f8-df6e-5358-b55f-de470ad6d423/358863f8-df6e-5358-b55f-de470ad6d423_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9424%252F19289424%252Finterior_front_seats-1770221746299.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9424/19289424/interior_front_seats-1770221746299.jpg saved to cache
2026-03-29 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 358863f8-df6e-5358-b55f-de470ad6d423
2026-03-29 20:11:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 358863f8-df6e-5358-b55f-de470ad6d423, skipping ID generation
2026-03-29 20:11:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 358863f8-df6e-5358-b55f-de470ad6d423 with scrape type 1
2026-03-29 20:11:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 358863f8-df6e-5358-b55f-de470ad6d423 sending to next pipeline
2026-03-29 20:11:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 358863f8-df6e-5358-b55f-de470ad6d423, identifier: 19289424
2026-03-29 20:11:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9252b9bb-3600-5be5-8f24-5d9eb2fadf88 with identifier: 20448956
2026-03-29 20:11:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9252b9bb-3600-5be5-8f24-5d9eb2fadf88 with identifier: 20448956
2026-03-29 20:11:22 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9252b9bb-3600-5be5-8f24-5d9eb2fadf88 with identifier: 20448956 to the API
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8956/20448956/exterior_front_driver-1774690403536.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '9252b9bb-3600-5be5-8f24-5d9eb2fadf88',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'HK67 XKY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20448956',
'listing': 'auction',
'location': 'Surrey Hindhead',
'make': 'Mazda',
'model': '6',
'odometer': 69200,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9252b9bb-3600-5be5-8f24-5d9eb2fadf88/9252b9bb-3600-5be5-8f24-5d9eb2fadf88_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1504605,
'Height': 2321,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8956/20448956/exterior_front_driver-1774690403536.jpg',
'Width': 3095},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9252b9bb-3600-5be5-8f24-5d9eb2fadf88/9252b9bb-3600-5be5-8f24-5d9eb2fadf88_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1625202,
'Height': 2393,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8956/20448956/exterior_rear_driver-1774690420016.jpg',
'Width': 3191},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9252b9bb-3600-5be5-8f24-5d9eb2fadf88/9252b9bb-3600-5be5-8f24-5d9eb2fadf88_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1756203,
'Height': 2570,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8956/20448956/exterior_front_passenger-1774690443101.jpg',
'Width': 3427},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9252b9bb-3600-5be5-8f24-5d9eb2fadf88/9252b9bb-3600-5be5-8f24-5d9eb2fadf88_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2335796,
'Height': 2970,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8956/20448956/exterior_rear_passenger-1774690431831.jpg',
'Width': 3960},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9252b9bb-3600-5be5-8f24-5d9eb2fadf88/9252b9bb-3600-5be5-8f24-5d9eb2fadf88_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2759448,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8956/20448956/interior_front_seats-1774690778106.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9252b9bb-3600-5be5-8f24-5d9eb2fadf88/9252b9bb-3600-5be5-8f24-5d9eb2fadf88_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2786367,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8956/20448956/interior_rear_seats-1774692799637.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9252b9bb-3600-5be5-8f24-5d9eb2fadf88/9252b9bb-3600-5be5-8f24-5d9eb2fadf88_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1741484,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8956/20448956/interior_dashboard-1774690825512.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9252b9bb-3600-5be5-8f24-5d9eb2fadf88/9252b9bb-3600-5be5-8f24-5d9eb2fadf88_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3990815,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8956/20448956/interior_boot-1774690843769.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9252b9bb-3600-5be5-8f24-5d9eb2fadf88/9252b9bb-3600-5be5-8f24-5d9eb2fadf88_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2567700,
'Height': 5712,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8956/20448956/docs_service_history-1774691167835.jpg?ixlib=js-3.8.0&auto=format&s=b66ef138ad7672f4da7261999fb42d98',
'Width': 4284},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9252b9bb-3600-5be5-8f24-5d9eb2fadf88/9252b9bb-3600-5be5-8f24-5d9eb2fadf88_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3101963,
'Height': 5712,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8956/20448956/docs_service_history-1774691188451.jpg?ixlib=js-3.8.0&auto=format&s=3efd23e4b5d81452bbf895b399d96c48',
'Width': 4284}],
'price': 8756,
'price_includes_vat': False,
'registration_date': '2018-01-17',
'seats_number': None,
'seller_name': None,
'title': 'Mazda 6 Sport NAV D Auto',
'transmission': 'automatic',
'trim': 'Sport NAV D Auto',
'vin': 'JMZGL692801530134',
'year': 2018}
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720448956%27 HTTP/1.1" 200 None
2026-03-29 20:11:22 [motorway.uk] INFO: Saving data for 20448956: {'created_time': 1774815082.345121, 'last_price_update_time': 1774815082.345131, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20448956') HTTP/1.1" 204 0
2026-03-29 20:11:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 790385b3-332b-5ebf-a4bf-0a9cfc71309b with identifier: 20363550
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Red HTTP/1.1" 200 None
2026-03-29 20:11:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:11:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 790385b3-332b-5ebf-a4bf-0a9cfc71309b with identifier: 20363550
2026-03-29 20:11:22 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 790385b3-332b-5ebf-a4bf-0a9cfc71309b with identifier: 20363550 to the API
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3550/20363550/exterior_front_driver-1774714179474.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '790385b3-332b-5ebf-a4bf-0a9cfc71309b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NG18 XVX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20363550',
'listing': 'auction',
'location': 'Herefordshire Hereford',
'make': 'Honda',
'model': 'CR-V',
'odometer': 53750,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_790385b3-332b-5ebf-a4bf-0a9cfc71309b/790385b3-332b-5ebf-a4bf-0a9cfc71309b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1607554,
'Height': 2676,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3550/20363550/exterior_front_driver-1774714179474.jpg',
'Width': 3568},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_790385b3-332b-5ebf-a4bf-0a9cfc71309b/790385b3-332b-5ebf-a4bf-0a9cfc71309b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1020748,
'Height': 2687,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3550/20363550/exterior_rear_driver-1774714177403.jpg',
'Width': 3583},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_790385b3-332b-5ebf-a4bf-0a9cfc71309b/790385b3-332b-5ebf-a4bf-0a9cfc71309b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1256549,
'Height': 2557,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3550/20363550/exterior_front_passenger-1774714177103.jpg',
'Width': 3409},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_790385b3-332b-5ebf-a4bf-0a9cfc71309b/790385b3-332b-5ebf-a4bf-0a9cfc71309b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 988142,
'Height': 2635,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3550/20363550/exterior_rear_passenger-1774714181972.jpg',
'Width': 3513},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_790385b3-332b-5ebf-a4bf-0a9cfc71309b/790385b3-332b-5ebf-a4bf-0a9cfc71309b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1795811,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/3550/20363550/interior_front_seats-1774714915526.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_790385b3-332b-5ebf-a4bf-0a9cfc71309b/790385b3-332b-5ebf-a4bf-0a9cfc71309b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1532450,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/3550/20363550/interior_rear_seats-1774714788997.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_790385b3-332b-5ebf-a4bf-0a9cfc71309b/790385b3-332b-5ebf-a4bf-0a9cfc71309b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1648581,
'Height': 2891,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3550/20363550/interior_dashboard-1774714795939.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_790385b3-332b-5ebf-a4bf-0a9cfc71309b/790385b3-332b-5ebf-a4bf-0a9cfc71309b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1496106,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/3550/20363550/interior_boot-1774714790809.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_790385b3-332b-5ebf-a4bf-0a9cfc71309b/790385b3-332b-5ebf-a4bf-0a9cfc71309b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 863686,
'Height': 2891,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3550/20363550/docs_service_history-1774715018441.jpg?ixlib=js-3.8.0&auto=format&s=18ac8053025b25d06dae6bffd8d0c03c',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_790385b3-332b-5ebf-a4bf-0a9cfc71309b/790385b3-332b-5ebf-a4bf-0a9cfc71309b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1135294,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/3550/20363550/damage_scratches-1774714331377.jpg',
'Width': 3840}],
'price': 12574,
'price_includes_vat': False,
'registration_date': '2018-08-29',
'seats_number': None,
'seller_name': None,
'title': 'Honda CR-V SE + Navi i-DTEC Auto',
'transmission': 'automatic',
'trim': 'SE + Navi i-DTEC Auto',
'vin': 'SHSRE6850JU003464',
'year': 2018}
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720363550%27 HTTP/1.1" 200 None
2026-03-29 20:11:22 [motorway.uk] INFO: Saving data for 20363550: {'created_time': 1774815082.911868, 'last_price_update_time': 1774815082.911878, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20363550') HTTP/1.1" 204 0
2026-03-29 20:11:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 001b9a53-6b15-56a3-9f2d-2d3f40807698 with identifier: 9335437
2026-03-29 20:11:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 001b9a53-6b15-56a3-9f2d-2d3f40807698 with identifier: 9335437
2026-03-29 20:11:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 001b9a53-6b15-56a3-9f2d-2d3f40807698 with identifier: 9335437 to the API
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/5437/9335437/interior_front_seats-1774772187741.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '001b9a53-6b15-56a3-9f2d-2d3f40807698',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'GL18 XOD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/9335437',
'listing': 'auction',
'location': 'Essex Basildon',
'make': 'Audi',
'model': 'A1',
'odometer': 42500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001b9a53-6b15-56a3-9f2d-2d3f40807698/001b9a53-6b15-56a3-9f2d-2d3f40807698_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1513882,
'Height': 2682,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5437/9335437/exterior_front_driver-1774771546403.jpg',
'Width': 3576},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001b9a53-6b15-56a3-9f2d-2d3f40807698/001b9a53-6b15-56a3-9f2d-2d3f40807698_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1689149,
'Height': 2691,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5437/9335437/exterior_rear_driver-1774771575009.jpg',
'Width': 3588},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001b9a53-6b15-56a3-9f2d-2d3f40807698/001b9a53-6b15-56a3-9f2d-2d3f40807698_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1163631,
'Height': 2462,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5437/9335437/exterior_front_passenger-1774771607107.jpg',
'Width': 3282},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001b9a53-6b15-56a3-9f2d-2d3f40807698/001b9a53-6b15-56a3-9f2d-2d3f40807698_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1744195,
'Height': 2774,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5437/9335437/exterior_rear_passenger-1774771591797.jpg',
'Width': 3699},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001b9a53-6b15-56a3-9f2d-2d3f40807698/001b9a53-6b15-56a3-9f2d-2d3f40807698_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3857459,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5437/9335437/interior_front_seats-1774772187741.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001b9a53-6b15-56a3-9f2d-2d3f40807698/001b9a53-6b15-56a3-9f2d-2d3f40807698_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3505893,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5437/9335437/interior_rear_seats-1774772269603.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001b9a53-6b15-56a3-9f2d-2d3f40807698/001b9a53-6b15-56a3-9f2d-2d3f40807698_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2861766,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5437/9335437/interior_dashboard-1774774859394.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001b9a53-6b15-56a3-9f2d-2d3f40807698/001b9a53-6b15-56a3-9f2d-2d3f40807698_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2382596,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5437/9335437/instrument_cluster-1774772326015.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001b9a53-6b15-56a3-9f2d-2d3f40807698/001b9a53-6b15-56a3-9f2d-2d3f40807698_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4474778,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5437/9335437/interior_boot-1774772251671.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001b9a53-6b15-56a3-9f2d-2d3f40807698/001b9a53-6b15-56a3-9f2d-2d3f40807698_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4578242,
'Height': 3461,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5437/9335437/docs_service_history-1774772447627.jpg?ixlib=js-3.8.0&auto=format&s=cf6804c4935b86cf6a9f2af332a49fc3',
'Width': 2598}],
'price': 11913,
'price_includes_vat': False,
'registration_date': '2018-05-15',
'seats_number': None,
'seller_name': None,
'title': 'Audi A1 S Line Black ED NAV TFSI SA',
'transmission': 'automatic',
'trim': 'S Line Black ED NAV TFSI SA',
'vin': 'WAUZZZ8X7JB071539',
'year': 2018}
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279335437%27 HTTP/1.1" 200 None
2026-03-29 20:11:23 [motorway.uk] INFO: Saving data for 9335437: {'created_time': 1774815083.338133, 'last_price_update_time': 1774815083.338145, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='9335437') HTTP/1.1" 204 0
2026-03-29 20:11:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 358863f8-df6e-5358-b55f-de470ad6d423 with identifier: 19289424
2026-03-29 20:11:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 358863f8-df6e-5358-b55f-de470ad6d423 with identifier: 19289424
2026-03-29 20:11:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 358863f8-df6e-5358-b55f-de470ad6d423 with identifier: 19289424 to the API
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/9424/19289424/interior_front_seats-1770221746299.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '358863f8-df6e-5358-b55f-de470ad6d423',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'OE73 CTX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19289424',
'listing': 'auction',
'location': 'Oxfordshire Oxford',
'make': 'Jaguar',
'model': 'XE Series',
'odometer': 24667,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358863f8-df6e-5358-b55f-de470ad6d423/358863f8-df6e-5358-b55f-de470ad6d423_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1449804,
'Height': 2199,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9424/19289424/exterior_front_driver-1770221759380.jpg',
'Width': 2932},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358863f8-df6e-5358-b55f-de470ad6d423/358863f8-df6e-5358-b55f-de470ad6d423_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1050328,
'Height': 2221,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9424/19289424/exterior_rear_driver-1770134430884.jpg',
'Width': 2961},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358863f8-df6e-5358-b55f-de470ad6d423/358863f8-df6e-5358-b55f-de470ad6d423_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1200972,
'Height': 1908,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9424/19289424/exterior_front_passenger-1770134461518.jpg',
'Width': 2544},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358863f8-df6e-5358-b55f-de470ad6d423/358863f8-df6e-5358-b55f-de470ad6d423_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1431264,
'Height': 2174,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9424/19289424/exterior_rear_passenger-1770134412062.jpg',
'Width': 2898},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358863f8-df6e-5358-b55f-de470ad6d423/358863f8-df6e-5358-b55f-de470ad6d423_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6521790,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/9424/19289424/interior_front_seats-1770221746299.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358863f8-df6e-5358-b55f-de470ad6d423/358863f8-df6e-5358-b55f-de470ad6d423_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6171110,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/9424/19289424/interior_rear_seats-1770134898303.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358863f8-df6e-5358-b55f-de470ad6d423/358863f8-df6e-5358-b55f-de470ad6d423_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1083894,
'Height': 4080,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9424/19289424/interior_dashboard-1770134834036.jpg',
'Width': 3060},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358863f8-df6e-5358-b55f-de470ad6d423/358863f8-df6e-5358-b55f-de470ad6d423_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6620467,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/9424/19289424/interior_boot-1770134876937.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358863f8-df6e-5358-b55f-de470ad6d423/358863f8-df6e-5358-b55f-de470ad6d423_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 887771,
'Height': 4080,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/9424/19289424/docs_service_history-1770134949519.jpg?ixlib=js-3.8.0&auto=format&s=143b7f23f5ddad80803805857d7c823e',
'Width': 3060},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358863f8-df6e-5358-b55f-de470ad6d423/358863f8-df6e-5358-b55f-de470ad6d423_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 755089,
'Height': 4080,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/9424/19289424/docs_service_history-1770134968477.jpg?ixlib=js-3.8.0&auto=format&s=faa377dbc32c79561826f88c8e05a72c',
'Width': 3060}],
'price': 19007,
'price_includes_vat': False,
'registration_date': '2023-11-30',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar XE R-DYNAMIC S D MHEV Auto',
'transmission': 'automatic',
'trim': 'XE R-DYNAMIC S D MHEV Auto',
'vin': 'SAJAB4AN5RCP71471',
'year': 2023}
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719289424%27 HTTP/1.1" 200 None
2026-03-29 20:11:23 [motorway.uk] INFO: Saving data for 19289424: {'created_time': 1774815083.750498, 'last_price_update_time': 1774815083.75051, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19289424') HTTP/1.1" 204 0
2026-03-29 20:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0887/20500887/damage_scratches-1774780912361.jpg> (referer: None)
2026-03-29 20:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8894/20488894/exterior_front_passenger-1774705947707.jpg> (referer: None)
2026-03-29 20:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0887/20500887/exterior_rear_passenger-1774779525416.jpg> (referer: None)
2026-03-29 20:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0887/20500887/exterior_front_passenger-1774779550355.jpg> (referer: None)
2026-03-29 20:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0887/20500887/docs_service_history-1774780752640.png?ixlib=js-3.8.0&auto=format&s=603604af18df076dbf64e4ea16188904> (referer: None)
2026-03-29 20:11:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659daf390>
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00195e10-d0ed-55ac-ade3-7a23dc3c02f9/00195e10-d0ed-55ac-ade3-7a23dc3c02f9_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0887%252F20500887%252Fdamage_scratches-1774780912361.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0887/20500887/damage_scratches-1774780912361.jpg saved to cache
2026-03-29 20:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 00195e10-d0ed-55ac-ade3-7a23dc3c02f9
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b3b050>
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dda7e48d-2e8f-5866-b5cf-3bf16a011ee5/dda7e48d-2e8f-5866-b5cf-3bf16a011ee5_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8894%252F20488894%252Fexterior_front_passenger-1774705947707.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8894/20488894/exterior_front_passenger-1774705947707.jpg saved to cache
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dda7e48d-2e8f-5866-b5cf-3bf16a011ee5
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582da910>
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00195e10-d0ed-55ac-ade3-7a23dc3c02f9/00195e10-d0ed-55ac-ade3-7a23dc3c02f9_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0887%252F20500887%252Fexterior_rear_passenger-1774779525416.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0887/20500887/exterior_rear_passenger-1774779525416.jpg saved to cache
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 00195e10-d0ed-55ac-ade3-7a23dc3c02f9
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65befa690>
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00195e10-d0ed-55ac-ade3-7a23dc3c02f9/00195e10-d0ed-55ac-ade3-7a23dc3c02f9_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0887%252F20500887%252Fexterior_front_passenger-1774779550355.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0887/20500887/exterior_front_passenger-1774779550355.jpg saved to cache
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 00195e10-d0ed-55ac-ade3-7a23dc3c02f9
2026-03-29 20:11:24 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-29 20:11:24 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-29 20:11:24 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 54 4
2026-03-29 20:11:24 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 70 9
2026-03-29 20:11:24 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 91 28442
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a48850>
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00195e10-d0ed-55ac-ade3-7a23dc3c02f9/00195e10-d0ed-55ac-ade3-7a23dc3c02f9_image_8.png HTTP/1.1" 201 0
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0887%252F20500887%252Fdocs_service_history-1774780752640.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D603604af18df076dbf64e4ea16188904') HTTP/1.1" 204 0
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0887/20500887/docs_service_history-1774780752640.png?ixlib=js-3.8.0&auto=format&s=603604af18df076dbf64e4ea16188904 saved to cache
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 00195e10-d0ed-55ac-ade3-7a23dc3c02f9
2026-03-29 20:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0887/20500887/interior_boot-1774780648851.jpg> (referer: None)
2026-03-29 20:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8894/20488894/exterior_front_driver-1774705909937.jpg> (referer: None)
2026-03-29 20:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0887/20500887/exterior_front_driver-1774779496468.jpg> (referer: None)
2026-03-29 20:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0887/20500887/exterior_rear_driver-1774779510150.jpg> (referer: None)
2026-03-29 20:11:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8894/20488894/exterior_rear_driver-1774705925895.jpg> (referer: None)
2026-03-29 20:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0887/20500887/interior_dashboard-1774781056774.jpg> (referer: None)
2026-03-29 20:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3303/6813303/exterior_front_passenger-1774620174889.jpg> (referer: None)
2026-03-29 20:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3303/6813303/exterior_rear_passenger-1774620163293.jpg> (referer: None)
2026-03-29 20:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3303/6813303/instrument_cluster-1774620608845.jpg> (referer: None)
2026-03-29 20:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0887/20500887/interior_front_seats-1774779913660.jpg> (referer: None)
2026-03-29 20:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0887/20500887/interior_rear_seats-1774779949457.jpg> (referer: None)
2026-03-29 20:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7330/20457330/interior_boot-1774708518283.jpg> (referer: None)
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a4ad50>
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00195e10-d0ed-55ac-ade3-7a23dc3c02f9/00195e10-d0ed-55ac-ade3-7a23dc3c02f9_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0887%252F20500887%252Finterior_boot-1774780648851.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0887/20500887/interior_boot-1774780648851.jpg saved to cache
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 00195e10-d0ed-55ac-ade3-7a23dc3c02f9
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a49a50>
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dda7e48d-2e8f-5866-b5cf-3bf16a011ee5/dda7e48d-2e8f-5866-b5cf-3bf16a011ee5_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8894%252F20488894%252Fexterior_front_driver-1774705909937.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8894/20488894/exterior_front_driver-1774705909937.jpg saved to cache
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dda7e48d-2e8f-5866-b5cf-3bf16a011ee5
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65843fb10>
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00195e10-d0ed-55ac-ade3-7a23dc3c02f9/00195e10-d0ed-55ac-ade3-7a23dc3c02f9_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0887%252F20500887%252Fexterior_front_driver-1774779496468.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0887/20500887/exterior_front_driver-1774779496468.jpg saved to cache
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00195e10-d0ed-55ac-ade3-7a23dc3c02f9
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ce6a10>
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00195e10-d0ed-55ac-ade3-7a23dc3c02f9/00195e10-d0ed-55ac-ade3-7a23dc3c02f9_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0887%252F20500887%252Fexterior_rear_driver-1774779510150.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0887/20500887/exterior_rear_driver-1774779510150.jpg saved to cache
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 00195e10-d0ed-55ac-ade3-7a23dc3c02f9
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582f3dd0>
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dda7e48d-2e8f-5866-b5cf-3bf16a011ee5/dda7e48d-2e8f-5866-b5cf-3bf16a011ee5_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8894%252F20488894%252Fexterior_rear_driver-1774705925895.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8894/20488894/exterior_rear_driver-1774705925895.jpg saved to cache
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dda7e48d-2e8f-5866-b5cf-3bf16a011ee5
2026-03-29 20:11:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dda7e48d-2e8f-5866-b5cf-3bf16a011ee5, skipping ID generation
2026-03-29 20:11:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dda7e48d-2e8f-5866-b5cf-3bf16a011ee5 with scrape type 1
2026-03-29 20:11:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dda7e48d-2e8f-5866-b5cf-3bf16a011ee5 sending to next pipeline
2026-03-29 20:11:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: dda7e48d-2e8f-5866-b5cf-3bf16a011ee5, identifier: 20488894
2026-03-29 20:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582d9250>
2026-03-29 20:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00195e10-d0ed-55ac-ade3-7a23dc3c02f9/00195e10-d0ed-55ac-ade3-7a23dc3c02f9_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0887%252F20500887%252Finterior_dashboard-1774781056774.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0887/20500887/interior_dashboard-1774781056774.jpg saved to cache
2026-03-29 20:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 00195e10-d0ed-55ac-ade3-7a23dc3c02f9
2026-03-29 20:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a4ab50>
2026-03-29 20:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8be4dd32-0a36-5821-aac8-df81d38bdcad/8be4dd32-0a36-5821-aac8-df81d38bdcad_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3303%252F6813303%252Fexterior_front_passenger-1774620174889.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3303/6813303/exterior_front_passenger-1774620174889.jpg saved to cache
2026-03-29 20:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8be4dd32-0a36-5821-aac8-df81d38bdcad
2026-03-29 20:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65855f9d0>
2026-03-29 20:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8be4dd32-0a36-5821-aac8-df81d38bdcad/8be4dd32-0a36-5821-aac8-df81d38bdcad_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3303%252F6813303%252Fexterior_rear_passenger-1774620163293.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3303/6813303/exterior_rear_passenger-1774620163293.jpg saved to cache
2026-03-29 20:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8be4dd32-0a36-5821-aac8-df81d38bdcad
2026-03-29 20:11:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: dda7e48d-2e8f-5866-b5cf-3bf16a011ee5 with identifier: 20488894
2026-03-29 20:11:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: dda7e48d-2e8f-5866-b5cf-3bf16a011ee5 with identifier: 20488894
2026-03-29 20:11:25 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: dda7e48d-2e8f-5866-b5cf-3bf16a011ee5 with identifier: 20488894 to the API
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8894/20488894/exterior_rear_driver-1774705925895.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'dda7e48d-2e8f-5866-b5cf-3bf16a011ee5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LR73 ENK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20488894',
'listing': 'auction',
'location': 'Merseyside Prescot',
'make': 'Land Rover',
'model': 'Defender',
'odometer': 12500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dda7e48d-2e8f-5866-b5cf-3bf16a011ee5/dda7e48d-2e8f-5866-b5cf-3bf16a011ee5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1060708,
'Height': 2148,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8894/20488894/exterior_front_driver-1774705909937.jpg',
'Width': 2864},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dda7e48d-2e8f-5866-b5cf-3bf16a011ee5/dda7e48d-2e8f-5866-b5cf-3bf16a011ee5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1517411,
'Height': 2437,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8894/20488894/exterior_rear_driver-1774705925895.jpg',
'Width': 3249},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dda7e48d-2e8f-5866-b5cf-3bf16a011ee5/dda7e48d-2e8f-5866-b5cf-3bf16a011ee5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1129206,
'Height': 1914,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8894/20488894/exterior_front_passenger-1774705947707.jpg',
'Width': 2552},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dda7e48d-2e8f-5866-b5cf-3bf16a011ee5/dda7e48d-2e8f-5866-b5cf-3bf16a011ee5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1186088,
'Height': 2391,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8894/20488894/exterior_rear_passenger-1774705938682.jpg',
'Width': 3188},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dda7e48d-2e8f-5866-b5cf-3bf16a011ee5/dda7e48d-2e8f-5866-b5cf-3bf16a011ee5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3857440,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8894/20488894/interior_front_seats-1774716727885.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dda7e48d-2e8f-5866-b5cf-3bf16a011ee5/dda7e48d-2e8f-5866-b5cf-3bf16a011ee5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1386646,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8894/20488894/interior_dashboard-1774716875503.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dda7e48d-2e8f-5866-b5cf-3bf16a011ee5/dda7e48d-2e8f-5866-b5cf-3bf16a011ee5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 822569,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8894/20488894/instrument_cluster-1774716797807.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dda7e48d-2e8f-5866-b5cf-3bf16a011ee5/dda7e48d-2e8f-5866-b5cf-3bf16a011ee5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2868383,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8894/20488894/interior_boot-1774716838716.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dda7e48d-2e8f-5866-b5cf-3bf16a011ee5/dda7e48d-2e8f-5866-b5cf-3bf16a011ee5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 823703,
'Height': 2926,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8894/20488894/docs_service_history-1774717076326.jpg?ixlib=js-3.8.0&auto=format&s=ba0b75f1bb02ae2e7a94f034276d2211',
'Width': 2082},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dda7e48d-2e8f-5866-b5cf-3bf16a011ee5/dda7e48d-2e8f-5866-b5cf-3bf16a011ee5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 662456,
'Height': 2531,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/8894/20488894/docs_service_history-1774790270054.jpg?ixlib=js-3.8.0&auto=format&s=c6cefd9da3333ab5945f47ce323f84bc',
'Width': 1898}],
'price': 54493,
'price_includes_vat': False,
'registration_date': '2023-09-25',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Defender Hard TOP D MHEV Auto',
'transmission': 'automatic',
'trim': 'Hard TOP D MHEV Auto',
'vin': 'SALEACAW2R2254259',
'year': 2023}
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488894%27 HTTP/1.1" 200 None
2026-03-29 20:11:25 [motorway.uk] INFO: Saving data for 20488894: {'created_time': 1774815085.747729, 'last_price_update_time': 1774815085.74774, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20488894') HTTP/1.1" 204 0
2026-03-29 20:11:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65cc72450>
2026-03-29 20:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8be4dd32-0a36-5821-aac8-df81d38bdcad/8be4dd32-0a36-5821-aac8-df81d38bdcad_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3303%252F6813303%252Finstrument_cluster-1774620608845.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3303/6813303/instrument_cluster-1774620608845.jpg saved to cache
2026-03-29 20:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8be4dd32-0a36-5821-aac8-df81d38bdcad
2026-03-29 20:11:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d77090>
2026-03-29 20:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00195e10-d0ed-55ac-ade3-7a23dc3c02f9/00195e10-d0ed-55ac-ade3-7a23dc3c02f9_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0887%252F20500887%252Finterior_front_seats-1774779913660.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0887/20500887/interior_front_seats-1774779913660.jpg saved to cache
2026-03-29 20:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 00195e10-d0ed-55ac-ade3-7a23dc3c02f9
2026-03-29 20:11:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a0ec90>
2026-03-29 20:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00195e10-d0ed-55ac-ade3-7a23dc3c02f9/00195e10-d0ed-55ac-ade3-7a23dc3c02f9_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0887%252F20500887%252Finterior_rear_seats-1774779949457.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0887/20500887/interior_rear_seats-1774779949457.jpg saved to cache
2026-03-29 20:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 00195e10-d0ed-55ac-ade3-7a23dc3c02f9
2026-03-29 20:11:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00195e10-d0ed-55ac-ade3-7a23dc3c02f9, skipping ID generation
2026-03-29 20:11:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00195e10-d0ed-55ac-ade3-7a23dc3c02f9 with scrape type 1
2026-03-29 20:11:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00195e10-d0ed-55ac-ade3-7a23dc3c02f9 sending to next pipeline
2026-03-29 20:11:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 00195e10-d0ed-55ac-ade3-7a23dc3c02f9, identifier: 20500887
2026-03-29 20:11:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ede7d0>
2026-03-29 20:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a8ba427-80c3-5ddf-8db8-2bccde8b1f29/8a8ba427-80c3-5ddf-8db8-2bccde8b1f29_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7330%252F20457330%252Finterior_boot-1774708518283.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7330/20457330/interior_boot-1774708518283.jpg saved to cache
2026-03-29 20:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8a8ba427-80c3-5ddf-8db8-2bccde8b1f29
2026-03-29 20:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=216&page=6&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 00195e10-d0ed-55ac-ade3-7a23dc3c02f9 with identifier: 20500887
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Hybrid HTTP/1.1" 200 None
2026-03-29 20:11:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:11:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 00195e10-d0ed-55ac-ade3-7a23dc3c02f9 with identifier: 20500887
2026-03-29 20:11:26 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 00195e10-d0ed-55ac-ade3-7a23dc3c02f9 with identifier: 20500887 to the API
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/0887/20500887/interior_rear_seats-1774779949457.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '00195e10-d0ed-55ac-ade3-7a23dc3c02f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KE72 EGF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20500887',
'listing': 'auction',
'location': 'Greater London Sidcup',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 11126,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00195e10-d0ed-55ac-ade3-7a23dc3c02f9/00195e10-d0ed-55ac-ade3-7a23dc3c02f9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 955786,
'Height': 2084,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0887/20500887/exterior_front_driver-1774779496468.jpg',
'Width': 2778},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00195e10-d0ed-55ac-ade3-7a23dc3c02f9/00195e10-d0ed-55ac-ade3-7a23dc3c02f9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1040753,
'Height': 2214,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0887/20500887/exterior_rear_driver-1774779510150.jpg',
'Width': 2952},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00195e10-d0ed-55ac-ade3-7a23dc3c02f9/00195e10-d0ed-55ac-ade3-7a23dc3c02f9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1255095,
'Height': 2444,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0887/20500887/exterior_front_passenger-1774779550355.jpg',
'Width': 3258},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00195e10-d0ed-55ac-ade3-7a23dc3c02f9/00195e10-d0ed-55ac-ade3-7a23dc3c02f9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1101407,
'Height': 2200,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0887/20500887/exterior_rear_passenger-1774779525416.jpg',
'Width': 2933},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00195e10-d0ed-55ac-ade3-7a23dc3c02f9/00195e10-d0ed-55ac-ade3-7a23dc3c02f9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3120086,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0887/20500887/interior_front_seats-1774779913660.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00195e10-d0ed-55ac-ade3-7a23dc3c02f9/00195e10-d0ed-55ac-ade3-7a23dc3c02f9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3661883,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0887/20500887/interior_rear_seats-1774779949457.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00195e10-d0ed-55ac-ade3-7a23dc3c02f9/00195e10-d0ed-55ac-ade3-7a23dc3c02f9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2350494,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0887/20500887/interior_dashboard-1774781056774.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00195e10-d0ed-55ac-ade3-7a23dc3c02f9/00195e10-d0ed-55ac-ade3-7a23dc3c02f9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 441833,
'Height': 1739,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0887/20500887/interior_boot-1774780648851.jpg',
'Width': 2318},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00195e10-d0ed-55ac-ade3-7a23dc3c02f9/00195e10-d0ed-55ac-ade3-7a23dc3c02f9_image_8.png',
'Extension': 'png',
'FileSizeInBytes': 28549,
'Height': 224,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0887/20500887/docs_service_history-1774780752640.png?ixlib=js-3.8.0&auto=format&s=603604af18df076dbf64e4ea16188904',
'Width': 817},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00195e10-d0ed-55ac-ade3-7a23dc3c02f9/00195e10-d0ed-55ac-ade3-7a23dc3c02f9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389542,
'Height': 1558,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0887/20500887/damage_scratches-1774780912361.jpg',
'Width': 2077}],
'price': 26087,
'price_includes_vat': False,
'registration_date': '2023-01-26',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Range Rover Evoque ED PHEV A',
'transmission': 'automatic',
'trim': 'Evoque ED PHEV A',
'vin': 'SALZA2AT4PH209514',
'year': 2023}
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720500887%27 HTTP/1.1" 200 None
2026-03-29 20:11:26 [motorway.uk] INFO: Saving data for 20500887: {'created_time': 1774815086.906937, 'last_price_update_time': 1774815086.906948, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20500887') HTTP/1.1" 204 0
2026-03-29 20:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7330/20457330/instrument_cluster-1774708324171.jpg> (referer: None)
2026-03-29 20:11:26 [motorway.uk] INFO: Found listing with ID: 20487615
2026-03-29 20:11:26 [motorway.uk] INFO: Found listing with ID: 20488394
2026-03-29 20:11:26 [motorway.uk] INFO: Found listing with ID: 20464062
2026-03-29 20:11:26 [motorway.uk] INFO: Found listing with ID: 20134898
2026-03-29 20:11:26 [motorway.uk] INFO: Found listing with ID: 19440586
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719440586%27 HTTP/1.1" 200 None
2026-03-29 20:11:26 [motorway.uk] INFO: Scrape type for 19440586: 1
2026-03-29 20:11:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:26 [motorway.uk] INFO: Found listing with ID: 19452010
2026-03-29 20:11:26 [motorway.uk] INFO: Found listing with ID: 10749345
2026-03-29 20:11:26 [motorway.uk] INFO: Found listing with ID: 19842266
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719842266%27 HTTP/1.1" 200 None
2026-03-29 20:11:26 [motorway.uk] INFO: Scrape type for 19842266: 1
2026-03-29 20:11:26 [motorway.uk] INFO: Found listing with ID: 20386031
2026-03-29 20:11:26 [motorway.uk] INFO: Found listing with ID: 20499683
2026-03-29 20:11:26 [motorway.uk] INFO: Found listing with ID: 20118034
2026-03-29 20:11:26 [motorway.uk] INFO: Found listing with ID: 20172802
2026-03-29 20:11:26 [motorway.uk] INFO: Found listing with ID: 20497223
2026-03-29 20:11:26 [motorway.uk] INFO: Found listing with ID: 19286556
2026-03-29 20:11:26 [motorway.uk] INFO: Found listing with ID: 20489789
2026-03-29 20:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720489789%27 HTTP/1.1" 200 None
2026-03-29 20:11:27 [motorway.uk] INFO: Scrape type for 20489789: 1
2026-03-29 20:11:27 [motorway.uk] INFO: Found listing with ID: 12967935
2026-03-29 20:11:27 [motorway.uk] INFO: Found listing with ID: 20254078
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720254078%27 HTTP/1.1" 200 None
2026-03-29 20:11:27 [motorway.uk] INFO: Scrape type for 20254078: 1
2026-03-29 20:11:27 [motorway.uk] INFO: Found listing with ID: 7263451
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277263451%27 HTTP/1.1" 200 None
2026-03-29 20:11:27 [motorway.uk] INFO: Scrape type for 7263451: 1
2026-03-29 20:11:27 [motorway.uk] INFO: Found listing with ID: 18322763
2026-03-29 20:11:27 [motorway.uk] INFO: Found listing with ID: 20406653
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720406653%27 HTTP/1.1" 200 None
2026-03-29 20:11:27 [motorway.uk] INFO: Scrape type for 20406653: 1
2026-03-29 20:11:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e54350>
2026-03-29 20:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a8ba427-80c3-5ddf-8db8-2bccde8b1f29/8a8ba427-80c3-5ddf-8db8-2bccde8b1f29_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7330%252F20457330%252Finstrument_cluster-1774708324171.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7330/20457330/instrument_cluster-1774708324171.jpg saved to cache
2026-03-29 20:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8a8ba427-80c3-5ddf-8db8-2bccde8b1f29
2026-03-29 20:11:27 [motorway.uk] INFO: Found listing with ID: 20490670
2026-03-29 20:11:27 [motorway.uk] INFO: Found listing with ID: 20502991
2026-03-29 20:11:27 [motorway.uk] INFO: Found listing with ID: 20372589
2026-03-29 20:11:27 [motorway.uk] INFO: Found listing with ID: 20158404
2026-03-29 20:11:27 [motorway.uk] INFO: Found listing with ID: 18562849
2026-03-29 20:11:27 [motorway.uk] INFO: Found listing with ID: 20417323
2026-03-29 20:11:27 [motorway.uk] INFO: Found listing with ID: 20485001
2026-03-29 20:11:27 [motorway.uk] INFO: Found listing with ID: 20303214
2026-03-29 20:11:27 [motorway.uk] INFO: Found listing with ID: 20459750
2026-03-29 20:11:27 [motorway.uk] INFO: Found listing with ID: 20491811
2026-03-29 20:11:27 [motorway.uk] INFO: Found listing with ID: 20475595
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720475595%27 HTTP/1.1" 200 None
2026-03-29 20:11:27 [motorway.uk] INFO: Scrape type for 20475595: 1
2026-03-29 20:11:27 [motorway.uk] INFO: Found listing with ID: 20127568
2026-03-29 20:11:27 [motorway.uk] INFO: Found listing with ID: 19344017
2026-03-29 20:11:27 [motorway.uk] INFO: Found listing with ID: 20260509
2026-03-29 20:11:27 [motorway.uk] INFO: Found listing with ID: 20189241
2026-03-29 20:11:27 [motorway.uk] INFO: Found listing with ID: 12732265
2026-03-29 20:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3303/6813303/exterior_front_driver-1774620129419.jpg> (referer: None)
2026-03-29 20:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3303/6813303/exterior_rear_driver-1774620147264.jpg> (referer: None)
2026-03-29 20:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7330/20457330/exterior_front_driver-1774707520891.jpg> (referer: None)
2026-03-29 20:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7330/20457330/interior_dashboard-1774708405406.jpg> (referer: None)
2026-03-29 20:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7330/20457330/interior_rear_seats-1774708315015.jpg> (referer: None)
2026-03-29 20:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7330/20457330/interior_front_seats-1774708297176.jpg> (referer: None)
2026-03-29 20:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a0e710>
2026-03-29 20:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8be4dd32-0a36-5821-aac8-df81d38bdcad/8be4dd32-0a36-5821-aac8-df81d38bdcad_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3303%252F6813303%252Fexterior_front_driver-1774620129419.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3303/6813303/exterior_front_driver-1774620129419.jpg saved to cache
2026-03-29 20:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8be4dd32-0a36-5821-aac8-df81d38bdcad
2026-03-29 20:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a0da90>
2026-03-29 20:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8be4dd32-0a36-5821-aac8-df81d38bdcad/8be4dd32-0a36-5821-aac8-df81d38bdcad_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3303%252F6813303%252Fexterior_rear_driver-1774620147264.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3303/6813303/exterior_rear_driver-1774620147264.jpg saved to cache
2026-03-29 20:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8be4dd32-0a36-5821-aac8-df81d38bdcad
2026-03-29 20:11:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8be4dd32-0a36-5821-aac8-df81d38bdcad, skipping ID generation
2026-03-29 20:11:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8be4dd32-0a36-5821-aac8-df81d38bdcad with scrape type 1
2026-03-29 20:11:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8be4dd32-0a36-5821-aac8-df81d38bdcad sending to next pipeline
2026-03-29 20:11:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8be4dd32-0a36-5821-aac8-df81d38bdcad, identifier: 6813303
2026-03-29 20:11:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8be4dd32-0a36-5821-aac8-df81d38bdcad with identifier: 6813303
2026-03-29 20:11:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8be4dd32-0a36-5821-aac8-df81d38bdcad with identifier: 6813303
2026-03-29 20:11:27 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8be4dd32-0a36-5821-aac8-df81d38bdcad with identifier: 6813303 to the API
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3303/6813303/exterior_rear_driver-1774620147264.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '8be4dd32-0a36-5821-aac8-df81d38bdcad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'RA18 ZFM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/6813303',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Jeep',
'model': 'Grand Cherokee',
'odometer': 83315,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 31,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8be4dd32-0a36-5821-aac8-df81d38bdcad/8be4dd32-0a36-5821-aac8-df81d38bdcad_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1892721,
'Height': 2444,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3303/6813303/exterior_front_driver-1774620129419.jpg',
'Width': 3259},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8be4dd32-0a36-5821-aac8-df81d38bdcad/8be4dd32-0a36-5821-aac8-df81d38bdcad_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1895434,
'Height': 2526,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3303/6813303/exterior_rear_driver-1774620147264.jpg',
'Width': 3368},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8be4dd32-0a36-5821-aac8-df81d38bdcad/8be4dd32-0a36-5821-aac8-df81d38bdcad_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2474436,
'Height': 2621,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3303/6813303/exterior_front_passenger-1774620174889.jpg',
'Width': 3494},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8be4dd32-0a36-5821-aac8-df81d38bdcad/8be4dd32-0a36-5821-aac8-df81d38bdcad_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2583883,
'Height': 2709,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3303/6813303/exterior_rear_passenger-1774620163293.jpg',
'Width': 3612},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8be4dd32-0a36-5821-aac8-df81d38bdcad/8be4dd32-0a36-5821-aac8-df81d38bdcad_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3040385,
'Height': 2957,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3303/6813303/interior_front_seats-1774622916907.jpg',
'Width': 3943},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8be4dd32-0a36-5821-aac8-df81d38bdcad/8be4dd32-0a36-5821-aac8-df81d38bdcad_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3527797,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3303/6813303/interior_rear_seats-1774620686398.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8be4dd32-0a36-5821-aac8-df81d38bdcad/8be4dd32-0a36-5821-aac8-df81d38bdcad_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3664913,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3303/6813303/interior_dashboard-1774620625076.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8be4dd32-0a36-5821-aac8-df81d38bdcad/8be4dd32-0a36-5821-aac8-df81d38bdcad_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2852388,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3303/6813303/instrument_cluster-1774620608845.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8be4dd32-0a36-5821-aac8-df81d38bdcad/8be4dd32-0a36-5821-aac8-df81d38bdcad_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4392039,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3303/6813303/interior_boot-1774620604389.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8be4dd32-0a36-5821-aac8-df81d38bdcad/8be4dd32-0a36-5821-aac8-df81d38bdcad_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 631720,
'Height': 2909,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3303/6813303/docs_service_history-1774621469636.jpg?ixlib=js-3.8.0&auto=format&s=09034fee2969aed76e48ec70f3218139',
'Width': 2071}],
'price': 14552,
'price_includes_vat': False,
'registration_date': '2018-03-31',
'seats_number': None,
'seller_name': None,
'title': 'Jeep Grand Cherokee Nghteagle Mjiia',
'transmission': 'automatic',
'trim': 'Nghteagle Mjiia',
'vin': '1C4RJFFM1HC722668',
'year': 2018}
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%276813303%27 HTTP/1.1" 200 None
2026-03-29 20:11:28 [motorway.uk] INFO: Saving data for 6813303: {'created_time': 1774815088.04375, 'last_price_update_time': 1774815088.043764, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='6813303') HTTP/1.1" 204 0
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e54ad0>
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a8ba427-80c3-5ddf-8db8-2bccde8b1f29/8a8ba427-80c3-5ddf-8db8-2bccde8b1f29_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7330%252F20457330%252Fexterior_front_driver-1774707520891.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7330/20457330/exterior_front_driver-1774707520891.jpg saved to cache
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8a8ba427-80c3-5ddf-8db8-2bccde8b1f29
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a78fd0>
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a8ba427-80c3-5ddf-8db8-2bccde8b1f29/8a8ba427-80c3-5ddf-8db8-2bccde8b1f29_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7330%252F20457330%252Finterior_dashboard-1774708405406.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7330/20457330/interior_dashboard-1774708405406.jpg saved to cache
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8a8ba427-80c3-5ddf-8db8-2bccde8b1f29
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658354c90>
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a8ba427-80c3-5ddf-8db8-2bccde8b1f29/8a8ba427-80c3-5ddf-8db8-2bccde8b1f29_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7330%252F20457330%252Finterior_rear_seats-1774708315015.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7330/20457330/interior_rear_seats-1774708315015.jpg saved to cache
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8a8ba427-80c3-5ddf-8db8-2bccde8b1f29
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584de3d0>
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a8ba427-80c3-5ddf-8db8-2bccde8b1f29/8a8ba427-80c3-5ddf-8db8-2bccde8b1f29_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7330%252F20457330%252Finterior_front_seats-1774708297176.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7330/20457330/interior_front_seats-1774708297176.jpg saved to cache
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8a8ba427-80c3-5ddf-8db8-2bccde8b1f29
2026-03-29 20:11:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19115404.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7330/20457330/exterior_rear_passenger-1774707657702.jpg> (referer: None)
2026-03-29 20:11:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7b926a0-d2d8-594d-ab17-df3cdf4959cd with identifier: 19115404
2026-03-29 20:11:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7b926a0-d2d8-594d-ab17-df3cdf4959cd with scrape type 1
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d7b926a0-d2d8-594d-ab17-df3cdf4959cd
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5404%252F19115404%252Fexterior_front_driver-1774781397991.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5404/19115404/exterior_front_driver-1774781397991.jpg not downloaded yet
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5404%252F19115404%252Fexterior_rear_driver-1774784035203.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5404/19115404/exterior_rear_driver-1774784035203.jpg not downloaded yet
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5404%252F19115404%252Fexterior_front_passenger-1774781435401.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5404/19115404/exterior_front_passenger-1774781435401.jpg not downloaded yet
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658356350>
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a8ba427-80c3-5ddf-8db8-2bccde8b1f29/8a8ba427-80c3-5ddf-8db8-2bccde8b1f29_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7330%252F20457330%252Fexterior_rear_passenger-1774707657702.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7330/20457330/exterior_rear_passenger-1774707657702.jpg saved to cache
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8a8ba427-80c3-5ddf-8db8-2bccde8b1f29
2026-03-29 20:11:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8a8ba427-80c3-5ddf-8db8-2bccde8b1f29, skipping ID generation
2026-03-29 20:11:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a8ba427-80c3-5ddf-8db8-2bccde8b1f29 with scrape type 1
2026-03-29 20:11:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8a8ba427-80c3-5ddf-8db8-2bccde8b1f29 sending to next pipeline
2026-03-29 20:11:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8a8ba427-80c3-5ddf-8db8-2bccde8b1f29, identifier: 20457330
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5404%252F19115404%252Fexterior_rear_passenger-1774781424101.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5404/19115404/exterior_rear_passenger-1774781424101.jpg not downloaded yet
2026-03-29 20:11:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8a8ba427-80c3-5ddf-8db8-2bccde8b1f29 with identifier: 20457330
2026-03-29 20:11:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8a8ba427-80c3-5ddf-8db8-2bccde8b1f29 with identifier: 20457330
2026-03-29 20:11:29 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8a8ba427-80c3-5ddf-8db8-2bccde8b1f29 with identifier: 20457330 to the API
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7330/20457330/exterior_rear_passenger-1774707657702.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '8a8ba427-80c3-5ddf-8db8-2bccde8b1f29',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CR02 TRY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20457330',
'listing': 'auction',
'location': 'Dorset Weymouth',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 30061,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a8ba427-80c3-5ddf-8db8-2bccde8b1f29/8a8ba427-80c3-5ddf-8db8-2bccde8b1f29_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1286582,
'Height': 2423,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7330/20457330/exterior_front_driver-1774707520891.jpg',
'Width': 3231},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a8ba427-80c3-5ddf-8db8-2bccde8b1f29/8a8ba427-80c3-5ddf-8db8-2bccde8b1f29_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1695794,
'Height': 2684,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7330/20457330/exterior_rear_driver-1774707569145.jpg',
'Width': 3579},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a8ba427-80c3-5ddf-8db8-2bccde8b1f29/8a8ba427-80c3-5ddf-8db8-2bccde8b1f29_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1759599,
'Height': 2813,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7330/20457330/exterior_front_passenger-1774707695743.jpg',
'Width': 3750},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a8ba427-80c3-5ddf-8db8-2bccde8b1f29/8a8ba427-80c3-5ddf-8db8-2bccde8b1f29_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1451202,
'Height': 2389,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7330/20457330/exterior_rear_passenger-1774707657702.jpg',
'Width': 3185},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a8ba427-80c3-5ddf-8db8-2bccde8b1f29/8a8ba427-80c3-5ddf-8db8-2bccde8b1f29_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2995160,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7330/20457330/interior_front_seats-1774708297176.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a8ba427-80c3-5ddf-8db8-2bccde8b1f29/8a8ba427-80c3-5ddf-8db8-2bccde8b1f29_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2867112,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7330/20457330/interior_rear_seats-1774708315015.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a8ba427-80c3-5ddf-8db8-2bccde8b1f29/8a8ba427-80c3-5ddf-8db8-2bccde8b1f29_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2723797,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7330/20457330/interior_dashboard-1774708405406.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a8ba427-80c3-5ddf-8db8-2bccde8b1f29/8a8ba427-80c3-5ddf-8db8-2bccde8b1f29_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2439571,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7330/20457330/instrument_cluster-1774708324171.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a8ba427-80c3-5ddf-8db8-2bccde8b1f29/8a8ba427-80c3-5ddf-8db8-2bccde8b1f29_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4286163,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7330/20457330/interior_boot-1774708518283.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a8ba427-80c3-5ddf-8db8-2bccde8b1f29/8a8ba427-80c3-5ddf-8db8-2bccde8b1f29_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92405,
'Height': 1263,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7330/20457330/docs_service_history-1774771173186-1.jpeg?ixlib=js-3.8.0&auto=format&s=f6b674a368bd428ba352e040958734b8',
'Width': 892}],
'price': 20205,
'price_includes_vat': False,
'registration_date': '2020-11-09',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Rrover Evoque Rdyn HSE P300E A',
'transmission': 'automatic',
'trim': 'Rrover Evoque Rdyn HSE P300E A',
'vin': 'SALZA2AT7LH113371',
'year': 2020}
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720457330%27 HTTP/1.1" 200 None
2026-03-29 20:11:29 [motorway.uk] INFO: Saving data for 20457330: {'created_time': 1774815089.49779, 'last_price_update_time': 1774815089.497805, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20457330') HTTP/1.1" 204 0
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5404%252F19115404%252Finterior_front_seats-1774781572311.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5404/19115404/interior_front_seats-1774781572311.jpg not downloaded yet
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5404%252F19115404%252Finterior_rear_seats-1774781621781.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5404/19115404/interior_rear_seats-1774781621781.jpg not downloaded yet
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5404%252F19115404%252Finterior_dashboard-1774781610487.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5404/19115404/interior_dashboard-1774781610487.jpg not downloaded yet
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5404%252F19115404%252Finstrument_cluster-1774781686315.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5404/19115404/instrument_cluster-1774781686315.jpg not downloaded yet
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5404%252F19115404%252Finterior_boot-1774781602165.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5404/19115404/interior_boot-1774781602165.jpg not downloaded yet
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5404%252F19115404%252Fdocs_service_history-1774785604855.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D431b8d37cba673aa3531a1a32a2a355f%27 HTTP/1.1" 200 None
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5404/19115404/docs_service_history-1774785604855.jpg?ixlib=js-3.8.0&auto=format&s=431b8d37cba673aa3531a1a32a2a355f not downloaded yet
2026-03-29 20:11:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20445222.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76711b8f-a805-5b8d-b9f7-930302629b4f with identifier: 20445222
2026-03-29 20:11:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76711b8f-a805-5b8d-b9f7-930302629b4f with scrape type 1
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 76711b8f-a805-5b8d-b9f7-930302629b4f
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5222%252F20445222%252Fexterior_front_driver-1774708823653.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5222/20445222/exterior_front_driver-1774708823653.jpg not downloaded yet
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5222%252F20445222%252Fexterior_rear_driver-1774708838817.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5222/20445222/exterior_rear_driver-1774708838817.jpg not downloaded yet
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5222%252F20445222%252Fexterior_front_passenger-1774708883385.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5222/20445222/exterior_front_passenger-1774708883385.jpg not downloaded yet
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5222%252F20445222%252Fexterior_rear_passenger-1774708867303.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5222/20445222/exterior_rear_passenger-1774708867303.jpg not downloaded yet
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5222%252F20445222%252Finterior_front_seats-1774709433164.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5222/20445222/interior_front_seats-1774709433164.jpg not downloaded yet
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5222%252F20445222%252Finterior_rear_seats-1774710284759.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5222/20445222/interior_rear_seats-1774710284759.jpg not downloaded yet
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5222%252F20445222%252Finterior_dashboard-1774712087105.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5222/20445222/interior_dashboard-1774712087105.jpg not downloaded yet
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5222%252F20445222%252Finstrument_cluster-1774710545899.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5222/20445222/instrument_cluster-1774710545899.jpg not downloaded yet
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5222%252F20445222%252Finterior_boot-1774710336769.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5222/20445222/interior_boot-1774710336769.jpg not downloaded yet
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5222%252F20445222%252Fdocs_service_history-1774711518444.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcfc03ae96d358d774dc6ed6454ff7ea8%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5222/20445222/docs_service_history-1774711518444.jpg?ixlib=js-3.8.0&auto=format&s=cfc03ae96d358d774dc6ed6454ff7ea8 not downloaded yet
2026-03-29 20:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5404/19115404/docs_service_history-1774785604855.jpg?ixlib=js-3.8.0&auto=format&s=431b8d37cba673aa3531a1a32a2a355f> (referer: None)
2026-03-29 20:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19439933.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf51890>
2026-03-29 20:11:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7b926a0-d2d8-594d-ab17-df3cdf4959cd/d7b926a0-d2d8-594d-ab17-df3cdf4959cd_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5404%252F19115404%252Fdocs_service_history-1774785604855.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D431b8d37cba673aa3531a1a32a2a355f') HTTP/1.1" 204 0
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5404/19115404/docs_service_history-1774785604855.jpg?ixlib=js-3.8.0&auto=format&s=431b8d37cba673aa3531a1a32a2a355f saved to cache
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d7b926a0-d2d8-594d-ab17-df3cdf4959cd
2026-03-29 20:11:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 638c1877-1923-56ce-9b59-81661e7ea35a with identifier: 19439933
2026-03-29 20:11:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 638c1877-1923-56ce-9b59-81661e7ea35a with scrape type 1
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 638c1877-1923-56ce-9b59-81661e7ea35a
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9933%252F19439933%252Fexterior_front_driver-1774691300361.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9933/19439933/exterior_front_driver-1774691300361.jpg not downloaded yet
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9933%252F19439933%252Fexterior_rear_driver-1774691311036.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9933/19439933/exterior_rear_driver-1774691311036.jpg not downloaded yet
2026-03-29 20:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/5937182.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9933%252F19439933%252Fexterior_front_passenger-1774691337401.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9933/19439933/exterior_front_passenger-1774691337401.jpg not downloaded yet
2026-03-29 20:11:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9933%252F19439933%252Fexterior_rear_passenger-1774691314998.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9933/19439933/exterior_rear_passenger-1774691314998.jpg not downloaded yet
2026-03-29 20:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5222/20445222/docs_service_history-1774711518444.jpg?ixlib=js-3.8.0&auto=format&s=cfc03ae96d358d774dc6ed6454ff7ea8> (referer: None)
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9933%252F19439933%252Finterior_front_seats-1774699405878.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9933/19439933/interior_front_seats-1774699405878.jpg not downloaded yet
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9933%252F19439933%252Finterior_rear_seats-1774691771920.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9933/19439933/interior_rear_seats-1774691771920.jpg not downloaded yet
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9933%252F19439933%252Finterior_dashboard-1774699421932.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9933/19439933/interior_dashboard-1774699421932.jpg not downloaded yet
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9933%252F19439933%252Finstrument_cluster-1774699435929.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9933/19439933/instrument_cluster-1774699435929.jpg not downloaded yet
2026-03-29 20:11:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da644c01-f115-5087-9827-1beec3915bcc with identifier: 5937182
2026-03-29 20:11:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da644c01-f115-5087-9827-1beec3915bcc with scrape type 1
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item da644c01-f115-5087-9827-1beec3915bcc
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7182%252F5937182%252Fexterior_front_driver-1774703059713.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7182/5937182/exterior_front_driver-1774703059713.jpg not downloaded yet
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9933%252F19439933%252Finterior_boot-1774692119349.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9933/19439933/interior_boot-1774692119349.jpg not downloaded yet
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7182%252F5937182%252Fexterior_rear_driver-1774703065084.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7182/5937182/exterior_rear_driver-1774703065084.jpg not downloaded yet
2026-03-29 20:11:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf51b50>
2026-03-29 20:11:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76711b8f-a805-5b8d-b9f7-930302629b4f/76711b8f-a805-5b8d-b9f7-930302629b4f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5222%252F20445222%252Fdocs_service_history-1774711518444.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcfc03ae96d358d774dc6ed6454ff7ea8') HTTP/1.1" 204 0
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5222/20445222/docs_service_history-1774711518444.jpg?ixlib=js-3.8.0&auto=format&s=cfc03ae96d358d774dc6ed6454ff7ea8 saved to cache
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 76711b8f-a805-5b8d-b9f7-930302629b4f
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9933%252F19439933%252Fwheels_front_driver-1774691385202.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9933/19439933/wheels_front_driver-1774691385202.jpg not downloaded yet
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7182%252F5937182%252Fexterior_front_passenger-1774703050670.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7182/5937182/exterior_front_passenger-1774703050670.jpg not downloaded yet
2026-03-29 20:11:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20446195.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7182%252F5937182%252Fexterior_rear_passenger-1774704881801.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7182/5937182/exterior_rear_passenger-1774704881801.jpg not downloaded yet
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7182%252F5937182%252Finterior_front_seats-1774704036219.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7182/5937182/interior_front_seats-1774704036219.jpg not downloaded yet
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7182%252F5937182%252Finterior_rear_seats-1774703829004.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7182/5937182/interior_rear_seats-1774703829004.jpg not downloaded yet
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7182%252F5937182%252Finterior_dashboard-1774703872065.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7182/5937182/interior_dashboard-1774703872065.jpg not downloaded yet
2026-03-29 20:11:30 [motorway.uk] ERROR: Error parsing details
Traceback (most recent call last):
File "/usr/src/app/crawlers/spiders/motorway.py", line 262, in parse_details
item = self._extract_listing_item(detail_data, auction_type)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/motorway.py", line 290, in _extract_listing_item
trim = self._extract_trim(detail_data)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/motorway.py", line 476, in _extract_trim
.replace(model, "")
^^^^^^^^^^^^^^^^^^
TypeError: replace() argument 1 must be str, not None
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7182%252F5937182%252Finstrument_cluster-1774704509886.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7182/5937182/instrument_cluster-1774704509886.jpg not downloaded yet
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7182%252F5937182%252Finterior_boot-1774705625021.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7182/5937182/interior_boot-1774705625021.jpg not downloaded yet
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7182%252F5937182%252Fdocs_service_history-1774703892019.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd45d4d5660ef3f2ff5f560b82a30b2b9%27 HTTP/1.1" 200 None
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7182/5937182/docs_service_history-1774703892019.jpg?ixlib=js-3.8.0&auto=format&s=d45d4d5660ef3f2ff5f560b82a30b2b9 not downloaded yet
2026-03-29 20:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5222/20445222/interior_boot-1774710336769.jpg> (referer: None)
2026-03-29 20:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9933/19439933/exterior_rear_passenger-1774691314998.jpg> (referer: None)
2026-03-29 20:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9933/19439933/exterior_rear_driver-1774691311036.jpg> (referer: None)
2026-03-29 20:11:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a83c90>
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76711b8f-a805-5b8d-b9f7-930302629b4f/76711b8f-a805-5b8d-b9f7-930302629b4f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5222%252F20445222%252Finterior_boot-1774710336769.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5222/20445222/interior_boot-1774710336769.jpg saved to cache
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 76711b8f-a805-5b8d-b9f7-930302629b4f
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bdaed0>
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_638c1877-1923-56ce-9b59-81661e7ea35a/638c1877-1923-56ce-9b59-81661e7ea35a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9933%252F19439933%252Fexterior_rear_passenger-1774691314998.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9933/19439933/exterior_rear_passenger-1774691314998.jpg saved to cache
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 638c1877-1923-56ce-9b59-81661e7ea35a
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65841ef50>
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_638c1877-1923-56ce-9b59-81661e7ea35a/638c1877-1923-56ce-9b59-81661e7ea35a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9933%252F19439933%252Fexterior_rear_driver-1774691311036.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9933/19439933/exterior_rear_driver-1774691311036.jpg saved to cache
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 638c1877-1923-56ce-9b59-81661e7ea35a
2026-03-29 20:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7182/5937182/docs_service_history-1774703892019.jpg?ixlib=js-3.8.0&auto=format&s=d45d4d5660ef3f2ff5f560b82a30b2b9> (referer: None)
2026-03-29 20:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9933/19439933/wheels_front_driver-1774691385202.jpg> (referer: None)
2026-03-29 20:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7182/5937182/instrument_cluster-1774704509886.jpg> (referer: None)
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cd7990>
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da644c01-f115-5087-9827-1beec3915bcc/da644c01-f115-5087-9827-1beec3915bcc_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7182%252F5937182%252Fdocs_service_history-1774703892019.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd45d4d5660ef3f2ff5f560b82a30b2b9') HTTP/1.1" 204 0
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7182/5937182/docs_service_history-1774703892019.jpg?ixlib=js-3.8.0&auto=format&s=d45d4d5660ef3f2ff5f560b82a30b2b9 saved to cache
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item da644c01-f115-5087-9827-1beec3915bcc
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e3f1d0>
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_638c1877-1923-56ce-9b59-81661e7ea35a/638c1877-1923-56ce-9b59-81661e7ea35a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9933%252F19439933%252Fwheels_front_driver-1774691385202.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9933/19439933/wheels_front_driver-1774691385202.jpg saved to cache
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 638c1877-1923-56ce-9b59-81661e7ea35a
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e3d1d0>
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da644c01-f115-5087-9827-1beec3915bcc/da644c01-f115-5087-9827-1beec3915bcc_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7182%252F5937182%252Finstrument_cluster-1774704509886.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7182/5937182/instrument_cluster-1774704509886.jpg saved to cache
2026-03-29 20:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item da644c01-f115-5087-9827-1beec3915bcc
2026-03-29 20:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7182/5937182/interior_dashboard-1774703872065.jpg> (referer: None)
2026-03-29 20:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7182/5937182/interior_rear_seats-1774703829004.jpg> (referer: None)
2026-03-29 20:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7182/5937182/interior_front_seats-1774704036219.jpg> (referer: None)
2026-03-29 20:11:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7182/5937182/interior_boot-1774705625021.jpg> (referer: None)
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658302d50>
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da644c01-f115-5087-9827-1beec3915bcc/da644c01-f115-5087-9827-1beec3915bcc_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7182%252F5937182%252Finterior_dashboard-1774703872065.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7182/5937182/interior_dashboard-1774703872065.jpg saved to cache
2026-03-29 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item da644c01-f115-5087-9827-1beec3915bcc
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659abeb10>
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da644c01-f115-5087-9827-1beec3915bcc/da644c01-f115-5087-9827-1beec3915bcc_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7182%252F5937182%252Finterior_rear_seats-1774703829004.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7182/5937182/interior_rear_seats-1774703829004.jpg saved to cache
2026-03-29 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item da644c01-f115-5087-9827-1beec3915bcc
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ac3650>
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da644c01-f115-5087-9827-1beec3915bcc/da644c01-f115-5087-9827-1beec3915bcc_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7182%252F5937182%252Finterior_front_seats-1774704036219.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7182/5937182/interior_front_seats-1774704036219.jpg saved to cache
2026-03-29 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item da644c01-f115-5087-9827-1beec3915bcc
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658301990>
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da644c01-f115-5087-9827-1beec3915bcc/da644c01-f115-5087-9827-1beec3915bcc_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7182%252F5937182%252Finterior_boot-1774705625021.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7182/5937182/interior_boot-1774705625021.jpg saved to cache
2026-03-29 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item da644c01-f115-5087-9827-1beec3915bcc
2026-03-29 20:11:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7182/5937182/exterior_front_passenger-1774703050670.jpg> (referer: None)
2026-03-29 20:11:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7182/5937182/exterior_rear_passenger-1774704881801.jpg> (referer: None)
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a22b50>
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da644c01-f115-5087-9827-1beec3915bcc/da644c01-f115-5087-9827-1beec3915bcc_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7182%252F5937182%252Fexterior_front_passenger-1774703050670.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7182/5937182/exterior_front_passenger-1774703050670.jpg saved to cache
2026-03-29 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item da644c01-f115-5087-9827-1beec3915bcc
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659abdfd0>
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da644c01-f115-5087-9827-1beec3915bcc/da644c01-f115-5087-9827-1beec3915bcc_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7182%252F5937182%252Fexterior_rear_passenger-1774704881801.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7182/5937182/exterior_rear_passenger-1774704881801.jpg saved to cache
2026-03-29 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item da644c01-f115-5087-9827-1beec3915bcc
2026-03-29 20:11:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7182/5937182/exterior_rear_driver-1774703065084.jpg> (referer: None)
2026-03-29 20:11:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20475595.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7182/5937182/exterior_front_driver-1774703059713.jpg> (referer: None)
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fbce10>
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da644c01-f115-5087-9827-1beec3915bcc/da644c01-f115-5087-9827-1beec3915bcc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7182%252F5937182%252Fexterior_rear_driver-1774703065084.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7182/5937182/exterior_rear_driver-1774703065084.jpg saved to cache
2026-03-29 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item da644c01-f115-5087-9827-1beec3915bcc
2026-03-29 20:11:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a91851d-c8c8-5681-a9de-54cb820b5a7c with identifier: 20475595
2026-03-29 20:11:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a91851d-c8c8-5681-a9de-54cb820b5a7c with scrape type 1
2026-03-29 20:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8a91851d-c8c8-5681-a9de-54cb820b5a7c
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5595%252F20475595%252Fexterior_front_driver-1774705631705.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5595/20475595/exterior_front_driver-1774705631705.jpg not downloaded yet
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5595%252F20475595%252Fexterior_rear_driver-1774705888251.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5595/20475595/exterior_rear_driver-1774705888251.jpg not downloaded yet
2026-03-29 20:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659993550>
2026-03-29 20:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da644c01-f115-5087-9827-1beec3915bcc/da644c01-f115-5087-9827-1beec3915bcc_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7182%252F5937182%252Fexterior_front_driver-1774703059713.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7182/5937182/exterior_front_driver-1774703059713.jpg saved to cache
2026-03-29 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da644c01-f115-5087-9827-1beec3915bcc
2026-03-29 20:11:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da644c01-f115-5087-9827-1beec3915bcc, skipping ID generation
2026-03-29 20:11:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da644c01-f115-5087-9827-1beec3915bcc with scrape type 1
2026-03-29 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da644c01-f115-5087-9827-1beec3915bcc sending to next pipeline
2026-03-29 20:11:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: da644c01-f115-5087-9827-1beec3915bcc, identifier: 5937182
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5595%252F20475595%252Fexterior_front_passenger-1774706005995.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5595/20475595/exterior_front_passenger-1774706005995.jpg not downloaded yet
2026-03-29 20:11:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: da644c01-f115-5087-9827-1beec3915bcc with identifier: 5937182
2026-03-29 20:11:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: da644c01-f115-5087-9827-1beec3915bcc with identifier: 5937182
2026-03-29 20:11:33 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: da644c01-f115-5087-9827-1beec3915bcc with identifier: 5937182 to the API
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7182/5937182/exterior_front_driver-1774703059713.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'da644c01-f115-5087-9827-1beec3915bcc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'OV18 HSD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/5937182',
'listing': 'auction',
'location': 'Oxfordshire Kidlington',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 53000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da644c01-f115-5087-9827-1beec3915bcc/da644c01-f115-5087-9827-1beec3915bcc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1618905,
'Height': 2483,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7182/5937182/exterior_front_driver-1774703059713.jpg',
'Width': 3310},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da644c01-f115-5087-9827-1beec3915bcc/da644c01-f115-5087-9827-1beec3915bcc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1303587,
'Height': 2282,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7182/5937182/exterior_rear_driver-1774703065084.jpg',
'Width': 3043},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da644c01-f115-5087-9827-1beec3915bcc/da644c01-f115-5087-9827-1beec3915bcc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1435268,
'Height': 2476,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7182/5937182/exterior_front_passenger-1774703050670.jpg',
'Width': 3301},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da644c01-f115-5087-9827-1beec3915bcc/da644c01-f115-5087-9827-1beec3915bcc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1423688,
'Height': 2465,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7182/5937182/exterior_rear_passenger-1774704881801.jpg',
'Width': 3287},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da644c01-f115-5087-9827-1beec3915bcc/da644c01-f115-5087-9827-1beec3915bcc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2621859,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7182/5937182/interior_front_seats-1774704036219.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da644c01-f115-5087-9827-1beec3915bcc/da644c01-f115-5087-9827-1beec3915bcc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1951875,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7182/5937182/interior_rear_seats-1774703829004.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da644c01-f115-5087-9827-1beec3915bcc/da644c01-f115-5087-9827-1beec3915bcc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2262672,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7182/5937182/interior_dashboard-1774703872065.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da644c01-f115-5087-9827-1beec3915bcc/da644c01-f115-5087-9827-1beec3915bcc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368931,
'Height': 1857,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7182/5937182/instrument_cluster-1774704509886.jpg',
'Width': 2476},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da644c01-f115-5087-9827-1beec3915bcc/da644c01-f115-5087-9827-1beec3915bcc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1639168,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7182/5937182/interior_boot-1774705625021.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da644c01-f115-5087-9827-1beec3915bcc/da644c01-f115-5087-9827-1beec3915bcc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1146252,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7182/5937182/docs_service_history-1774703892019.jpg?ixlib=js-3.8.0&auto=format&s=d45d4d5660ef3f2ff5f560b82a30b2b9',
'Width': 2880}],
'price': 3133,
'price_includes_vat': False,
'registration_date': '2018-05-08',
'seats_number': None,
'seller_name': None,
'title': 'Dacia Sandero Ambiance SCE',
'transmission': 'manual',
'trim': 'Ambiance SCE',
'vin': 'UU15SDMC560239859',
'year': 2018}
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%275937182%27 HTTP/1.1" 200 None
2026-03-29 20:11:33 [motorway.uk] INFO: Saving data for 5937182: {'created_time': 1774815093.768103, 'last_price_update_time': 1774815093.768118, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='5937182') HTTP/1.1" 204 0
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5595%252F20475595%252Fexterior_rear_passenger-1774705915980.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5595/20475595/exterior_rear_passenger-1774705915980.jpg not downloaded yet
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5595%252F20475595%252Finterior_front_seats-1774706463895.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5595/20475595/interior_front_seats-1774706463895.jpg not downloaded yet
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5595%252F20475595%252Finterior_rear_seats-1774706487090.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5595/20475595/interior_rear_seats-1774706487090.jpg not downloaded yet
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5595%252F20475595%252Finterior_dashboard-1774706533202.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5595/20475595/interior_dashboard-1774706533202.jpg not downloaded yet
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5595%252F20475595%252Finstrument_cluster-1774706552467.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5595/20475595/instrument_cluster-1774706552467.jpg not downloaded yet
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5595%252F20475595%252Finterior_boot-1774706553598.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5595/20475595/interior_boot-1774706553598.jpg not downloaded yet
2026-03-29 20:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9933/19439933/instrument_cluster-1774699435929.jpg> (referer: None)
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5595%252F20475595%252Fdocs_service_history-1774707053371.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D70e1b438c677f039a72cebb273c014e1%27 HTTP/1.1" 200 None
2026-03-29 20:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5595/20475595/docs_service_history-1774707053371.jpg?ixlib=js-3.8.0&auto=format&s=70e1b438c677f039a72cebb273c014e1 not downloaded yet
2026-03-29 20:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9933/19439933/interior_boot-1774692119349.jpg> (referer: None)
2026-03-29 20:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9933/19439933/interior_dashboard-1774699421932.jpg> (referer: None)
2026-03-29 20:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9933/19439933/interior_front_seats-1774699405878.jpg> (referer: None)
2026-03-29 20:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9933/19439933/interior_rear_seats-1774691771920.jpg> (referer: None)
2026-03-29 20:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20406653.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20493712.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584d72d0>
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_638c1877-1923-56ce-9b59-81661e7ea35a/638c1877-1923-56ce-9b59-81661e7ea35a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9933%252F19439933%252Finstrument_cluster-1774699435929.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9933/19439933/instrument_cluster-1774699435929.jpg saved to cache
2026-03-29 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 638c1877-1923-56ce-9b59-81661e7ea35a
2026-03-29 20:11:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584d56d0>
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_638c1877-1923-56ce-9b59-81661e7ea35a/638c1877-1923-56ce-9b59-81661e7ea35a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9933%252F19439933%252Finterior_boot-1774692119349.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9933/19439933/interior_boot-1774692119349.jpg saved to cache
2026-03-29 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 638c1877-1923-56ce-9b59-81661e7ea35a
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cfc990>
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_638c1877-1923-56ce-9b59-81661e7ea35a/638c1877-1923-56ce-9b59-81661e7ea35a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9933%252F19439933%252Finterior_dashboard-1774699421932.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9933/19439933/interior_dashboard-1774699421932.jpg saved to cache
2026-03-29 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 638c1877-1923-56ce-9b59-81661e7ea35a
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658445a90>
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_638c1877-1923-56ce-9b59-81661e7ea35a/638c1877-1923-56ce-9b59-81661e7ea35a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9933%252F19439933%252Finterior_front_seats-1774699405878.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9933/19439933/interior_front_seats-1774699405878.jpg saved to cache
2026-03-29 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 638c1877-1923-56ce-9b59-81661e7ea35a
2026-03-29 20:11:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cfe9d0>
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_638c1877-1923-56ce-9b59-81661e7ea35a/638c1877-1923-56ce-9b59-81661e7ea35a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9933%252F19439933%252Finterior_rear_seats-1774691771920.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9933/19439933/interior_rear_seats-1774691771920.jpg saved to cache
2026-03-29 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 638c1877-1923-56ce-9b59-81661e7ea35a
2026-03-29 20:11:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b32c733-0254-5a36-91b0-9956f3b111dc with identifier: 20406653
2026-03-29 20:11:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b32c733-0254-5a36-91b0-9956f3b111dc with scrape type 1
2026-03-29 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5b32c733-0254-5a36-91b0-9956f3b111dc
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6653%252F20406653%252Fexterior_front_driver-1774697593191.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6653/20406653/exterior_front_driver-1774697593191.jpg not downloaded yet
2026-03-29 20:11:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e31cb8c-b819-5889-afd6-bc69ea59e649 with identifier: 20493712
2026-03-29 20:11:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e31cb8c-b819-5889-afd6-bc69ea59e649 with scrape type 1
2026-03-29 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4e31cb8c-b819-5889-afd6-bc69ea59e649
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3712%252F20493712%252Fexterior_front_driver-1774778332922.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3712/20493712/exterior_front_driver-1774778332922.jpg not downloaded yet
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6653%252F20406653%252Fexterior_rear_driver-1774697589442.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6653/20406653/exterior_rear_driver-1774697589442.jpg not downloaded yet
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3712%252F20493712%252Fexterior_rear_driver-1774778349138.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3712/20493712/exterior_rear_driver-1774778349138.jpg not downloaded yet
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6653%252F20406653%252Fexterior_front_passenger-1774697596482.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6653/20406653/exterior_front_passenger-1774697596482.jpg not downloaded yet
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3712%252F20493712%252Fexterior_front_passenger-1774779592621.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3712/20493712/exterior_front_passenger-1774779592621.jpg not downloaded yet
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6653%252F20406653%252Fexterior_rear_passenger-1774697615461.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6653/20406653/exterior_rear_passenger-1774697615461.jpg not downloaded yet
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3712%252F20493712%252Fexterior_rear_passenger-1774720684106.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3712/20493712/exterior_rear_passenger-1774720684106.jpg not downloaded yet
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6653%252F20406653%252Finterior_front_seats-1774698524066.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6653/20406653/interior_front_seats-1774698524066.jpg not downloaded yet
2026-03-29 20:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3712%252F20493712%252Finterior_front_seats-1774778396048.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3712/20493712/interior_front_seats-1774778396048.jpg not downloaded yet
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6653%252F20406653%252Finterior_rear_seats-1774698210152.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6653/20406653/interior_rear_seats-1774698210152.jpg not downloaded yet
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3712%252F20493712%252Finterior_rear_seats-1774778862055.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3712/20493712/interior_rear_seats-1774778862055.jpg not downloaded yet
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6653%252F20406653%252Finterior_dashboard-1774705306055.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6653/20406653/interior_dashboard-1774705306055.jpg not downloaded yet
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3712%252F20493712%252Finterior_dashboard-1774778878540.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3712/20493712/interior_dashboard-1774778878540.jpg not downloaded yet
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6653%252F20406653%252Finterior_boot-1774698147271.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6653/20406653/interior_boot-1774698147271.jpg not downloaded yet
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3712%252F20493712%252Finterior_boot-1774778459253.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3712/20493712/interior_boot-1774778459253.jpg not downloaded yet
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6653%252F20406653%252Fdocs_service_history-1774698368810.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1f5e8ac4252f95b699619b3eef866665%27 HTTP/1.1" 200 None
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6653/20406653/docs_service_history-1774698368810.jpg?ixlib=js-3.8.0&auto=format&s=1f5e8ac4252f95b699619b3eef866665 not downloaded yet
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3712%252F20493712%252Fdocs_service_history-1774721097254.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D135d2e1733e99783674d512e7e5a37df%27 HTTP/1.1" 200 None
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3712/20493712/docs_service_history-1774721097254.jpg?ixlib=js-3.8.0&auto=format&s=135d2e1733e99783674d512e7e5a37df not downloaded yet
2026-03-29 20:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3712/20493712/exterior_front_driver-1774778332922.jpg> (referer: None)
2026-03-29 20:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/7263451.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6653%252F20406653%252Fdocs_service_history-1774698390118.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9f4f51bfa437df58af807d5268d83eb9%27 HTTP/1.1" 200 None
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6653/20406653/docs_service_history-1774698390118.jpg?ixlib=js-3.8.0&auto=format&s=9f4f51bfa437df58af807d5268d83eb9 not downloaded yet
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3712%252F20493712%252Fdocs_service_history-1774721132026.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De6a1614f78e213454053c7d9be84a956%27 HTTP/1.1" 200 None
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3712/20493712/docs_service_history-1774721132026.jpg?ixlib=js-3.8.0&auto=format&s=e6a1614f78e213454053c7d9be84a956 not downloaded yet
2026-03-29 20:11:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6653/20406653/exterior_front_driver-1774697593191.jpg> (referer: None)
2026-03-29 20:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5595/20475595/instrument_cluster-1774706552467.jpg> (referer: None)
2026-03-29 20:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5595/20475595/interior_dashboard-1774706533202.jpg> (referer: None)
2026-03-29 20:11:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5595/20475595/interior_boot-1774706553598.jpg> (referer: None)
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e2cb10>
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e31cb8c-b819-5889-afd6-bc69ea59e649/4e31cb8c-b819-5889-afd6-bc69ea59e649_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3712%252F20493712%252Fexterior_front_driver-1774778332922.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3712/20493712/exterior_front_driver-1774778332922.jpg saved to cache
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e31cb8c-b819-5889-afd6-bc69ea59e649
2026-03-29 20:11:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cebe8506-187c-53c7-b3ab-8d6a67c0ecde with identifier: 7263451
2026-03-29 20:11:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cebe8506-187c-53c7-b3ab-8d6a67c0ecde with scrape type 1
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cebe8506-187c-53c7-b3ab-8d6a67c0ecde
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3451%252F7263451%252F7263451-exterior_front_driver-default-1774532324215.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3451/7263451/7263451-exterior_front_driver-default-1774532324215.jpg not downloaded yet
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e2ca50>
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b32c733-0254-5a36-91b0-9956f3b111dc/5b32c733-0254-5a36-91b0-9956f3b111dc_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6653%252F20406653%252Fexterior_front_driver-1774697593191.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6653/20406653/exterior_front_driver-1774697593191.jpg saved to cache
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b32c733-0254-5a36-91b0-9956f3b111dc
2026-03-29 20:11:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d761d0>
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a91851d-c8c8-5681-a9de-54cb820b5a7c/8a91851d-c8c8-5681-a9de-54cb820b5a7c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5595%252F20475595%252Finstrument_cluster-1774706552467.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5595/20475595/instrument_cluster-1774706552467.jpg saved to cache
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8a91851d-c8c8-5681-a9de-54cb820b5a7c
2026-03-29 20:11:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e72a90>
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a91851d-c8c8-5681-a9de-54cb820b5a7c/8a91851d-c8c8-5681-a9de-54cb820b5a7c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5595%252F20475595%252Finterior_dashboard-1774706533202.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5595/20475595/interior_dashboard-1774706533202.jpg saved to cache
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8a91851d-c8c8-5681-a9de-54cb820b5a7c
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3451%252F7263451%252F7263451-exterior_rear_driver-default-1774532377683.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3451/7263451/7263451-exterior_rear_driver-default-1774532377683.jpg not downloaded yet
2026-03-29 20:11:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a5e4d0>
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a91851d-c8c8-5681-a9de-54cb820b5a7c/8a91851d-c8c8-5681-a9de-54cb820b5a7c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5595%252F20475595%252Finterior_boot-1774706553598.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5595/20475595/interior_boot-1774706553598.jpg saved to cache
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8a91851d-c8c8-5681-a9de-54cb820b5a7c
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3451%252F7263451%252F7263451-exterior_front_passenger-default-1774532409014.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3451/7263451/7263451-exterior_front_passenger-default-1774532409014.jpg not downloaded yet
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3451%252F7263451%252F7263451-exterior_rear_passenger-default-1774532440229.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3451/7263451/7263451-exterior_rear_passenger-default-1774532440229.jpg not downloaded yet
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3451%252F7263451%252F7263451-interior_front_seats-default-1774532501079.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3451/7263451/7263451-interior_front_seats-default-1774532501079.jpg not downloaded yet
2026-03-29 20:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20254078.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3451%252F7263451%252F7263451-interior_rear_seats-default-1774532529401.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3451/7263451/7263451-interior_rear_seats-default-1774532529401.jpg not downloaded yet
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3451%252F7263451%252F7263451-interior_dashboard-default-1774532561200.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3451/7263451/7263451-interior_dashboard-default-1774532561200.jpg not downloaded yet
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3451%252F7263451%252F7263451-instrument_cluster-default-1774532719836.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3451/7263451/7263451-instrument_cluster-default-1774532719836.jpg not downloaded yet
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3451%252F7263451%252F7263451-interior_boot-default-1774532562379.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3451/7263451/7263451-interior_boot-default-1774532562379.jpg not downloaded yet
2026-03-29 20:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3712/20493712/interior_boot-1774778459253.jpg> (referer: None)
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3451%252F7263451%252F7263451-docs_service_history-modified-1774533951178.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0b701a9d5aa2f31e5e2c60977061ee66%27 HTTP/1.1" 200 None
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3451/7263451/7263451-docs_service_history-modified-1774533951178.jpeg?ixlib=js-3.8.0&auto=format&s=0b701a9d5aa2f31e5e2c60977061ee66 not downloaded yet
2026-03-29 20:11:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82cebd3e-9ce9-5b93-b3ca-388df344502f with identifier: 20254078
2026-03-29 20:11:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82cebd3e-9ce9-5b93-b3ca-388df344502f with scrape type 1
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82cebd3e-9ce9-5b93-b3ca-388df344502f
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4078%252F20254078%252Fexterior_front_driver-1774783868283.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4078/20254078/exterior_front_driver-1774783868283.jpg not downloaded yet
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4078%252F20254078%252Fexterior_rear_driver-1774783913177.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4078/20254078/exterior_rear_driver-1774783913177.jpg not downloaded yet
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4078%252F20254078%252Fexterior_front_passenger-1774718916626.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4078/20254078/exterior_front_passenger-1774718916626.jpg not downloaded yet
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4078%252F20254078%252Fexterior_rear_passenger-1774718902811.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4078/20254078/exterior_rear_passenger-1774718902811.jpg not downloaded yet
2026-03-29 20:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659bf6490>
2026-03-29 20:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e31cb8c-b819-5889-afd6-bc69ea59e649/4e31cb8c-b819-5889-afd6-bc69ea59e649_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3712%252F20493712%252Finterior_boot-1774778459253.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3712/20493712/interior_boot-1774778459253.jpg saved to cache
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4e31cb8c-b819-5889-afd6-bc69ea59e649
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4078%252F20254078%252Finterior_front_seats-1774719201230.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4078/20254078/interior_front_seats-1774719201230.jpg not downloaded yet
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4078%252F20254078%252Finterior_rear_seats-1774719213986.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4078/20254078/interior_rear_seats-1774719213986.jpg not downloaded yet
2026-03-29 20:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5595/20475595/interior_rear_seats-1774706487090.jpg> (referer: None)
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4078%252F20254078%252Finterior_dashboard-1774783936280.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4078/20254078/interior_dashboard-1774783936280.jpg not downloaded yet
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4078%252F20254078%252Finstrument_cluster-1774719318503.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4078/20254078/instrument_cluster-1774719318503.jpg not downloaded yet
2026-03-29 20:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3712/20493712/docs_service_history-1774721132026.jpg?ixlib=js-3.8.0&auto=format&s=e6a1614f78e213454053c7d9be84a956> (referer: None)
2026-03-29 20:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6653/20406653/docs_service_history-1774698390118.jpg?ixlib=js-3.8.0&auto=format&s=9f4f51bfa437df58af807d5268d83eb9> (referer: None)
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4078%252F20254078%252Finterior_boot-1774719238873.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4078/20254078/interior_boot-1774719238873.jpg not downloaded yet
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4078%252F20254078%252Fdocs_service_history-1774723515829.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2d7a0400991163733566b3fd1c7fa8e8%27 HTTP/1.1" 200 None
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4078/20254078/docs_service_history-1774723515829.jpg?ixlib=js-3.8.0&auto=format&s=2d7a0400991163733566b3fd1c7fa8e8 not downloaded yet
2026-03-29 20:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3712/20493712/docs_service_history-1774721097254.jpg?ixlib=js-3.8.0&auto=format&s=135d2e1733e99783674d512e7e5a37df> (referer: None)
2026-03-29 20:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5595/20475595/docs_service_history-1774707053371.jpg?ixlib=js-3.8.0&auto=format&s=70e1b438c677f039a72cebb273c014e1> (referer: None)
2026-03-29 20:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3451/7263451/7263451-exterior_front_driver-default-1774532324215.jpg> (referer: None)
2026-03-29 20:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3451/7263451/7263451-exterior_rear_passenger-default-1774532440229.jpg> (referer: None)
2026-03-29 20:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6653/20406653/docs_service_history-1774698368810.jpg?ixlib=js-3.8.0&auto=format&s=1f5e8ac4252f95b699619b3eef866665> (referer: None)
2026-03-29 20:11:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d86a10>
2026-03-29 20:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a91851d-c8c8-5681-a9de-54cb820b5a7c/8a91851d-c8c8-5681-a9de-54cb820b5a7c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5595%252F20475595%252Finterior_rear_seats-1774706487090.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5595/20475595/interior_rear_seats-1774706487090.jpg saved to cache
2026-03-29 20:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8a91851d-c8c8-5681-a9de-54cb820b5a7c
2026-03-29 20:11:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d84810>
2026-03-29 20:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e31cb8c-b819-5889-afd6-bc69ea59e649/4e31cb8c-b819-5889-afd6-bc69ea59e649_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3712%252F20493712%252Fdocs_service_history-1774721132026.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De6a1614f78e213454053c7d9be84a956') HTTP/1.1" 204 0
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3712/20493712/docs_service_history-1774721132026.jpg?ixlib=js-3.8.0&auto=format&s=e6a1614f78e213454053c7d9be84a956 saved to cache
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4e31cb8c-b819-5889-afd6-bc69ea59e649
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598db5d0>
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b32c733-0254-5a36-91b0-9956f3b111dc/5b32c733-0254-5a36-91b0-9956f3b111dc_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6653%252F20406653%252Fdocs_service_history-1774698390118.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9f4f51bfa437df58af807d5268d83eb9') HTTP/1.1" 204 0
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6653/20406653/docs_service_history-1774698390118.jpg?ixlib=js-3.8.0&auto=format&s=9f4f51bfa437df58af807d5268d83eb9 saved to cache
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5b32c733-0254-5a36-91b0-9956f3b111dc
2026-03-29 20:11:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d87850>
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e31cb8c-b819-5889-afd6-bc69ea59e649/4e31cb8c-b819-5889-afd6-bc69ea59e649_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3712%252F20493712%252Fdocs_service_history-1774721097254.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D135d2e1733e99783674d512e7e5a37df') HTTP/1.1" 204 0
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3712/20493712/docs_service_history-1774721097254.jpg?ixlib=js-3.8.0&auto=format&s=135d2e1733e99783674d512e7e5a37df saved to cache
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4e31cb8c-b819-5889-afd6-bc69ea59e649
2026-03-29 20:11:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a84350>
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a91851d-c8c8-5681-a9de-54cb820b5a7c/8a91851d-c8c8-5681-a9de-54cb820b5a7c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5595%252F20475595%252Fdocs_service_history-1774707053371.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D70e1b438c677f039a72cebb273c014e1') HTTP/1.1" 204 0
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5595/20475595/docs_service_history-1774707053371.jpg?ixlib=js-3.8.0&auto=format&s=70e1b438c677f039a72cebb273c014e1 saved to cache
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8a91851d-c8c8-5681-a9de-54cb820b5a7c
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a7d750>
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cebe8506-187c-53c7-b3ab-8d6a67c0ecde/cebe8506-187c-53c7-b3ab-8d6a67c0ecde_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3451%252F7263451%252F7263451-exterior_front_driver-default-1774532324215.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3451/7263451/7263451-exterior_front_driver-default-1774532324215.jpg saved to cache
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cebe8506-187c-53c7-b3ab-8d6a67c0ecde
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e2e310>
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cebe8506-187c-53c7-b3ab-8d6a67c0ecde/cebe8506-187c-53c7-b3ab-8d6a67c0ecde_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3451%252F7263451%252F7263451-exterior_rear_passenger-default-1774532440229.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3451/7263451/7263451-exterior_rear_passenger-default-1774532440229.jpg saved to cache
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cebe8506-187c-53c7-b3ab-8d6a67c0ecde
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d96ad0>
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b32c733-0254-5a36-91b0-9956f3b111dc/5b32c733-0254-5a36-91b0-9956f3b111dc_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6653%252F20406653%252Fdocs_service_history-1774698368810.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1f5e8ac4252f95b699619b3eef866665') HTTP/1.1" 204 0
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6653/20406653/docs_service_history-1774698368810.jpg?ixlib=js-3.8.0&auto=format&s=1f5e8ac4252f95b699619b3eef866665 saved to cache
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5b32c733-0254-5a36-91b0-9956f3b111dc
2026-03-29 20:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3451/7263451/7263451-instrument_cluster-default-1774532719836.jpg> (referer: None)
2026-03-29 20:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4078/20254078/interior_rear_seats-1774719213986.jpg> (referer: None)
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ce6910>
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cebe8506-187c-53c7-b3ab-8d6a67c0ecde/cebe8506-187c-53c7-b3ab-8d6a67c0ecde_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3451%252F7263451%252F7263451-instrument_cluster-default-1774532719836.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3451/7263451/7263451-instrument_cluster-default-1774532719836.jpg saved to cache
2026-03-29 20:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cebe8506-187c-53c7-b3ab-8d6a67c0ecde
2026-03-29 20:11:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d78350>
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82cebd3e-9ce9-5b93-b3ca-388df344502f/82cebd3e-9ce9-5b93-b3ca-388df344502f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4078%252F20254078%252Finterior_rear_seats-1774719213986.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4078/20254078/interior_rear_seats-1774719213986.jpg saved to cache
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82cebd3e-9ce9-5b93-b3ca-388df344502f
2026-03-29 20:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19842266.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4078/20254078/docs_service_history-1774723515829.jpg?ixlib=js-3.8.0&auto=format&s=2d7a0400991163733566b3fd1c7fa8e8> (referer: None)
2026-03-29 20:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4078/20254078/exterior_front_passenger-1774718916626.jpg> (referer: None)
2026-03-29 20:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=252&page=7&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4078/20254078/exterior_rear_driver-1774783913177.jpg> (referer: None)
2026-03-29 20:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4078/20254078/instrument_cluster-1774719318503.jpg> (referer: None)
2026-03-29 20:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4078/20254078/exterior_rear_passenger-1774718902811.jpg> (referer: None)
2026-03-29 20:11:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6c6331c-023f-5573-b956-bdd7ef96c4c6 with identifier: 19842266
2026-03-29 20:11:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6c6331c-023f-5573-b956-bdd7ef96c4c6 with scrape type 1
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d6c6331c-023f-5573-b956-bdd7ef96c4c6
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2266%252F19842266%252Fexterior_front_driver-1774709578906.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2266/19842266/exterior_front_driver-1774709578906.jpg not downloaded yet
2026-03-29 20:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4078/20254078/interior_dashboard-1774783936280.jpg> (referer: None)
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2266%252F19842266%252Fexterior_rear_driver-1774709595662.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2266/19842266/exterior_rear_driver-1774709595662.jpg not downloaded yet
2026-03-29 20:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4078/20254078/interior_boot-1774719238873.jpg> (referer: None)
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2266%252F19842266%252Fexterior_front_passenger-1774709631194.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2266/19842266/exterior_front_passenger-1774709631194.jpg not downloaded yet
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c0f250>
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82cebd3e-9ce9-5b93-b3ca-388df344502f/82cebd3e-9ce9-5b93-b3ca-388df344502f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4078%252F20254078%252Fdocs_service_history-1774723515829.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2d7a0400991163733566b3fd1c7fa8e8') HTTP/1.1" 204 0
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4078/20254078/docs_service_history-1774723515829.jpg?ixlib=js-3.8.0&auto=format&s=2d7a0400991163733566b3fd1c7fa8e8 saved to cache
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82cebd3e-9ce9-5b93-b3ca-388df344502f
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658b2dd10>
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82cebd3e-9ce9-5b93-b3ca-388df344502f/82cebd3e-9ce9-5b93-b3ca-388df344502f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4078%252F20254078%252Fexterior_front_passenger-1774718916626.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4078/20254078/exterior_front_passenger-1774718916626.jpg saved to cache
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82cebd3e-9ce9-5b93-b3ca-388df344502f
2026-03-29 20:11:38 [motorway.uk] INFO: Found listing with ID: 20471425
2026-03-29 20:11:38 [motorway.uk] INFO: Found listing with ID: 20460179
2026-03-29 20:11:38 [motorway.uk] INFO: Found listing with ID: 20486036
2026-03-29 20:11:38 [motorway.uk] INFO: Found listing with ID: 20484858
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720484858%27 HTTP/1.1" 200 None
2026-03-29 20:11:38 [motorway.uk] INFO: Scrape type for 20484858: 1
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65843cd10>
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82cebd3e-9ce9-5b93-b3ca-388df344502f/82cebd3e-9ce9-5b93-b3ca-388df344502f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4078%252F20254078%252Fexterior_rear_driver-1774783913177.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4078/20254078/exterior_rear_driver-1774783913177.jpg saved to cache
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82cebd3e-9ce9-5b93-b3ca-388df344502f
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2266%252F19842266%252Fexterior_rear_passenger-1774709606834.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2266/19842266/exterior_rear_passenger-1774709606834.jpg not downloaded yet
2026-03-29 20:11:38 [motorway.uk] INFO: Found listing with ID: 20485204
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720485204%27 HTTP/1.1" 200 None
2026-03-29 20:11:38 [motorway.uk] INFO: Scrape type for 20485204: 1
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d93510>
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82cebd3e-9ce9-5b93-b3ca-388df344502f/82cebd3e-9ce9-5b93-b3ca-388df344502f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4078%252F20254078%252Finstrument_cluster-1774719318503.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4078/20254078/instrument_cluster-1774719318503.jpg saved to cache
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82cebd3e-9ce9-5b93-b3ca-388df344502f
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b1b190>
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82cebd3e-9ce9-5b93-b3ca-388df344502f/82cebd3e-9ce9-5b93-b3ca-388df344502f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4078%252F20254078%252Fexterior_rear_passenger-1774718902811.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4078/20254078/exterior_rear_passenger-1774718902811.jpg saved to cache
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82cebd3e-9ce9-5b93-b3ca-388df344502f
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2266%252F19842266%252Finterior_front_seats-1774710377916.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2266/19842266/interior_front_seats-1774710377916.jpg not downloaded yet
2026-03-29 20:11:38 [motorway.uk] INFO: Found listing with ID: 20487941
2026-03-29 20:11:38 [motorway.uk] INFO: Found listing with ID: 20364057
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720364057%27 HTTP/1.1" 200 None
2026-03-29 20:11:39 [motorway.uk] INFO: Scrape type for 20364057: 1
2026-03-29 20:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c61a10>
2026-03-29 20:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82cebd3e-9ce9-5b93-b3ca-388df344502f/82cebd3e-9ce9-5b93-b3ca-388df344502f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4078%252F20254078%252Finterior_dashboard-1774783936280.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4078/20254078/interior_dashboard-1774783936280.jpg saved to cache
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82cebd3e-9ce9-5b93-b3ca-388df344502f
2026-03-29 20:11:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658380f10>
2026-03-29 20:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82cebd3e-9ce9-5b93-b3ca-388df344502f/82cebd3e-9ce9-5b93-b3ca-388df344502f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4078%252F20254078%252Finterior_boot-1774719238873.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4078/20254078/interior_boot-1774719238873.jpg saved to cache
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82cebd3e-9ce9-5b93-b3ca-388df344502f
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2266%252F19842266%252Finterior_rear_seats-1774710414345.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2266/19842266/interior_rear_seats-1774710414345.jpg not downloaded yet
2026-03-29 20:11:39 [motorway.uk] INFO: Found listing with ID: 20486965
2026-03-29 20:11:39 [motorway.uk] INFO: Found listing with ID: 20137059
2026-03-29 20:11:39 [motorway.uk] INFO: Found listing with ID: 20074064
2026-03-29 20:11:39 [motorway.uk] INFO: Found listing with ID: 20211024
2026-03-29 20:11:39 [motorway.uk] INFO: Found listing with ID: 15623720
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715623720%27 HTTP/1.1" 200 None
2026-03-29 20:11:39 [motorway.uk] INFO: Scrape type for 15623720: 2
2026-03-29 20:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/3451/7263451/7263451-docs_service_history-modified-1774533951178.jpeg?ixlib=js-3.8.0&auto=format&s=0b701a9d5aa2f31e5e2c60977061ee66> (referer: None)
2026-03-29 20:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4078/20254078/interior_front_seats-1774719201230.jpg> (referer: None)
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2266%252F19842266%252Finterior_dashboard-1774710462661.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2266/19842266/interior_dashboard-1774710462661.jpg not downloaded yet
2026-03-29 20:11:39 [motorway.uk] INFO: Found listing with ID: 3788757
2026-03-29 20:11:39 [motorway.uk] INFO: Found listing with ID: 20490856
2026-03-29 20:11:39 [motorway.uk] INFO: Found listing with ID: 3629062
2026-03-29 20:11:39 [motorway.uk] INFO: Found listing with ID: 17539370
2026-03-29 20:11:39 [motorway.uk] INFO: Found listing with ID: 19374986
2026-03-29 20:11:39 [motorway.uk] INFO: Found listing with ID: 8230018
2026-03-29 20:11:39 [motorway.uk] INFO: Found listing with ID: 20417498
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720417498%27 HTTP/1.1" 200 None
2026-03-29 20:11:39 [motorway.uk] INFO: Scrape type for 20417498: 1
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2266%252F19842266%252Finstrument_cluster-1774710461779.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2266/19842266/instrument_cluster-1774710461779.jpg not downloaded yet
2026-03-29 20:11:39 [motorway.uk] INFO: Found listing with ID: 20493011
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720493011%27 HTTP/1.1" 200 None
2026-03-29 20:11:39 [motorway.uk] INFO: Scrape type for 20493011: 1
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2266%252F19842266%252Finterior_boot-1774710552641.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2266/19842266/interior_boot-1774710552641.jpg not downloaded yet
2026-03-29 20:11:39 [motorway.uk] INFO: Found listing with ID: 19185609
2026-03-29 20:11:39 [motorway.uk] INFO: Found listing with ID: 20459030
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720459030%27 HTTP/1.1" 200 None
2026-03-29 20:11:39 [motorway.uk] INFO: Scrape type for 20459030: 1
2026-03-29 20:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a47d90>
2026-03-29 20:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cebe8506-187c-53c7-b3ab-8d6a67c0ecde/cebe8506-187c-53c7-b3ab-8d6a67c0ecde_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3451%252F7263451%252F7263451-docs_service_history-modified-1774533951178.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0b701a9d5aa2f31e5e2c60977061ee66') HTTP/1.1" 204 0
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3451/7263451/7263451-docs_service_history-modified-1774533951178.jpeg?ixlib=js-3.8.0&auto=format&s=0b701a9d5aa2f31e5e2c60977061ee66 saved to cache
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cebe8506-187c-53c7-b3ab-8d6a67c0ecde
2026-03-29 20:11:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65998ec50>
2026-03-29 20:11:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82cebd3e-9ce9-5b93-b3ca-388df344502f/82cebd3e-9ce9-5b93-b3ca-388df344502f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4078%252F20254078%252Finterior_front_seats-1774719201230.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4078/20254078/interior_front_seats-1774719201230.jpg saved to cache
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82cebd3e-9ce9-5b93-b3ca-388df344502f
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2266%252F19842266%252Fdocs_service_history-1774779850438.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8fd6a747746f35fad171aca8e205bcc5%27 HTTP/1.1" 200 None
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2266/19842266/docs_service_history-1774779850438.jpg?ixlib=js-3.8.0&auto=format&s=8fd6a747746f35fad171aca8e205bcc5 not downloaded yet
2026-03-29 20:11:39 [motorway.uk] INFO: Found listing with ID: 19077638
2026-03-29 20:11:39 [motorway.uk] INFO: Found listing with ID: 11018452
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711018452%27 HTTP/1.1" 200 None
2026-03-29 20:11:39 [motorway.uk] INFO: Scrape type for 11018452: 1
2026-03-29 20:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/3909564.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19203575.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:39 [motorway.uk] INFO: Found listing with ID: 20107109
2026-03-29 20:11:39 [motorway.uk] INFO: Found listing with ID: 19998396
2026-03-29 20:11:39 [motorway.uk] INFO: Found listing with ID: 20254074
2026-03-29 20:11:39 [motorway.uk] INFO: Found listing with ID: 20487479
2026-03-29 20:11:39 [motorway.uk] INFO: Found listing with ID: 20436997
2026-03-29 20:11:39 [motorway.uk] INFO: Found listing with ID: 12193651
2026-03-29 20:11:39 [motorway.uk] INFO: Found listing with ID: 12187861
2026-03-29 20:11:39 [motorway.uk] INFO: Found listing with ID: 13059915
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713059915%27 HTTP/1.1" 200 None
2026-03-29 20:11:39 [motorway.uk] INFO: Scrape type for 13059915: 1
2026-03-29 20:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20404359.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:39 [motorway.uk] INFO: Found listing with ID: 16021572
2026-03-29 20:11:39 [motorway.uk] INFO: Found listing with ID: 20368083
2026-03-29 20:11:39 [motorway.uk] INFO: Found listing with ID: 20499187
2026-03-29 20:11:39 [motorway.uk] INFO: Found listing with ID: 11654403
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711654403%27 HTTP/1.1" 200 None
2026-03-29 20:11:39 [motorway.uk] INFO: Scrape type for 11654403: 1
2026-03-29 20:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4078/20254078/exterior_front_driver-1774783868283.jpg> (referer: None)
2026-03-29 20:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3451/7263451/7263451-interior_boot-default-1774532562379.jpg> (referer: None)
2026-03-29 20:11:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db2fee49-d68f-5e30-bf65-b160a07ccdb5 with identifier: 3909564
2026-03-29 20:11:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db2fee49-d68f-5e30-bf65-b160a07ccdb5 with scrape type 1
2026-03-29 20:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item db2fee49-d68f-5e30-bf65-b160a07ccdb5
2026-03-29 20:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9564%252F3909564%252Fexterior_front_driver-1774694228173.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9564/3909564/exterior_front_driver-1774694228173.jpeg not downloaded yet
2026-03-29 20:11:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d52f558-c2bf-54b7-86ac-d349a2d41283 with identifier: 19203575
2026-03-29 20:11:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d52f558-c2bf-54b7-86ac-d349a2d41283 with scrape type 2
2026-03-29 20:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d52f558-c2bf-54b7-86ac-d349a2d41283 with scrape type 2
2026-03-29 20:11:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5d52f558-c2bf-54b7-86ac-d349a2d41283, identifier: 19203575
2026-03-29 20:11:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5d52f558-c2bf-54b7-86ac-d349a2d41283 with identifier: 19203575
2026-03-29 20:11:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:11:40 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Silver HTTP/1.1" 200 None
2026-03-29 20:11:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:11:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5d52f558-c2bf-54b7-86ac-d349a2d41283 with identifier: 19203575
2026-03-29 20:11:40 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5d52f558-c2bf-54b7-86ac-d349a2d41283 with identifier: 19203575 to the API
2026-03-29 20:11:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19203575.json>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '5d52f558-c2bf-54b7-86ac-d349a2d41283',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'R7 RGV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19203575',
'listing': 'auction',
'location': 'Cheshire West and Chester Malpas',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 14387,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 30400,
'price_includes_vat': False,
'registration_date': '2023-10-02',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Range Rover Evoque DYN HSE Dmhev A',
'transmission': 'automatic',
'trim': 'Evoque DYN HSE Dmhev A',
'vin': 'SALZA2AN5RH233535',
'year': 2023}
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719203575%27 HTTP/1.1" 200 None
2026-03-29 20:11:41 [motorway.uk] INFO: Saving data for 19203575: {'auction_closing_time': 1774884600.0, 'created_time': 1774469593.828623, 'last_price_update_time': 1774815101.051396}
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19203575') HTTP/1.1" 204 0
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9564%252F3909564%252Fexterior_rear_driver-1774694147813.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9564/3909564/exterior_rear_driver-1774694147813.jpeg not downloaded yet
2026-03-29 20:11:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/2266/19842266/docs_service_history-1774779850438.jpg?ixlib=js-3.8.0&auto=format&s=8fd6a747746f35fad171aca8e205bcc5> (referer: None)
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9564%252F3909564%252Fexterior_front_passenger-1774694273019.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9564/3909564/exterior_front_passenger-1774694273019.jpeg not downloaded yet
2026-03-29 20:11:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39367f78-574d-5919-ba05-6796acb4f138 with identifier: 20404359
2026-03-29 20:11:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39367f78-574d-5919-ba05-6796acb4f138 with scrape type 1
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 39367f78-574d-5919-ba05-6796acb4f138
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4359%252F20404359%252Fexterior_front_driver-1774712638498.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4359/20404359/exterior_front_driver-1774712638498.jpg not downloaded yet
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b62050>
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82cebd3e-9ce9-5b93-b3ca-388df344502f/82cebd3e-9ce9-5b93-b3ca-388df344502f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4078%252F20254078%252Fexterior_front_driver-1774783868283.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4078/20254078/exterior_front_driver-1774783868283.jpg saved to cache
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82cebd3e-9ce9-5b93-b3ca-388df344502f
2026-03-29 20:11:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82cebd3e-9ce9-5b93-b3ca-388df344502f, skipping ID generation
2026-03-29 20:11:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82cebd3e-9ce9-5b93-b3ca-388df344502f with scrape type 1
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82cebd3e-9ce9-5b93-b3ca-388df344502f sending to next pipeline
2026-03-29 20:11:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 82cebd3e-9ce9-5b93-b3ca-388df344502f, identifier: 20254078
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e6da50>
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cebe8506-187c-53c7-b3ab-8d6a67c0ecde/cebe8506-187c-53c7-b3ab-8d6a67c0ecde_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3451%252F7263451%252F7263451-interior_boot-default-1774532562379.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3451/7263451/7263451-interior_boot-default-1774532562379.jpg saved to cache
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cebe8506-187c-53c7-b3ab-8d6a67c0ecde
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9564%252F3909564%252Fexterior_rear_passenger-1774694140342.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9564/3909564/exterior_rear_passenger-1774694140342.jpeg not downloaded yet
2026-03-29 20:11:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 82cebd3e-9ce9-5b93-b3ca-388df344502f with identifier: 20254078
2026-03-29 20:11:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 82cebd3e-9ce9-5b93-b3ca-388df344502f with identifier: 20254078
2026-03-29 20:11:41 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 82cebd3e-9ce9-5b93-b3ca-388df344502f with identifier: 20254078 to the API
2026-03-29 20:11:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/4078/20254078/exterior_front_driver-1774783868283.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '82cebd3e-9ce9-5b93-b3ca-388df344502f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BD18 LEX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20254078',
'listing': 'auction',
'location': 'West Midlands Coventry',
'make': 'Lexus',
'model': 'IS 300',
'odometer': 71000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82cebd3e-9ce9-5b93-b3ca-388df344502f/82cebd3e-9ce9-5b93-b3ca-388df344502f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2088588,
'Height': 2570,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4078/20254078/exterior_front_driver-1774783868283.jpg',
'Width': 3427},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82cebd3e-9ce9-5b93-b3ca-388df344502f/82cebd3e-9ce9-5b93-b3ca-388df344502f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2770601,
'Height': 2969,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4078/20254078/exterior_rear_driver-1774783913177.jpg',
'Width': 3959},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82cebd3e-9ce9-5b93-b3ca-388df344502f/82cebd3e-9ce9-5b93-b3ca-388df344502f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1537533,
'Height': 2287,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4078/20254078/exterior_front_passenger-1774718916626.jpg',
'Width': 3049},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82cebd3e-9ce9-5b93-b3ca-388df344502f/82cebd3e-9ce9-5b93-b3ca-388df344502f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1946956,
'Height': 2802,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4078/20254078/exterior_rear_passenger-1774718902811.jpg',
'Width': 3736},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82cebd3e-9ce9-5b93-b3ca-388df344502f/82cebd3e-9ce9-5b93-b3ca-388df344502f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4494965,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4078/20254078/interior_front_seats-1774719201230.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82cebd3e-9ce9-5b93-b3ca-388df344502f/82cebd3e-9ce9-5b93-b3ca-388df344502f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4215249,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4078/20254078/interior_rear_seats-1774719213986.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82cebd3e-9ce9-5b93-b3ca-388df344502f/82cebd3e-9ce9-5b93-b3ca-388df344502f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2505123,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4078/20254078/interior_dashboard-1774783936280.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82cebd3e-9ce9-5b93-b3ca-388df344502f/82cebd3e-9ce9-5b93-b3ca-388df344502f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1824682,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4078/20254078/instrument_cluster-1774719318503.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82cebd3e-9ce9-5b93-b3ca-388df344502f/82cebd3e-9ce9-5b93-b3ca-388df344502f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3086952,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4078/20254078/interior_boot-1774719238873.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82cebd3e-9ce9-5b93-b3ca-388df344502f/82cebd3e-9ce9-5b93-b3ca-388df344502f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 444775,
'Height': 2100,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4078/20254078/docs_service_history-1774723515829.jpg?ixlib=js-3.8.0&auto=format&s=2d7a0400991163733566b3fd1c7fa8e8',
'Width': 1576}],
'price': 14336,
'price_includes_vat': False,
'registration_date': '2018-03-02',
'seats_number': None,
'seller_name': None,
'title': 'Lexus IS 300H F Sport CVT',
'transmission': 'automatic',
'trim': 'H F Sport CVT',
'vin': 'JTHBH5D2X05069290',
'year': 2018}
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720254078%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [motorway.uk] INFO: Saving data for 20254078: {'created_time': 1774815102.15961, 'last_price_update_time': 1774815102.159621, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20254078') HTTP/1.1" 204 0
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4359%252F20404359%252Fexterior_rear_driver-1774712659399.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4359/20404359/exterior_rear_driver-1774712659399.jpg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9564%252F3909564%252Finterior_front_seats-1774693916993.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9564/3909564/interior_front_seats-1774693916993.jpeg not downloaded yet
2026-03-29 20:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20489789.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d01990>
2026-03-29 20:11:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c6331c-023f-5573-b956-bdd7ef96c4c6/d6c6331c-023f-5573-b956-bdd7ef96c4c6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2266%252F19842266%252Fdocs_service_history-1774779850438.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8fd6a747746f35fad171aca8e205bcc5') HTTP/1.1" 204 0
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2266/19842266/docs_service_history-1774779850438.jpg?ixlib=js-3.8.0&auto=format&s=8fd6a747746f35fad171aca8e205bcc5 saved to cache
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d6c6331c-023f-5573-b956-bdd7ef96c4c6
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4359%252F20404359%252Fexterior_front_passenger-1774712718419.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4359/20404359/exterior_front_passenger-1774712718419.jpg not downloaded yet
2026-03-29 20:11:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9564%252F3909564%252Finterior_rear_seats-1774694016491.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9564/3909564/interior_rear_seats-1774694016491.jpeg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4359%252F20404359%252Fexterior_rear_passenger-1774712683498.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4359/20404359/exterior_rear_passenger-1774712683498.jpg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9564%252F3909564%252Finterior_dashboard-1774694047896.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9564/3909564/interior_dashboard-1774694047896.jpeg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4359%252F20404359%252Finterior_front_seats-1774713692603.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4359/20404359/interior_front_seats-1774713692603.jpg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9564%252F3909564%252Finstrument_cluster-1774694105399.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9564/3909564/instrument_cluster-1774694105399.jpeg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4359%252F20404359%252Finterior_rear_seats-1774713113113.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4359/20404359/interior_rear_seats-1774713113113.jpg not downloaded yet
2026-03-29 20:11:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa60fb8d-0c5a-520b-85d7-28248fe15f71 with identifier: 20489789
2026-03-29 20:11:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa60fb8d-0c5a-520b-85d7-28248fe15f71 with scrape type 1
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fa60fb8d-0c5a-520b-85d7-28248fe15f71
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9789%252F20489789%252Fexterior_front_driver-1774708237201.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9789/20489789/exterior_front_driver-1774708237201.jpg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9564%252F3909564%252Finterior_boot-1774694050083.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9564/3909564/interior_boot-1774694050083.jpeg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4359%252F20404359%252Finterior_dashboard-1774713152904.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4359/20404359/interior_dashboard-1774713152904.jpg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9789%252F20489789%252Fexterior_rear_driver-1774708519356.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9789/20489789/exterior_rear_driver-1774708519356.jpg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9564%252F3909564%252Fdocs_service_history-1774695097047.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5a548c3ebdd8f203995b89c9fd98884a%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9564/3909564/docs_service_history-1774695097047.jpeg?ixlib=js-3.8.0&auto=format&s=5a548c3ebdd8f203995b89c9fd98884a not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4359%252F20404359%252Finterior_boot-1774713171118.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4359/20404359/interior_boot-1774713171118.jpg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9789%252F20489789%252Fexterior_front_passenger-1774708293965.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9789/20489789/exterior_front_passenger-1774708293965.jpg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4359%252F20404359%252Fdocs_service_history-1774713293235.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D692ed88e91d96917947d7352a3b95730%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4359/20404359/docs_service_history-1774713293235.jpg?ixlib=js-3.8.0&auto=format&s=692ed88e91d96917947d7352a3b95730 not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9789%252F20489789%252Fexterior_rear_passenger-1774708545508.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9789/20489789/exterior_rear_passenger-1774708545508.jpg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4359%252F20404359%252Fwheels_front_driver-1774713764458.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4359/20404359/wheels_front_driver-1774713764458.jpg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9789%252F20489789%252Finterior_front_seats-1774708856298.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9789/20489789/interior_front_seats-1774708856298.jpg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9789%252F20489789%252Finterior_dashboard-1774710418022.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9789/20489789/interior_dashboard-1774710418022.jpg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9789%252F20489789%252Finstrument_cluster-1774708946122.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9789/20489789/instrument_cluster-1774708946122.jpg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9789%252F20489789%252Finterior_boot-1774708907450.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9789/20489789/interior_boot-1774708907450.jpg not downloaded yet
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9789%252F20489789%252Fdocs_service_history-1774709739140.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9ad4a6920814d13d7b840b36fd08b3fe%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9789/20489789/docs_service_history-1774709739140.jpg?ixlib=js-3.8.0&auto=format&s=9ad4a6920814d13d7b840b36fd08b3fe not downloaded yet
2026-03-29 20:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2266/19842266/instrument_cluster-1774710461779.jpg> (referer: None)
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9789%252F20489789%252Fdocs_service_history-1774709331134.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd0c84980a093545363f255f46f52a5db%27 HTTP/1.1" 200 None
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9789/20489789/docs_service_history-1774709331134.jpg?ixlib=js-3.8.0&auto=format&s=d0c84980a093545363f255f46f52a5db not downloaded yet
2026-03-29 20:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4359/20404359/exterior_front_driver-1774712638498.jpg> (referer: None)
2026-03-29 20:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2266/19842266/interior_rear_seats-1774710414345.jpg> (referer: None)
2026-03-29 20:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4359/20404359/exterior_rear_driver-1774712659399.jpg> (referer: None)
2026-03-29 20:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2266/19842266/interior_dashboard-1774710462661.jpg> (referer: None)
2026-03-29 20:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9564/3909564/exterior_rear_passenger-1774694140342.jpeg> (referer: None)
2026-03-29 20:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2266/19842266/interior_front_seats-1774710377916.jpg> (referer: None)
2026-03-29 20:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2266/19842266/interior_boot-1774710552641.jpg> (referer: None)
2026-03-29 20:11:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65855ff90>
2026-03-29 20:11:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c6331c-023f-5573-b956-bdd7ef96c4c6/d6c6331c-023f-5573-b956-bdd7ef96c4c6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2266%252F19842266%252Finstrument_cluster-1774710461779.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2266/19842266/instrument_cluster-1774710461779.jpg saved to cache
2026-03-29 20:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d6c6331c-023f-5573-b956-bdd7ef96c4c6
2026-03-29 20:11:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65855f790>
2026-03-29 20:11:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39367f78-574d-5919-ba05-6796acb4f138/39367f78-574d-5919-ba05-6796acb4f138_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4359%252F20404359%252Fexterior_front_driver-1774712638498.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4359/20404359/exterior_front_driver-1774712638498.jpg saved to cache
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 39367f78-574d-5919-ba05-6796acb4f138
2026-03-29 20:11:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fdae50>
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c6331c-023f-5573-b956-bdd7ef96c4c6/d6c6331c-023f-5573-b956-bdd7ef96c4c6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2266%252F19842266%252Finterior_rear_seats-1774710414345.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2266/19842266/interior_rear_seats-1774710414345.jpg saved to cache
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d6c6331c-023f-5573-b956-bdd7ef96c4c6
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e55710>
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39367f78-574d-5919-ba05-6796acb4f138/39367f78-574d-5919-ba05-6796acb4f138_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4359%252F20404359%252Fexterior_rear_driver-1774712659399.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4359/20404359/exterior_rear_driver-1774712659399.jpg saved to cache
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 39367f78-574d-5919-ba05-6796acb4f138
2026-03-29 20:11:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659991210>
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c6331c-023f-5573-b956-bdd7ef96c4c6/d6c6331c-023f-5573-b956-bdd7ef96c4c6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2266%252F19842266%252Finterior_dashboard-1774710462661.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2266/19842266/interior_dashboard-1774710462661.jpg saved to cache
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d6c6331c-023f-5573-b956-bdd7ef96c4c6
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f8d6d0>
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db2fee49-d68f-5e30-bf65-b160a07ccdb5/db2fee49-d68f-5e30-bf65-b160a07ccdb5_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9564%252F3909564%252Fexterior_rear_passenger-1774694140342.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9564/3909564/exterior_rear_passenger-1774694140342.jpeg saved to cache
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db2fee49-d68f-5e30-bf65-b160a07ccdb5
2026-03-29 20:11:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599ee150>
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c6331c-023f-5573-b956-bdd7ef96c4c6/d6c6331c-023f-5573-b956-bdd7ef96c4c6_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2266%252F19842266%252Finterior_front_seats-1774710377916.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2266/19842266/interior_front_seats-1774710377916.jpg saved to cache
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6c6331c-023f-5573-b956-bdd7ef96c4c6
2026-03-29 20:11:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e54c90>
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c6331c-023f-5573-b956-bdd7ef96c4c6/d6c6331c-023f-5573-b956-bdd7ef96c4c6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2266%252F19842266%252Finterior_boot-1774710552641.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2266/19842266/interior_boot-1774710552641.jpg saved to cache
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d6c6331c-023f-5573-b956-bdd7ef96c4c6
2026-03-29 20:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/9789/20489789/docs_service_history-1774709739140.jpg?ixlib=js-3.8.0&auto=format&s=9ad4a6920814d13d7b840b36fd08b3fe> (referer: None)
2026-03-29 20:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9789/20489789/docs_service_history-1774709331134.jpg?ixlib=js-3.8.0&auto=format&s=d0c84980a093545363f255f46f52a5db> (referer: None)
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bdb510>
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa60fb8d-0c5a-520b-85d7-28248fe15f71/fa60fb8d-0c5a-520b-85d7-28248fe15f71_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9789%252F20489789%252Fdocs_service_history-1774709739140.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9ad4a6920814d13d7b840b36fd08b3fe') HTTP/1.1" 204 0
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9789/20489789/docs_service_history-1774709739140.jpg?ixlib=js-3.8.0&auto=format&s=9ad4a6920814d13d7b840b36fd08b3fe saved to cache
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fa60fb8d-0c5a-520b-85d7-28248fe15f71
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ae7710>
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa60fb8d-0c5a-520b-85d7-28248fe15f71/fa60fb8d-0c5a-520b-85d7-28248fe15f71_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9789%252F20489789%252Fdocs_service_history-1774709331134.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd0c84980a093545363f255f46f52a5db') HTTP/1.1" 204 0
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9789/20489789/docs_service_history-1774709331134.jpg?ixlib=js-3.8.0&auto=format&s=d0c84980a093545363f255f46f52a5db saved to cache
2026-03-29 20:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fa60fb8d-0c5a-520b-85d7-28248fe15f71
2026-03-29 20:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20364057.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4359/20404359/wheels_front_driver-1774713764458.jpg> (referer: None)
2026-03-29 20:11:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 120af6f0-63fc-5b28-b658-d5524b422829 with identifier: 20364057
2026-03-29 20:11:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 120af6f0-63fc-5b28-b658-d5524b422829 with scrape type 1
2026-03-29 20:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 120af6f0-63fc-5b28-b658-d5524b422829
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4057%252F20364057%252Fexterior_front_driver-1774623649374.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4057/20364057/exterior_front_driver-1774623649374.jpg not downloaded yet
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4057%252F20364057%252Fexterior_rear_driver-1774626930061.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4057/20364057/exterior_rear_driver-1774626930061.jpg not downloaded yet
2026-03-29 20:11:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15623720.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4057%252F20364057%252Fexterior_front_passenger-1774623694995.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4057/20364057/exterior_front_passenger-1774623694995.jpg not downloaded yet
2026-03-29 20:11:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d76450>
2026-03-29 20:11:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39367f78-574d-5919-ba05-6796acb4f138/39367f78-574d-5919-ba05-6796acb4f138_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4359%252F20404359%252Fwheels_front_driver-1774713764458.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4359/20404359/wheels_front_driver-1774713764458.jpg saved to cache
2026-03-29 20:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 39367f78-574d-5919-ba05-6796acb4f138
2026-03-29 20:11:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9789/20489789/instrument_cluster-1774708946122.jpg> (referer: None)
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4057%252F20364057%252Fexterior_rear_passenger-1774626916511.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4057/20364057/exterior_rear_passenger-1774626916511.jpg not downloaded yet
2026-03-29 20:11:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20493011.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9789/20489789/interior_dashboard-1774710418022.jpg> (referer: None)
2026-03-29 20:11:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9564/3909564/docs_service_history-1774695097047.jpeg?ixlib=js-3.8.0&auto=format&s=5a548c3ebdd8f203995b89c9fd98884a> (referer: None)
2026-03-29 20:11:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88006cfa-ad3c-54d5-b4aa-ce3ae901ad5d with identifier: 15623720
2026-03-29 20:11:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88006cfa-ad3c-54d5-b4aa-ce3ae901ad5d with scrape type 2
2026-03-29 20:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88006cfa-ad3c-54d5-b4aa-ce3ae901ad5d with scrape type 2
2026-03-29 20:11:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 88006cfa-ad3c-54d5-b4aa-ce3ae901ad5d, identifier: 15623720
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4057%252F20364057%252Finterior_front_seats-1774624159955.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4057/20364057/interior_front_seats-1774624159955.jpg not downloaded yet
2026-03-29 20:11:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 88006cfa-ad3c-54d5-b4aa-ce3ae901ad5d with identifier: 15623720
2026-03-29 20:11:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 88006cfa-ad3c-54d5-b4aa-ce3ae901ad5d with identifier: 15623720
2026-03-29 20:11:44 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 88006cfa-ad3c-54d5-b4aa-ce3ae901ad5d with identifier: 15623720 to the API
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15623720.json>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '88006cfa-ad3c-54d5-b4aa-ce3ae901ad5d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BK15 XHM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/15623720',
'listing': 'auction',
'location': 'Hertfordshire Welwyn Garden City',
'make': 'Ford',
'model': 'Transit',
'odometer': 94500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 5121,
'price_includes_vat': False,
'registration_date': '2015-03-31',
'seats_number': None,
'seller_name': None,
'title': 'Ford Transit Custom 290 ECO-TECH',
'transmission': 'manual',
'trim': 'Custom 290 ECO-TECH',
'vin': 'WF0YXXTTGYFK08700',
'year': 2015}
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715623720%27 HTTP/1.1" 200 None
2026-03-29 20:11:45 [motorway.uk] INFO: Saving data for 15623720: {'auction_closing_time': 1774884600.0, 'created_time': 1774383535.34958, 'last_price_update_time': 1774815105.071205}
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='15623720') HTTP/1.1" 204 0
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4057%252F20364057%252Finterior_rear_seats-1774624182721.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4057/20364057/interior_rear_seats-1774624182721.jpg not downloaded yet
2026-03-29 20:11:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582daed0>
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa60fb8d-0c5a-520b-85d7-28248fe15f71/fa60fb8d-0c5a-520b-85d7-28248fe15f71_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9789%252F20489789%252Finstrument_cluster-1774708946122.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9789/20489789/instrument_cluster-1774708946122.jpg saved to cache
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fa60fb8d-0c5a-520b-85d7-28248fe15f71
2026-03-29 20:11:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80b9ce8e-9596-516e-9334-697510f61bfc with identifier: 20493011
2026-03-29 20:11:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80b9ce8e-9596-516e-9334-697510f61bfc with scrape type 1
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 80b9ce8e-9596-516e-9334-697510f61bfc
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3011%252F20493011%252Fexterior_front_driver-1774780074564.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3011/20493011/exterior_front_driver-1774780074564.jpg not downloaded yet
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583796d0>
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa60fb8d-0c5a-520b-85d7-28248fe15f71/fa60fb8d-0c5a-520b-85d7-28248fe15f71_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9789%252F20489789%252Finterior_dashboard-1774710418022.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9789/20489789/interior_dashboard-1774710418022.jpg saved to cache
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fa60fb8d-0c5a-520b-85d7-28248fe15f71
2026-03-29 20:11:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658aa7b50>
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db2fee49-d68f-5e30-bf65-b160a07ccdb5/db2fee49-d68f-5e30-bf65-b160a07ccdb5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9564%252F3909564%252Fdocs_service_history-1774695097047.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5a548c3ebdd8f203995b89c9fd98884a') HTTP/1.1" 204 0
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9564/3909564/docs_service_history-1774695097047.jpeg?ixlib=js-3.8.0&auto=format&s=5a548c3ebdd8f203995b89c9fd98884a saved to cache
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item db2fee49-d68f-5e30-bf65-b160a07ccdb5
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4057%252F20364057%252Finterior_dashboard-1774681799078.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4057/20364057/interior_dashboard-1774681799078.jpg not downloaded yet
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3011%252F20493011%252Fexterior_rear_driver-1774780106966.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3011/20493011/exterior_rear_driver-1774780106966.jpg not downloaded yet
2026-03-29 20:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20417498.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20459030.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4057%252F20364057%252Finstrument_cluster-1774624261079.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4057/20364057/instrument_cluster-1774624261079.jpg not downloaded yet
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3011%252F20493011%252Fexterior_front_passenger-1774780161181.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3011/20493011/exterior_front_passenger-1774780161181.jpg not downloaded yet
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4057%252F20364057%252Finterior_boot-1774624263069.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4057/20364057/interior_boot-1774624263069.jpg not downloaded yet
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3011%252F20493011%252Fexterior_rear_passenger-1774780145762.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3011/20493011/exterior_rear_passenger-1774780145762.jpg not downloaded yet
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4057%252F20364057%252Fdocs_service_history-1774625051381.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D38c76e075ce551861086d0f2b515c53e%27 HTTP/1.1" 200 None
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4057/20364057/docs_service_history-1774625051381.jpg?ixlib=js-3.8.0&auto=format&s=38c76e075ce551861086d0f2b515c53e not downloaded yet
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3011%252F20493011%252Finterior_front_seats-1774780646435.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3011/20493011/interior_front_seats-1774780646435.jpg not downloaded yet
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3011%252F20493011%252Finterior_rear_seats-1774780666574.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3011/20493011/interior_rear_seats-1774780666574.jpg not downloaded yet
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3011%252F20493011%252Finterior_dashboard-1774780754001.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3011/20493011/interior_dashboard-1774780754001.jpg not downloaded yet
2026-03-29 20:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9789/20489789/exterior_front_passenger-1774708293965.jpg> (referer: None)
2026-03-29 20:11:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8563c3ea-9063-5a14-ae79-eeb65c405f5d with identifier: 20417498
2026-03-29 20:11:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8563c3ea-9063-5a14-ae79-eeb65c405f5d with scrape type 1
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8563c3ea-9063-5a14-ae79-eeb65c405f5d
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7498%252F20417498%252Fexterior_front_driver-1774694778990.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7498/20417498/exterior_front_driver-1774694778990.jpg not downloaded yet
2026-03-29 20:11:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75193405-f3d2-518f-a4e0-0725e03a8299 with identifier: 20459030
2026-03-29 20:11:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75193405-f3d2-518f-a4e0-0725e03a8299 with scrape type 1
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 75193405-f3d2-518f-a4e0-0725e03a8299
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9030%252F20459030%252Fexterior_front_driver-1774622262738.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9030/20459030/exterior_front_driver-1774622262738.jpg not downloaded yet
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3011%252F20493011%252Finstrument_cluster-1774780935302.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3011/20493011/instrument_cluster-1774780935302.jpg not downloaded yet
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7498%252F20417498%252Fexterior_rear_driver-1774694789318.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7498/20417498/exterior_rear_driver-1774694789318.jpg not downloaded yet
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9030%252F20459030%252Fexterior_rear_driver-1774609292492.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9030/20459030/exterior_rear_driver-1774609292492.jpg not downloaded yet
2026-03-29 20:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/11018452.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3011%252F20493011%252Finterior_boot-1774780719625.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3011/20493011/interior_boot-1774780719625.jpg not downloaded yet
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7498%252F20417498%252Fexterior_front_passenger-1774694819545.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7498/20417498/exterior_front_passenger-1774694819545.jpg not downloaded yet
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9030%252F20459030%252Fexterior_front_passenger-1774773901269.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9030/20459030/exterior_front_passenger-1774773901269.jpg not downloaded yet
2026-03-29 20:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9789/20489789/exterior_rear_passenger-1774708545508.jpg> (referer: None)
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3011%252F20493011%252Fdocs_service_history-1774781207144.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbca3cf2cbb93a018adbc6de29cb06d9b%27 HTTP/1.1" 200 None
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3011/20493011/docs_service_history-1774781207144.jpg?ixlib=js-3.8.0&auto=format&s=bca3cf2cbb93a018adbc6de29cb06d9b not downloaded yet
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7498%252F20417498%252Fexterior_rear_passenger-1774694801599.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7498/20417498/exterior_rear_passenger-1774694801599.jpg not downloaded yet
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9030%252F20459030%252Fexterior_rear_passenger-1774621660349.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9030/20459030/exterior_rear_passenger-1774621660349.jpg not downloaded yet
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589c4f10>
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa60fb8d-0c5a-520b-85d7-28248fe15f71/fa60fb8d-0c5a-520b-85d7-28248fe15f71_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9789%252F20489789%252Fexterior_front_passenger-1774708293965.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9789/20489789/exterior_front_passenger-1774708293965.jpg saved to cache
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fa60fb8d-0c5a-520b-85d7-28248fe15f71
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7498%252F20417498%252Finterior_front_seats-1774695113201.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7498/20417498/interior_front_seats-1774695113201.jpg not downloaded yet
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9030%252F20459030%252Finterior_front_seats-1774621117754.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9030/20459030/interior_front_seats-1774621117754.jpg not downloaded yet
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7498%252F20417498%252Finterior_rear_seats-1774695126830.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7498/20417498/interior_rear_seats-1774695126830.jpg not downloaded yet
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9030%252F20459030%252Finterior_rear_seats-1774621054412.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9030/20459030/interior_rear_seats-1774621054412.jpg not downloaded yet
2026-03-29 20:11:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59265768-860a-513b-b9a9-34a7f615361b with identifier: 11018452
2026-03-29 20:11:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59265768-860a-513b-b9a9-34a7f615361b with scrape type 1
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 59265768-860a-513b-b9a9-34a7f615361b
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8452%252F11018452%252Fexterior_front_driver-1774692511891.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8452/11018452/exterior_front_driver-1774692511891.jpeg not downloaded yet
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfa3b90>
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa60fb8d-0c5a-520b-85d7-28248fe15f71/fa60fb8d-0c5a-520b-85d7-28248fe15f71_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9789%252F20489789%252Fexterior_rear_passenger-1774708545508.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9789/20489789/exterior_rear_passenger-1774708545508.jpg saved to cache
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fa60fb8d-0c5a-520b-85d7-28248fe15f71
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7498%252F20417498%252Finterior_dashboard-1774788081583.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7498/20417498/interior_dashboard-1774788081583.jpg not downloaded yet
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9030%252F20459030%252Finterior_dashboard-1774621058158.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9030/20459030/interior_dashboard-1774621058158.jpg not downloaded yet
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8452%252F11018452%252Fexterior_rear_driver-1774692338934.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8452/11018452/exterior_rear_driver-1774692338934.jpeg not downloaded yet
2026-03-29 20:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4057/20364057/exterior_rear_driver-1774626930061.jpg> (referer: None)
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7498%252F20417498%252Finstrument_cluster-1774695224342.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7498/20417498/instrument_cluster-1774695224342.jpg not downloaded yet
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9030%252F20459030%252Finterior_boot-1774621006085.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9030/20459030/interior_boot-1774621006085.jpg not downloaded yet
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8452%252F11018452%252Fexterior_front_passenger-1774692370525.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8452/11018452/exterior_front_passenger-1774692370525.jpeg not downloaded yet
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7498%252F20417498%252Finterior_boot-1774695205620.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7498/20417498/interior_boot-1774695205620.jpg not downloaded yet
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9030%252F20459030%252Fdocs_service_history-1774774002886.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc3c7c1ef6de0da97986e0c5d81a0231b%27 HTTP/1.1" 200 None
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9030/20459030/docs_service_history-1774774002886.jpg?ixlib=js-3.8.0&auto=format&s=c3c7c1ef6de0da97986e0c5d81a0231b not downloaded yet
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8452%252F11018452%252Fexterior_rear_passenger-1774692354084.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8452/11018452/exterior_rear_passenger-1774692354084.jpeg not downloaded yet
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7498%252F20417498%252Fdocs_service_history-1774720335255.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db98d8a0100022c5b764af60726d761c8%27 HTTP/1.1" 200 None
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7498/20417498/docs_service_history-1774720335255.jpg?ixlib=js-3.8.0&auto=format&s=b98d8a0100022c5b764af60726d761c8 not downloaded yet
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9030%252F20459030%252Fdocs_service_history-1774711188774.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbce30896d22ca09478b484832918d975%27 HTTP/1.1" 200 None
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9030/20459030/docs_service_history-1774711188774.jpg?ixlib=js-3.8.0&auto=format&s=bce30896d22ca09478b484832918d975 not downloaded yet
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8452%252F11018452%252Finterior_front_seats-1774692137754.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8452/11018452/interior_front_seats-1774692137754.jpeg not downloaded yet
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6585a0350>
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120af6f0-63fc-5b28-b658-d5524b422829/120af6f0-63fc-5b28-b658-d5524b422829_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4057%252F20364057%252Fexterior_rear_driver-1774626930061.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4057/20364057/exterior_rear_driver-1774626930061.jpg saved to cache
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 120af6f0-63fc-5b28-b658-d5524b422829
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8452%252F11018452%252Finterior_rear_seats-1774692188414.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8452/11018452/interior_rear_seats-1774692188414.jpeg not downloaded yet
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8452%252F11018452%252F11018452-interior_dashboard-modified-1774692922246.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8452/11018452/11018452-interior_dashboard-modified-1774692922246.jpeg not downloaded yet
2026-03-29 20:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4057/20364057/exterior_front_passenger-1774623694995.jpg> (referer: None)
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8452%252F11018452%252Finstrument_cluster-1774692278235.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8452/11018452/instrument_cluster-1774692278235.jpeg not downloaded yet
2026-03-29 20:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9789/20489789/interior_boot-1774708907450.jpg> (referer: None)
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8452%252F11018452%252Finterior_boot-1774692314698.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8452/11018452/interior_boot-1774692314698.jpeg not downloaded yet
2026-03-29 20:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9789/20489789/interior_front_seats-1774708856298.jpg> (referer: None)
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8452%252F11018452%252Fdocs_service_history-1774690108962.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df253335443f61cf30b1b68bde9003be4%27 HTTP/1.1" 200 None
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8452/11018452/docs_service_history-1774690108962.jpeg?ixlib=js-3.8.0&auto=format&s=f253335443f61cf30b1b68bde9003be4 not downloaded yet
2026-03-29 20:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4057/20364057/exterior_rear_passenger-1774626916511.jpg> (referer: None)
2026-03-29 20:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4359/20404359/interior_boot-1774713171118.jpg> (referer: None)
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659dafd10>
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120af6f0-63fc-5b28-b658-d5524b422829/120af6f0-63fc-5b28-b658-d5524b422829_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4057%252F20364057%252Fexterior_front_passenger-1774623694995.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4057/20364057/exterior_front_passenger-1774623694995.jpg saved to cache
2026-03-29 20:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 120af6f0-63fc-5b28-b658-d5524b422829
2026-03-29 20:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9030/20459030/exterior_rear_passenger-1774621660349.jpg> (referer: None)
2026-03-29 20:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3011/20493011/exterior_rear_driver-1774780106966.jpg> (referer: None)
2026-03-29 20:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3011/20493011/exterior_front_driver-1774780074564.jpg> (referer: None)
2026-03-29 20:11:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf43210>
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa60fb8d-0c5a-520b-85d7-28248fe15f71/fa60fb8d-0c5a-520b-85d7-28248fe15f71_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9789%252F20489789%252Finterior_boot-1774708907450.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9789/20489789/interior_boot-1774708907450.jpg saved to cache
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fa60fb8d-0c5a-520b-85d7-28248fe15f71
2026-03-29 20:11:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf0e2d0>
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa60fb8d-0c5a-520b-85d7-28248fe15f71/fa60fb8d-0c5a-520b-85d7-28248fe15f71_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9789%252F20489789%252Finterior_front_seats-1774708856298.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9789/20489789/interior_front_seats-1774708856298.jpg saved to cache
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fa60fb8d-0c5a-520b-85d7-28248fe15f71
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e86790>
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120af6f0-63fc-5b28-b658-d5524b422829/120af6f0-63fc-5b28-b658-d5524b422829_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4057%252F20364057%252Fexterior_rear_passenger-1774626916511.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4057/20364057/exterior_rear_passenger-1774626916511.jpg saved to cache
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 120af6f0-63fc-5b28-b658-d5524b422829
2026-03-29 20:11:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d9ee10>
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39367f78-574d-5919-ba05-6796acb4f138/39367f78-574d-5919-ba05-6796acb4f138_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4359%252F20404359%252Finterior_boot-1774713171118.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4359/20404359/interior_boot-1774713171118.jpg saved to cache
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 39367f78-574d-5919-ba05-6796acb4f138
2026-03-29 20:11:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8452/11018452/exterior_rear_driver-1774692338934.jpeg> (referer: None)
2026-03-29 20:11:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4057/20364057/interior_rear_seats-1774624182721.jpg> (referer: None)
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d9e810>
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75193405-f3d2-518f-a4e0-0725e03a8299/75193405-f3d2-518f-a4e0-0725e03a8299_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9030%252F20459030%252Fexterior_rear_passenger-1774621660349.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9030/20459030/exterior_rear_passenger-1774621660349.jpg saved to cache
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 75193405-f3d2-518f-a4e0-0725e03a8299
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659015c90>
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b9ce8e-9596-516e-9334-697510f61bfc/80b9ce8e-9596-516e-9334-697510f61bfc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3011%252F20493011%252Fexterior_rear_driver-1774780106966.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3011/20493011/exterior_rear_driver-1774780106966.jpg saved to cache
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 80b9ce8e-9596-516e-9334-697510f61bfc
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf2fcd0>
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b9ce8e-9596-516e-9334-697510f61bfc/80b9ce8e-9596-516e-9334-697510f61bfc_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3011%252F20493011%252Fexterior_front_driver-1774780074564.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3011/20493011/exterior_front_driver-1774780074564.jpg saved to cache
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80b9ce8e-9596-516e-9334-697510f61bfc
2026-03-29 20:11:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19440586.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a07090>
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59265768-860a-513b-b9a9-34a7f615361b/59265768-860a-513b-b9a9-34a7f615361b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8452%252F11018452%252Fexterior_rear_driver-1774692338934.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8452/11018452/exterior_rear_driver-1774692338934.jpeg saved to cache
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 59265768-860a-513b-b9a9-34a7f615361b
2026-03-29 20:11:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfbd890>
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120af6f0-63fc-5b28-b658-d5524b422829/120af6f0-63fc-5b28-b658-d5524b422829_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4057%252F20364057%252Finterior_rear_seats-1774624182721.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4057/20364057/interior_rear_seats-1774624182721.jpg saved to cache
2026-03-29 20:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 120af6f0-63fc-5b28-b658-d5524b422829
2026-03-29 20:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3011/20493011/instrument_cluster-1774780935302.jpg> (referer: None)
2026-03-29 20:11:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc21ff68-4ff3-5fc9-93e1-d2df0870f133 with identifier: 19440586
2026-03-29 20:11:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc21ff68-4ff3-5fc9-93e1-d2df0870f133 with scrape type 1
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dc21ff68-4ff3-5fc9-93e1-d2df0870f133
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0586%252F19440586%252Fexterior_front_driver-1774614347007.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0586/19440586/exterior_front_driver-1774614347007.jpg not downloaded yet
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0586%252F19440586%252Fexterior_rear_driver-1774614362330.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0586/19440586/exterior_rear_driver-1774614362330.jpg not downloaded yet
2026-03-29 20:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/11654403.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4359/20404359/docs_service_history-1774713293235.jpg?ixlib=js-3.8.0&auto=format&s=692ed88e91d96917947d7352a3b95730> (referer: None)
2026-03-29 20:11:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:11:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b34c90>
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b9ce8e-9596-516e-9334-697510f61bfc/80b9ce8e-9596-516e-9334-697510f61bfc_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3011%252F20493011%252Finstrument_cluster-1774780935302.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3011/20493011/instrument_cluster-1774780935302.jpg saved to cache
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 80b9ce8e-9596-516e-9334-697510f61bfc
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0586%252F19440586%252Fexterior_front_passenger-1774614387241.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0586/19440586/exterior_front_passenger-1774614387241.jpg not downloaded yet
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0586%252F19440586%252Fexterior_rear_passenger-1774614376631.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0586/19440586/exterior_rear_passenger-1774614376631.jpg not downloaded yet
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0586%252F19440586%252Finterior_front_seats-1774614626672.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0586/19440586/interior_front_seats-1774614626672.jpg not downloaded yet
2026-03-29 20:11:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02cfd17c-157b-5e91-a301-eb366935b12c with identifier: 11654403
2026-03-29 20:11:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02cfd17c-157b-5e91-a301-eb366935b12c with scrape type 1
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 02cfd17c-157b-5e91-a301-eb366935b12c
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4403%252F11654403%252Fexterior_front_driver-1774709516505.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4403/11654403/exterior_front_driver-1774709516505.jpg not downloaded yet
2026-03-29 20:11:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a4a0d0>
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39367f78-574d-5919-ba05-6796acb4f138/39367f78-574d-5919-ba05-6796acb4f138_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4359%252F20404359%252Fdocs_service_history-1774713293235.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D692ed88e91d96917947d7352a3b95730') HTTP/1.1" 204 0
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4359/20404359/docs_service_history-1774713293235.jpg?ixlib=js-3.8.0&auto=format&s=692ed88e91d96917947d7352a3b95730 saved to cache
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 39367f78-574d-5919-ba05-6796acb4f138
2026-03-29 20:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4057/20364057/interior_front_seats-1774624159955.jpg> (referer: None)
2026-03-29 20:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7498/20417498/docs_service_history-1774720335255.jpg?ixlib=js-3.8.0&auto=format&s=b98d8a0100022c5b764af60726d761c8> (referer: None)
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0586%252F19440586%252Finterior_rear_seats-1774614647730.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0586/19440586/interior_rear_seats-1774614647730.jpg not downloaded yet
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4403%252F11654403%252Fexterior_rear_driver-1774709538593.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4403/11654403/exterior_rear_driver-1774709538593.jpg not downloaded yet
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0586%252F19440586%252Finterior_dashboard-1774614726284.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0586/19440586/interior_dashboard-1774614726284.jpg not downloaded yet
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4403%252F11654403%252Fexterior_front_passenger-1774620275374.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4403/11654403/exterior_front_passenger-1774620275374.jpg not downloaded yet
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0586%252F19440586%252Finstrument_cluster-1774614739778.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0586/19440586/instrument_cluster-1774614739778.jpg not downloaded yet
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4403%252F11654403%252Fexterior_rear_passenger-1774709559272.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4403/11654403/exterior_rear_passenger-1774709559272.jpg not downloaded yet
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0586%252F19440586%252Finterior_boot-1774614732507.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0586/19440586/interior_boot-1774614732507.jpg not downloaded yet
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4403%252F11654403%252Finterior_front_seats-1774622133688.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4403/11654403/interior_front_seats-1774622133688.jpg not downloaded yet
2026-03-29 20:11:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599d4990>
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120af6f0-63fc-5b28-b658-d5524b422829/120af6f0-63fc-5b28-b658-d5524b422829_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4057%252F20364057%252Finterior_front_seats-1774624159955.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4057/20364057/interior_front_seats-1774624159955.jpg saved to cache
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 120af6f0-63fc-5b28-b658-d5524b422829
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582bdbd0>
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8563c3ea-9063-5a14-ae79-eeb65c405f5d/8563c3ea-9063-5a14-ae79-eeb65c405f5d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7498%252F20417498%252Fdocs_service_history-1774720335255.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db98d8a0100022c5b764af60726d761c8') HTTP/1.1" 204 0
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7498/20417498/docs_service_history-1774720335255.jpg?ixlib=js-3.8.0&auto=format&s=b98d8a0100022c5b764af60726d761c8 saved to cache
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8563c3ea-9063-5a14-ae79-eeb65c405f5d
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0586%252F19440586%252Fdocs_service_history-1774614803113.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfb6b09bf0a6c55f4fe31c158331f5916%27 HTTP/1.1" 200 None
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0586/19440586/docs_service_history-1774614803113.jpg?ixlib=js-3.8.0&auto=format&s=fb6b09bf0a6c55f4fe31c158331f5916 not downloaded yet
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4403%252F11654403%252Finterior_rear_seats-1774622071336.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4403/11654403/interior_rear_seats-1774622071336.jpg not downloaded yet
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4403%252F11654403%252Finterior_dashboard-1774622096234.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4403/11654403/interior_dashboard-1774622096234.jpg not downloaded yet
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4403%252F11654403%252Finterior_boot-1774709579486.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4403/11654403/interior_boot-1774709579486.jpg not downloaded yet
2026-03-29 20:11:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8452/11018452/11018452-interior_dashboard-modified-1774692922246.jpeg> (referer: None)
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4403%252F11654403%252Fdocs_service_history-1774709688995.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7bc582da0fbb146c14aa4c0696ffa55d%27 HTTP/1.1" 200 None
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4403/11654403/docs_service_history-1774709688995.jpg?ixlib=js-3.8.0&auto=format&s=7bc582da0fbb146c14aa4c0696ffa55d not downloaded yet
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4403%252F11654403%252Fdamage_scratches-1774620315850.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4403/11654403/damage_scratches-1774620315850.jpg not downloaded yet
2026-03-29 20:11:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3011/20493011/interior_rear_seats-1774780666574.jpg> (referer: None)
2026-03-29 20:11:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8452/11018452/exterior_rear_passenger-1774692354084.jpeg> (referer: None)
2026-03-29 20:11:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8452/11018452/interior_rear_seats-1774692188414.jpeg> (referer: None)
2026-03-29 20:11:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8452/11018452/instrument_cluster-1774692278235.jpeg> (referer: None)
2026-03-29 20:11:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/9030/20459030/docs_service_history-1774774002886.jpg?ixlib=js-3.8.0&auto=format&s=c3c7c1ef6de0da97986e0c5d81a0231b> (referer: None)
2026-03-29 20:11:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8452/11018452/exterior_front_passenger-1774692370525.jpeg> (referer: None)
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c5a6d0>
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59265768-860a-513b-b9a9-34a7f615361b/59265768-860a-513b-b9a9-34a7f615361b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8452%252F11018452%252F11018452-interior_dashboard-modified-1774692922246.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8452/11018452/11018452-interior_dashboard-modified-1774692922246.jpeg saved to cache
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 59265768-860a-513b-b9a9-34a7f615361b
2026-03-29 20:11:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:11:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583007d0>
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b9ce8e-9596-516e-9334-697510f61bfc/80b9ce8e-9596-516e-9334-697510f61bfc_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3011%252F20493011%252Finterior_rear_seats-1774780666574.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3011/20493011/interior_rear_seats-1774780666574.jpg saved to cache
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 80b9ce8e-9596-516e-9334-697510f61bfc
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658302b50>
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59265768-860a-513b-b9a9-34a7f615361b/59265768-860a-513b-b9a9-34a7f615361b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8452%252F11018452%252Fexterior_rear_passenger-1774692354084.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8452/11018452/exterior_rear_passenger-1774692354084.jpeg saved to cache
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 59265768-860a-513b-b9a9-34a7f615361b
2026-03-29 20:11:49 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:49 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:49 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x000\xdbq\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xfc6\x000\xd1a\x00\x00\x00\x00'
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a1ea90>
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59265768-860a-513b-b9a9-34a7f615361b/59265768-860a-513b-b9a9-34a7f615361b_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8452%252F11018452%252Finterior_rear_seats-1774692188414.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8452/11018452/interior_rear_seats-1774692188414.jpeg saved to cache
2026-03-29 20:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 59265768-860a-513b-b9a9-34a7f615361b
2026-03-29 20:11:49 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:49 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:49 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00#~\x07\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01~`\x00#s\xf7\x00\x00\x00\x00'
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cd5e10>
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59265768-860a-513b-b9a9-34a7f615361b/59265768-860a-513b-b9a9-34a7f615361b_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8452%252F11018452%252Finstrument_cluster-1774692278235.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8452/11018452/instrument_cluster-1774692278235.jpeg saved to cache
2026-03-29 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 59265768-860a-513b-b9a9-34a7f615361b
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bcec10>
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75193405-f3d2-518f-a4e0-0725e03a8299/75193405-f3d2-518f-a4e0-0725e03a8299_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9030%252F20459030%252Fdocs_service_history-1774774002886.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc3c7c1ef6de0da97986e0c5d81a0231b') HTTP/1.1" 204 0
2026-03-29 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9030/20459030/docs_service_history-1774774002886.jpg?ixlib=js-3.8.0&auto=format&s=c3c7c1ef6de0da97986e0c5d81a0231b saved to cache
2026-03-29 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 75193405-f3d2-518f-a4e0-0725e03a8299
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cd5950>
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59265768-860a-513b-b9a9-34a7f615361b/59265768-860a-513b-b9a9-34a7f615361b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8452%252F11018452%252Fexterior_front_passenger-1774692370525.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8452/11018452/exterior_front_passenger-1774692370525.jpeg saved to cache
2026-03-29 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 59265768-860a-513b-b9a9-34a7f615361b
2026-03-29 20:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8452/11018452/docs_service_history-1774690108962.jpeg?ixlib=js-3.8.0&auto=format&s=f253335443f61cf30b1b68bde9003be4> (referer: None)
2026-03-29 20:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/9030/20459030/docs_service_history-1774711188774.jpg?ixlib=js-3.8.0&auto=format&s=bce30896d22ca09478b484832918d975> (referer: None)
2026-03-29 20:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8452/11018452/interior_front_seats-1774692137754.jpeg> (referer: None)
2026-03-29 20:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8452/11018452/interior_boot-1774692314698.jpeg> (referer: None)
2026-03-29 20:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7498/20417498/interior_boot-1774695205620.jpg> (referer: None)
2026-03-29 20:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4403/11654403/interior_dashboard-1774622096234.jpg> (referer: None)
2026-03-29 20:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4403/11654403/interior_front_seats-1774622133688.jpg> (referer: None)
2026-03-29 20:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0586/19440586/docs_service_history-1774614803113.jpg?ixlib=js-3.8.0&auto=format&s=fb6b09bf0a6c55f4fe31c158331f5916> (referer: None)
2026-03-29 20:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4403/11654403/interior_rear_seats-1774622071336.jpg> (referer: None)
2026-03-29 20:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0586/19440586/interior_boot-1774614732507.jpg> (referer: None)
2026-03-29 20:11:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a83750>
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59265768-860a-513b-b9a9-34a7f615361b/59265768-860a-513b-b9a9-34a7f615361b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8452%252F11018452%252Fdocs_service_history-1774690108962.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df253335443f61cf30b1b68bde9003be4') HTTP/1.1" 204 0
2026-03-29 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8452/11018452/docs_service_history-1774690108962.jpeg?ixlib=js-3.8.0&auto=format&s=f253335443f61cf30b1b68bde9003be4 saved to cache
2026-03-29 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 59265768-860a-513b-b9a9-34a7f615361b
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be02010>
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75193405-f3d2-518f-a4e0-0725e03a8299/75193405-f3d2-518f-a4e0-0725e03a8299_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9030%252F20459030%252Fdocs_service_history-1774711188774.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbce30896d22ca09478b484832918d975') HTTP/1.1" 204 0
2026-03-29 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9030/20459030/docs_service_history-1774711188774.jpg?ixlib=js-3.8.0&auto=format&s=bce30896d22ca09478b484832918d975 saved to cache
2026-03-29 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 75193405-f3d2-518f-a4e0-0725e03a8299
2026-03-29 20:11:50 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:50 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:50 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x006\x8f\x94\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02WF\x006\x85\x84\x00\x00\x00\x00'
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be01dd0>
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59265768-860a-513b-b9a9-34a7f615361b/59265768-860a-513b-b9a9-34a7f615361b_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8452%252F11018452%252Finterior_front_seats-1774692137754.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8452/11018452/interior_front_seats-1774692137754.jpeg saved to cache
2026-03-29 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 59265768-860a-513b-b9a9-34a7f615361b
2026-03-29 20:11:50 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:11:50 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:11:50 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00;K\xe4\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03\x05Z\x00;A\xd4\x00\x00\x00\x00'
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584dcf50>
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59265768-860a-513b-b9a9-34a7f615361b/59265768-860a-513b-b9a9-34a7f615361b_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8452%252F11018452%252Finterior_boot-1774692314698.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8452/11018452/interior_boot-1774692314698.jpeg saved to cache
2026-03-29 20:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 59265768-860a-513b-b9a9-34a7f615361b
2026-03-29 20:11:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:11:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b47bd0>
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8563c3ea-9063-5a14-ae79-eeb65c405f5d/8563c3ea-9063-5a14-ae79-eeb65c405f5d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7498%252F20417498%252Finterior_boot-1774695205620.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7498/20417498/interior_boot-1774695205620.jpg saved to cache
2026-03-29 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8563c3ea-9063-5a14-ae79-eeb65c405f5d
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ce22d0>
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02cfd17c-157b-5e91-a301-eb366935b12c/02cfd17c-157b-5e91-a301-eb366935b12c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4403%252F11654403%252Finterior_dashboard-1774622096234.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4403/11654403/interior_dashboard-1774622096234.jpg saved to cache
2026-03-29 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 02cfd17c-157b-5e91-a301-eb366935b12c
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659aa6c90>
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02cfd17c-157b-5e91-a301-eb366935b12c/02cfd17c-157b-5e91-a301-eb366935b12c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4403%252F11654403%252Finterior_front_seats-1774622133688.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4403/11654403/interior_front_seats-1774622133688.jpg saved to cache
2026-03-29 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 02cfd17c-157b-5e91-a301-eb366935b12c
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ce0110>
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc21ff68-4ff3-5fc9-93e1-d2df0870f133/dc21ff68-4ff3-5fc9-93e1-d2df0870f133_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0586%252F19440586%252Fdocs_service_history-1774614803113.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfb6b09bf0a6c55f4fe31c158331f5916') HTTP/1.1" 204 0
2026-03-29 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0586/19440586/docs_service_history-1774614803113.jpg?ixlib=js-3.8.0&auto=format&s=fb6b09bf0a6c55f4fe31c158331f5916 saved to cache
2026-03-29 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dc21ff68-4ff3-5fc9-93e1-d2df0870f133
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ce2690>
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02cfd17c-157b-5e91-a301-eb366935b12c/02cfd17c-157b-5e91-a301-eb366935b12c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4403%252F11654403%252Finterior_rear_seats-1774622071336.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4403/11654403/interior_rear_seats-1774622071336.jpg saved to cache
2026-03-29 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 02cfd17c-157b-5e91-a301-eb366935b12c
2026-03-29 20:11:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659aa79d0>
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc21ff68-4ff3-5fc9-93e1-d2df0870f133/dc21ff68-4ff3-5fc9-93e1-d2df0870f133_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0586%252F19440586%252Finterior_boot-1774614732507.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0586/19440586/interior_boot-1774614732507.jpg saved to cache
2026-03-29 20:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dc21ff68-4ff3-5fc9-93e1-d2df0870f133
2026-03-29 20:11:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/4403/11654403/docs_service_history-1774709688995.jpg?ixlib=js-3.8.0&auto=format&s=7bc582da0fbb146c14aa4c0696ffa55d> (referer: None)
2026-03-29 20:11:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4403/11654403/interior_boot-1774709579486.jpg> (referer: None)
2026-03-29 20:11:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4403/11654403/damage_scratches-1774620315850.jpg> (referer: None)
2026-03-29 20:11:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4403/11654403/exterior_front_passenger-1774620275374.jpg> (referer: None)
2026-03-29 20:11:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0586/19440586/interior_dashboard-1774614726284.jpg> (referer: None)
2026-03-29 20:11:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4403/11654403/exterior_rear_passenger-1774709559272.jpg> (referer: None)
2026-03-29 20:11:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0586/19440586/instrument_cluster-1774614739778.jpg> (referer: None)
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b83b90>
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02cfd17c-157b-5e91-a301-eb366935b12c/02cfd17c-157b-5e91-a301-eb366935b12c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4403%252F11654403%252Fdocs_service_history-1774709688995.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7bc582da0fbb146c14aa4c0696ffa55d') HTTP/1.1" 204 0
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4403/11654403/docs_service_history-1774709688995.jpg?ixlib=js-3.8.0&auto=format&s=7bc582da0fbb146c14aa4c0696ffa55d saved to cache
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 02cfd17c-157b-5e91-a301-eb366935b12c
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658301110>
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02cfd17c-157b-5e91-a301-eb366935b12c/02cfd17c-157b-5e91-a301-eb366935b12c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4403%252F11654403%252Finterior_boot-1774709579486.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4403/11654403/interior_boot-1774709579486.jpg saved to cache
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 02cfd17c-157b-5e91-a301-eb366935b12c
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d311d0>
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02cfd17c-157b-5e91-a301-eb366935b12c/02cfd17c-157b-5e91-a301-eb366935b12c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4403%252F11654403%252Fdamage_scratches-1774620315850.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4403/11654403/damage_scratches-1774620315850.jpg saved to cache
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 02cfd17c-157b-5e91-a301-eb366935b12c
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658edcc90>
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02cfd17c-157b-5e91-a301-eb366935b12c/02cfd17c-157b-5e91-a301-eb366935b12c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4403%252F11654403%252Fexterior_front_passenger-1774620275374.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4403/11654403/exterior_front_passenger-1774620275374.jpg saved to cache
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 02cfd17c-157b-5e91-a301-eb366935b12c
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d88ed0>
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc21ff68-4ff3-5fc9-93e1-d2df0870f133/dc21ff68-4ff3-5fc9-93e1-d2df0870f133_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0586%252F19440586%252Finterior_dashboard-1774614726284.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0586/19440586/interior_dashboard-1774614726284.jpg saved to cache
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dc21ff68-4ff3-5fc9-93e1-d2df0870f133
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658699890>
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02cfd17c-157b-5e91-a301-eb366935b12c/02cfd17c-157b-5e91-a301-eb366935b12c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4403%252F11654403%252Fexterior_rear_passenger-1774709559272.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4403/11654403/exterior_rear_passenger-1774709559272.jpg saved to cache
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 02cfd17c-157b-5e91-a301-eb366935b12c
2026-03-29 20:11:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658364d50>
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc21ff68-4ff3-5fc9-93e1-d2df0870f133/dc21ff68-4ff3-5fc9-93e1-d2df0870f133_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0586%252F19440586%252Finstrument_cluster-1774614739778.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0586/19440586/instrument_cluster-1774614739778.jpg saved to cache
2026-03-29 20:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dc21ff68-4ff3-5fc9-93e1-d2df0870f133
2026-03-29 20:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9030/20459030/interior_dashboard-1774621058158.jpg> (referer: None)
2026-03-29 20:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0586/19440586/exterior_rear_passenger-1774614376631.jpg> (referer: None)
2026-03-29 20:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7498/20417498/interior_dashboard-1774788081583.jpg> (referer: None)
2026-03-29 20:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0586/19440586/exterior_front_driver-1774614347007.jpg> (referer: None)
2026-03-29 20:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7498/20417498/instrument_cluster-1774695224342.jpg> (referer: None)
2026-03-29 20:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4403/11654403/exterior_rear_driver-1774709538593.jpg> (referer: None)
2026-03-29 20:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0586/19440586/exterior_front_passenger-1774614387241.jpg> (referer: None)
2026-03-29 20:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0586/19440586/exterior_rear_driver-1774614362330.jpg> (referer: None)
2026-03-29 20:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9030/20459030/interior_boot-1774621006085.jpg> (referer: None)
2026-03-29 20:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0586/19440586/interior_front_seats-1774614626672.jpg> (referer: None)
2026-03-29 20:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0586/19440586/interior_rear_seats-1774614647730.jpg> (referer: None)
2026-03-29 20:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4403/11654403/exterior_front_driver-1774709516505.jpg> (referer: None)
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658537cd0>
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75193405-f3d2-518f-a4e0-0725e03a8299/75193405-f3d2-518f-a4e0-0725e03a8299_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9030%252F20459030%252Finterior_dashboard-1774621058158.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9030/20459030/interior_dashboard-1774621058158.jpg saved to cache
2026-03-29 20:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 75193405-f3d2-518f-a4e0-0725e03a8299
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658535e10>
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc21ff68-4ff3-5fc9-93e1-d2df0870f133/dc21ff68-4ff3-5fc9-93e1-d2df0870f133_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0586%252F19440586%252Fexterior_rear_passenger-1774614376631.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0586/19440586/exterior_rear_passenger-1774614376631.jpg saved to cache
2026-03-29 20:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dc21ff68-4ff3-5fc9-93e1-d2df0870f133
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a7eb90>
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8563c3ea-9063-5a14-ae79-eeb65c405f5d/8563c3ea-9063-5a14-ae79-eeb65c405f5d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7498%252F20417498%252Finterior_dashboard-1774788081583.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7498/20417498/interior_dashboard-1774788081583.jpg saved to cache
2026-03-29 20:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8563c3ea-9063-5a14-ae79-eeb65c405f5d
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658524490>
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc21ff68-4ff3-5fc9-93e1-d2df0870f133/dc21ff68-4ff3-5fc9-93e1-d2df0870f133_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0586%252F19440586%252Fexterior_front_driver-1774614347007.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0586/19440586/exterior_front_driver-1774614347007.jpg saved to cache
2026-03-29 20:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc21ff68-4ff3-5fc9-93e1-d2df0870f133
2026-03-29 20:11:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:11:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a72f90>
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8563c3ea-9063-5a14-ae79-eeb65c405f5d/8563c3ea-9063-5a14-ae79-eeb65c405f5d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7498%252F20417498%252Finstrument_cluster-1774695224342.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7498/20417498/instrument_cluster-1774695224342.jpg saved to cache
2026-03-29 20:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8563c3ea-9063-5a14-ae79-eeb65c405f5d
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a420d0>
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02cfd17c-157b-5e91-a301-eb366935b12c/02cfd17c-157b-5e91-a301-eb366935b12c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4403%252F11654403%252Fexterior_rear_driver-1774709538593.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4403/11654403/exterior_rear_driver-1774709538593.jpg saved to cache
2026-03-29 20:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 02cfd17c-157b-5e91-a301-eb366935b12c
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586ebb50>
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc21ff68-4ff3-5fc9-93e1-d2df0870f133/dc21ff68-4ff3-5fc9-93e1-d2df0870f133_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0586%252F19440586%252Fexterior_front_passenger-1774614387241.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0586/19440586/exterior_front_passenger-1774614387241.jpg saved to cache
2026-03-29 20:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dc21ff68-4ff3-5fc9-93e1-d2df0870f133
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d751d0>
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc21ff68-4ff3-5fc9-93e1-d2df0870f133/dc21ff68-4ff3-5fc9-93e1-d2df0870f133_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0586%252F19440586%252Fexterior_rear_driver-1774614362330.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0586/19440586/exterior_rear_driver-1774614362330.jpg saved to cache
2026-03-29 20:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dc21ff68-4ff3-5fc9-93e1-d2df0870f133
2026-03-29 20:11:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a7fe50>
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75193405-f3d2-518f-a4e0-0725e03a8299/75193405-f3d2-518f-a4e0-0725e03a8299_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9030%252F20459030%252Finterior_boot-1774621006085.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9030/20459030/interior_boot-1774621006085.jpg saved to cache
2026-03-29 20:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 75193405-f3d2-518f-a4e0-0725e03a8299
2026-03-29 20:11:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584c3210>
2026-03-29 20:11:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc21ff68-4ff3-5fc9-93e1-d2df0870f133/dc21ff68-4ff3-5fc9-93e1-d2df0870f133_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0586%252F19440586%252Finterior_front_seats-1774614626672.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0586/19440586/interior_front_seats-1774614626672.jpg saved to cache
2026-03-29 20:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dc21ff68-4ff3-5fc9-93e1-d2df0870f133
2026-03-29 20:11:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658526310>
2026-03-29 20:11:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc21ff68-4ff3-5fc9-93e1-d2df0870f133/dc21ff68-4ff3-5fc9-93e1-d2df0870f133_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0586%252F19440586%252Finterior_rear_seats-1774614647730.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0586/19440586/interior_rear_seats-1774614647730.jpg saved to cache
2026-03-29 20:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dc21ff68-4ff3-5fc9-93e1-d2df0870f133
2026-03-29 20:11:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc21ff68-4ff3-5fc9-93e1-d2df0870f133, skipping ID generation
2026-03-29 20:11:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc21ff68-4ff3-5fc9-93e1-d2df0870f133 with scrape type 1
2026-03-29 20:11:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc21ff68-4ff3-5fc9-93e1-d2df0870f133 sending to next pipeline
2026-03-29 20:11:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: dc21ff68-4ff3-5fc9-93e1-d2df0870f133, identifier: 19440586
2026-03-29 20:11:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65843c410>
2026-03-29 20:11:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02cfd17c-157b-5e91-a301-eb366935b12c/02cfd17c-157b-5e91-a301-eb366935b12c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4403%252F11654403%252Fexterior_front_driver-1774709516505.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4403/11654403/exterior_front_driver-1774709516505.jpg saved to cache
2026-03-29 20:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 02cfd17c-157b-5e91-a301-eb366935b12c
2026-03-29 20:11:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02cfd17c-157b-5e91-a301-eb366935b12c, skipping ID generation
2026-03-29 20:11:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02cfd17c-157b-5e91-a301-eb366935b12c with scrape type 1
2026-03-29 20:11:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02cfd17c-157b-5e91-a301-eb366935b12c sending to next pipeline
2026-03-29 20:11:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 02cfd17c-157b-5e91-a301-eb366935b12c, identifier: 11654403
2026-03-29 20:11:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: dc21ff68-4ff3-5fc9-93e1-d2df0870f133 with identifier: 19440586
2026-03-29 20:11:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: dc21ff68-4ff3-5fc9-93e1-d2df0870f133 with identifier: 19440586
2026-03-29 20:11:55 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: dc21ff68-4ff3-5fc9-93e1-d2df0870f133 with identifier: 19440586 to the API
2026-03-29 20:11:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/0586/19440586/interior_rear_seats-1774614647730.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'dc21ff68-4ff3-5fc9-93e1-d2df0870f133',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'AV70 RYA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19440586',
'listing': 'auction',
'location': 'Suffolk Ipswich',
'make': 'Audi',
'model': 'A1',
'odometer': 48802,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc21ff68-4ff3-5fc9-93e1-d2df0870f133/dc21ff68-4ff3-5fc9-93e1-d2df0870f133_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2763760,
'Height': 2685,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0586/19440586/exterior_front_driver-1774614347007.jpg',
'Width': 3580},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc21ff68-4ff3-5fc9-93e1-d2df0870f133/dc21ff68-4ff3-5fc9-93e1-d2df0870f133_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2719461,
'Height': 2732,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0586/19440586/exterior_rear_driver-1774614362330.jpg',
'Width': 3642},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc21ff68-4ff3-5fc9-93e1-d2df0870f133/dc21ff68-4ff3-5fc9-93e1-d2df0870f133_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2499980,
'Height': 2720,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0586/19440586/exterior_front_passenger-1774614387241.jpg',
'Width': 3626},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc21ff68-4ff3-5fc9-93e1-d2df0870f133/dc21ff68-4ff3-5fc9-93e1-d2df0870f133_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2089057,
'Height': 2513,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0586/19440586/exterior_rear_passenger-1774614376631.jpg',
'Width': 3351},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc21ff68-4ff3-5fc9-93e1-d2df0870f133/dc21ff68-4ff3-5fc9-93e1-d2df0870f133_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3650335,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0586/19440586/interior_front_seats-1774614626672.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc21ff68-4ff3-5fc9-93e1-d2df0870f133/dc21ff68-4ff3-5fc9-93e1-d2df0870f133_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3850819,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0586/19440586/interior_rear_seats-1774614647730.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc21ff68-4ff3-5fc9-93e1-d2df0870f133/dc21ff68-4ff3-5fc9-93e1-d2df0870f133_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1882665,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0586/19440586/interior_dashboard-1774614726284.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc21ff68-4ff3-5fc9-93e1-d2df0870f133/dc21ff68-4ff3-5fc9-93e1-d2df0870f133_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2371574,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0586/19440586/instrument_cluster-1774614739778.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc21ff68-4ff3-5fc9-93e1-d2df0870f133/dc21ff68-4ff3-5fc9-93e1-d2df0870f133_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3790946,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0586/19440586/interior_boot-1774614732507.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc21ff68-4ff3-5fc9-93e1-d2df0870f133/dc21ff68-4ff3-5fc9-93e1-d2df0870f133_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2155094,
'Height': 5712,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0586/19440586/docs_service_history-1774614803113.jpg?ixlib=js-3.8.0&auto=format&s=fb6b09bf0a6c55f4fe31c158331f5916',
'Width': 4284}],
'price': 13238,
'price_includes_vat': False,
'registration_date': '2020-10-28',
'seats_number': None,
'seller_name': None,
'title': 'Audi A1 Sport 30 TFSI S-A',
'transmission': 'automatic',
'trim': 'Sport 30 TFSI S-A',
'vin': 'WAUZZZGB7MR007518',
'year': 2020}
2026-03-29 20:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719440586%27 HTTP/1.1" 200 None
2026-03-29 20:11:55 [motorway.uk] INFO: Saving data for 19440586: {'created_time': 1774815115.577095, 'last_price_update_time': 1774815115.577105, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19440586') HTTP/1.1" 204 0
2026-03-29 20:11:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 02cfd17c-157b-5e91-a301-eb366935b12c with identifier: 11654403
2026-03-29 20:11:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 02cfd17c-157b-5e91-a301-eb366935b12c with identifier: 11654403
2026-03-29 20:11:55 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 02cfd17c-157b-5e91-a301-eb366935b12c with identifier: 11654403 to the API
2026-03-29 20:11:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/4403/11654403/exterior_front_driver-1774709516505.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '02cfd17c-157b-5e91-a301-eb366935b12c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HX68 NVH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/11654403',
'listing': 'auction',
'location': 'Greater London London',
'make': 'MINI',
'model': 'Countryman',
'odometer': 28640,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 32,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02cfd17c-157b-5e91-a301-eb366935b12c/02cfd17c-157b-5e91-a301-eb366935b12c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2651137,
'Height': 2861,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4403/11654403/exterior_front_driver-1774709516505.jpg',
'Width': 3815},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02cfd17c-157b-5e91-a301-eb366935b12c/02cfd17c-157b-5e91-a301-eb366935b12c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2382361,
'Height': 2702,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4403/11654403/exterior_rear_driver-1774709538593.jpg',
'Width': 3603},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02cfd17c-157b-5e91-a301-eb366935b12c/02cfd17c-157b-5e91-a301-eb366935b12c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1977756,
'Height': 2820,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4403/11654403/exterior_front_passenger-1774620275374.jpg',
'Width': 3760},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02cfd17c-157b-5e91-a301-eb366935b12c/02cfd17c-157b-5e91-a301-eb366935b12c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2134158,
'Height': 2783,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4403/11654403/exterior_rear_passenger-1774709559272.jpg',
'Width': 3711},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02cfd17c-157b-5e91-a301-eb366935b12c/02cfd17c-157b-5e91-a301-eb366935b12c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2869190,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4403/11654403/interior_front_seats-1774622133688.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02cfd17c-157b-5e91-a301-eb366935b12c/02cfd17c-157b-5e91-a301-eb366935b12c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2517355,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4403/11654403/interior_rear_seats-1774622071336.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02cfd17c-157b-5e91-a301-eb366935b12c/02cfd17c-157b-5e91-a301-eb366935b12c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1149809,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4403/11654403/interior_dashboard-1774622096234.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02cfd17c-157b-5e91-a301-eb366935b12c/02cfd17c-157b-5e91-a301-eb366935b12c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381117,
'Height': 1568,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4403/11654403/interior_boot-1774709579486.jpg',
'Width': 2091},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02cfd17c-157b-5e91-a301-eb366935b12c/02cfd17c-157b-5e91-a301-eb366935b12c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 844990,
'Height': 2267,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/4403/11654403/docs_service_history-1774709688995.jpg?ixlib=js-3.8.0&auto=format&s=7bc582da0fbb146c14aa4c0696ffa55d',
'Width': 3023},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02cfd17c-157b-5e91-a301-eb366935b12c/02cfd17c-157b-5e91-a301-eb366935b12c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2024145,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4403/11654403/damage_scratches-1774620315850.jpg',
'Width': 3840}],
'price': 12374,
'price_includes_vat': False,
'registration_date': '2018-11-22',
'seats_number': None,
'seller_name': None,
'title': 'MINI Countryman Cooper Auto',
'transmission': 'automatic',
'trim': 'Cooper Auto',
'vin': 'WMWYW320603H67964',
'year': 2018}
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711654403%27 HTTP/1.1" 200 None
2026-03-29 20:11:56 [motorway.uk] INFO: Saving data for 11654403: {'created_time': 1774815116.01352, 'last_price_update_time': 1774815116.013534, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='11654403') HTTP/1.1" 204 0
2026-03-29 20:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7498/20417498/exterior_rear_passenger-1774694801599.jpg> (referer: None)
2026-03-29 20:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8452/11018452/exterior_front_driver-1774692511891.jpeg> (referer: None)
2026-03-29 20:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7498/20417498/interior_rear_seats-1774695126830.jpg> (referer: None)
2026-03-29 20:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7498/20417498/interior_front_seats-1774695113201.jpg> (referer: None)
2026-03-29 20:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9030/20459030/interior_front_seats-1774621117754.jpg> (referer: None)
2026-03-29 20:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9030/20459030/interior_rear_seats-1774621054412.jpg> (referer: None)
2026-03-29 20:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3011/20493011/docs_service_history-1774781207144.jpg?ixlib=js-3.8.0&auto=format&s=bca3cf2cbb93a018adbc6de29cb06d9b> (referer: None)
2026-03-29 20:11:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582dd610>
2026-03-29 20:11:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8563c3ea-9063-5a14-ae79-eeb65c405f5d/8563c3ea-9063-5a14-ae79-eeb65c405f5d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7498%252F20417498%252Fexterior_rear_passenger-1774694801599.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7498/20417498/exterior_rear_passenger-1774694801599.jpg saved to cache
2026-03-29 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8563c3ea-9063-5a14-ae79-eeb65c405f5d
2026-03-29 20:11:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582dced0>
2026-03-29 20:11:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59265768-860a-513b-b9a9-34a7f615361b/59265768-860a-513b-b9a9-34a7f615361b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8452%252F11018452%252Fexterior_front_driver-1774692511891.jpeg') HTTP/1.1" 204 0
2026-03-29 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8452/11018452/exterior_front_driver-1774692511891.jpeg saved to cache
2026-03-29 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 59265768-860a-513b-b9a9-34a7f615361b
2026-03-29 20:11:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 59265768-860a-513b-b9a9-34a7f615361b, skipping ID generation
2026-03-29 20:11:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59265768-860a-513b-b9a9-34a7f615361b with scrape type 1
2026-03-29 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 59265768-860a-513b-b9a9-34a7f615361b sending to next pipeline
2026-03-29 20:11:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 59265768-860a-513b-b9a9-34a7f615361b, identifier: 11018452
2026-03-29 20:11:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:11:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a38310>
2026-03-29 20:11:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8563c3ea-9063-5a14-ae79-eeb65c405f5d/8563c3ea-9063-5a14-ae79-eeb65c405f5d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7498%252F20417498%252Finterior_rear_seats-1774695126830.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7498/20417498/interior_rear_seats-1774695126830.jpg saved to cache
2026-03-29 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8563c3ea-9063-5a14-ae79-eeb65c405f5d
2026-03-29 20:11:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:11:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e94790>
2026-03-29 20:11:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8563c3ea-9063-5a14-ae79-eeb65c405f5d/8563c3ea-9063-5a14-ae79-eeb65c405f5d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7498%252F20417498%252Finterior_front_seats-1774695113201.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7498/20417498/interior_front_seats-1774695113201.jpg saved to cache
2026-03-29 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8563c3ea-9063-5a14-ae79-eeb65c405f5d
2026-03-29 20:11:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658537610>
2026-03-29 20:11:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75193405-f3d2-518f-a4e0-0725e03a8299/75193405-f3d2-518f-a4e0-0725e03a8299_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9030%252F20459030%252Finterior_front_seats-1774621117754.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9030/20459030/interior_front_seats-1774621117754.jpg saved to cache
2026-03-29 20:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 75193405-f3d2-518f-a4e0-0725e03a8299
2026-03-29 20:11:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e968d0>
2026-03-29 20:11:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75193405-f3d2-518f-a4e0-0725e03a8299/75193405-f3d2-518f-a4e0-0725e03a8299_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9030%252F20459030%252Finterior_rear_seats-1774621054412.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9030/20459030/interior_rear_seats-1774621054412.jpg saved to cache
2026-03-29 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 75193405-f3d2-518f-a4e0-0725e03a8299
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b47850>
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b9ce8e-9596-516e-9334-697510f61bfc/80b9ce8e-9596-516e-9334-697510f61bfc_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3011%252F20493011%252Fdocs_service_history-1774781207144.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbca3cf2cbb93a018adbc6de29cb06d9b') HTTP/1.1" 204 0
2026-03-29 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3011/20493011/docs_service_history-1774781207144.jpg?ixlib=js-3.8.0&auto=format&s=bca3cf2cbb93a018adbc6de29cb06d9b saved to cache
2026-03-29 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 80b9ce8e-9596-516e-9334-697510f61bfc
2026-03-29 20:11:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 59265768-860a-513b-b9a9-34a7f615361b with identifier: 11018452
2026-03-29 20:11:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 59265768-860a-513b-b9a9-34a7f615361b with identifier: 11018452
2026-03-29 20:11:57 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 59265768-860a-513b-b9a9-34a7f615361b with identifier: 11018452 to the API
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8452/11018452/exterior_front_driver-1774692511891.jpeg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '59265768-860a-513b-b9a9-34a7f615361b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'AJ70 VBM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/11018452',
'listing': 'auction',
'location': 'Surrey Egham',
'make': 'BMW',
'model': '1 Series',
'odometer': 67052,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59265768-860a-513b-b9a9-34a7f615361b/59265768-860a-513b-b9a9-34a7f615361b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2197649,
'Height': 2660,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8452/11018452/exterior_front_driver-1774692511891.jpeg',
'Width': 3546},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59265768-860a-513b-b9a9-34a7f615361b/59265768-860a-513b-b9a9-34a7f615361b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1630416,
'Height': 2380,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8452/11018452/exterior_rear_driver-1774692338934.jpeg',
'Width': 3173},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59265768-860a-513b-b9a9-34a7f615361b/59265768-860a-513b-b9a9-34a7f615361b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2345346,
'Height': 2764,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8452/11018452/exterior_front_passenger-1774692370525.jpeg',
'Width': 3685},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59265768-860a-513b-b9a9-34a7f615361b/59265768-860a-513b-b9a9-34a7f615361b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2128715,
'Height': 2700,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8452/11018452/exterior_rear_passenger-1774692354084.jpeg',
'Width': 3600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59265768-860a-513b-b9a9-34a7f615361b/59265768-860a-513b-b9a9-34a7f615361b_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3729114,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8452/11018452/interior_front_seats-1774692137754.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59265768-860a-513b-b9a9-34a7f615361b/59265768-860a-513b-b9a9-34a7f615361b_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3332007,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8452/11018452/interior_rear_seats-1774692188414.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59265768-860a-513b-b9a9-34a7f615361b/59265768-860a-513b-b9a9-34a7f615361b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2173203,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8452/11018452/11018452-interior_dashboard-modified-1774692922246.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59265768-860a-513b-b9a9-34a7f615361b/59265768-860a-513b-b9a9-34a7f615361b_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2423911,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8452/11018452/instrument_cluster-1774692278235.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59265768-860a-513b-b9a9-34a7f615361b/59265768-860a-513b-b9a9-34a7f615361b_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4084030,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8452/11018452/interior_boot-1774692314698.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59265768-860a-513b-b9a9-34a7f615361b/59265768-860a-513b-b9a9-34a7f615361b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3215306,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8452/11018452/docs_service_history-1774690108962.jpeg?ixlib=js-3.8.0&auto=format&s=f253335443f61cf30b1b68bde9003be4',
'Width': 4032}],
'price': 15307,
'price_includes_vat': False,
'registration_date': '2020-12-16',
'seats_number': None,
'seller_name': None,
'title': 'BMW 128TI Auto',
'transmission': 'automatic',
'trim': '128TI Auto',
'vin': 'WBA7L520X05S65380',
'year': 2020}
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711018452%27 HTTP/1.1" 200 None
2026-03-29 20:11:57 [motorway.uk] INFO: Saving data for 11018452: {'created_time': 1774815117.561928, 'last_price_update_time': 1774815117.56194, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='11018452') HTTP/1.1" 204 0
2026-03-29 20:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9030/20459030/exterior_rear_driver-1774609292492.jpg> (referer: None)
2026-03-29 20:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9030/20459030/exterior_front_driver-1774622262738.jpg> (referer: None)
2026-03-29 20:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7498/20417498/exterior_front_passenger-1774694819545.jpg> (referer: None)
2026-03-29 20:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7498/20417498/exterior_front_driver-1774694778990.jpg> (referer: None)
2026-03-29 20:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9030/20459030/exterior_front_passenger-1774773901269.jpg> (referer: None)
2026-03-29 20:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7498/20417498/exterior_rear_driver-1774694789318.jpg> (referer: None)
2026-03-29 20:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3011/20493011/interior_dashboard-1774780754001.jpg> (referer: None)
2026-03-29 20:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3011/20493011/exterior_rear_passenger-1774780145762.jpg> (referer: None)
2026-03-29 20:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4057/20364057/docs_service_history-1774625051381.jpg?ixlib=js-3.8.0&auto=format&s=38c76e075ce551861086d0f2b515c53e> (referer: None)
2026-03-29 20:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3011/20493011/interior_front_seats-1774780646435.jpg> (referer: None)
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582c4550>
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75193405-f3d2-518f-a4e0-0725e03a8299/75193405-f3d2-518f-a4e0-0725e03a8299_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9030%252F20459030%252Fexterior_rear_driver-1774609292492.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9030/20459030/exterior_rear_driver-1774609292492.jpg saved to cache
2026-03-29 20:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 75193405-f3d2-518f-a4e0-0725e03a8299
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582c54d0>
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75193405-f3d2-518f-a4e0-0725e03a8299/75193405-f3d2-518f-a4e0-0725e03a8299_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9030%252F20459030%252Fexterior_front_driver-1774622262738.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9030/20459030/exterior_front_driver-1774622262738.jpg saved to cache
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 75193405-f3d2-518f-a4e0-0725e03a8299
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bf4890>
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8563c3ea-9063-5a14-ae79-eeb65c405f5d/8563c3ea-9063-5a14-ae79-eeb65c405f5d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7498%252F20417498%252Fexterior_front_passenger-1774694819545.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7498/20417498/exterior_front_passenger-1774694819545.jpg saved to cache
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8563c3ea-9063-5a14-ae79-eeb65c405f5d
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cd6e50>
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8563c3ea-9063-5a14-ae79-eeb65c405f5d/8563c3ea-9063-5a14-ae79-eeb65c405f5d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7498%252F20417498%252Fexterior_front_driver-1774694778990.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7498/20417498/exterior_front_driver-1774694778990.jpg saved to cache
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8563c3ea-9063-5a14-ae79-eeb65c405f5d
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e1ab50>
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75193405-f3d2-518f-a4e0-0725e03a8299/75193405-f3d2-518f-a4e0-0725e03a8299_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9030%252F20459030%252Fexterior_front_passenger-1774773901269.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9030/20459030/exterior_front_passenger-1774773901269.jpg saved to cache
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 75193405-f3d2-518f-a4e0-0725e03a8299
2026-03-29 20:11:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 75193405-f3d2-518f-a4e0-0725e03a8299, skipping ID generation
2026-03-29 20:11:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75193405-f3d2-518f-a4e0-0725e03a8299 with scrape type 1
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 75193405-f3d2-518f-a4e0-0725e03a8299 sending to next pipeline
2026-03-29 20:11:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 75193405-f3d2-518f-a4e0-0725e03a8299, identifier: 20459030
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598f1cd0>
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8563c3ea-9063-5a14-ae79-eeb65c405f5d/8563c3ea-9063-5a14-ae79-eeb65c405f5d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7498%252F20417498%252Fexterior_rear_driver-1774694789318.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7498/20417498/exterior_rear_driver-1774694789318.jpg saved to cache
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8563c3ea-9063-5a14-ae79-eeb65c405f5d
2026-03-29 20:11:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8563c3ea-9063-5a14-ae79-eeb65c405f5d, skipping ID generation
2026-03-29 20:11:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8563c3ea-9063-5a14-ae79-eeb65c405f5d with scrape type 1
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8563c3ea-9063-5a14-ae79-eeb65c405f5d sending to next pipeline
2026-03-29 20:11:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8563c3ea-9063-5a14-ae79-eeb65c405f5d, identifier: 20417498
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e3db10>
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b9ce8e-9596-516e-9334-697510f61bfc/80b9ce8e-9596-516e-9334-697510f61bfc_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3011%252F20493011%252Finterior_dashboard-1774780754001.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3011/20493011/interior_dashboard-1774780754001.jpg saved to cache
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 80b9ce8e-9596-516e-9334-697510f61bfc
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65853c150>
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b9ce8e-9596-516e-9334-697510f61bfc/80b9ce8e-9596-516e-9334-697510f61bfc_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3011%252F20493011%252Fexterior_rear_passenger-1774780145762.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3011/20493011/exterior_rear_passenger-1774780145762.jpg saved to cache
2026-03-29 20:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 80b9ce8e-9596-516e-9334-697510f61bfc
2026-03-29 20:11:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:11:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e1af90>
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120af6f0-63fc-5b28-b658-d5524b422829/120af6f0-63fc-5b28-b658-d5524b422829_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4057%252F20364057%252Fdocs_service_history-1774625051381.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D38c76e075ce551861086d0f2b515c53e') HTTP/1.1" 204 0
2026-03-29 20:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4057/20364057/docs_service_history-1774625051381.jpg?ixlib=js-3.8.0&auto=format&s=38c76e075ce551861086d0f2b515c53e saved to cache
2026-03-29 20:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 120af6f0-63fc-5b28-b658-d5524b422829
2026-03-29 20:11:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:11:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:11:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:11:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:11:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:11:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65841fa90>
2026-03-29 20:11:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:11:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b9ce8e-9596-516e-9334-697510f61bfc/80b9ce8e-9596-516e-9334-697510f61bfc_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3011%252F20493011%252Finterior_front_seats-1774780646435.jpg') HTTP/1.1" 204 0
2026-03-29 20:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3011/20493011/interior_front_seats-1774780646435.jpg saved to cache
2026-03-29 20:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 80b9ce8e-9596-516e-9334-697510f61bfc
2026-03-29 20:11:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 75193405-f3d2-518f-a4e0-0725e03a8299 with identifier: 20459030
2026-03-29 20:11:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 75193405-f3d2-518f-a4e0-0725e03a8299 with identifier: 20459030
2026-03-29 20:11:59 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 75193405-f3d2-518f-a4e0-0725e03a8299 with identifier: 20459030 to the API
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:11:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/9030/20459030/exterior_front_passenger-1774773901269.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '75193405-f3d2-518f-a4e0-0725e03a8299',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CV66 YHS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20459030',
'listing': 'auction',
'location': 'West Sussex Littlehampton',
'make': 'Audi',
'model': 'TT',
'odometer': 44340,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75193405-f3d2-518f-a4e0-0725e03a8299/75193405-f3d2-518f-a4e0-0725e03a8299_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2096663,
'Height': 2669,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9030/20459030/exterior_front_driver-1774622262738.jpg',
'Width': 3559},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75193405-f3d2-518f-a4e0-0725e03a8299/75193405-f3d2-518f-a4e0-0725e03a8299_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1393983,
'Height': 2591,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9030/20459030/exterior_rear_driver-1774609292492.jpg',
'Width': 3454},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75193405-f3d2-518f-a4e0-0725e03a8299/75193405-f3d2-518f-a4e0-0725e03a8299_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1688366,
'Height': 2606,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9030/20459030/exterior_front_passenger-1774773901269.jpg',
'Width': 3475},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75193405-f3d2-518f-a4e0-0725e03a8299/75193405-f3d2-518f-a4e0-0725e03a8299_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1578029,
'Height': 2561,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9030/20459030/exterior_rear_passenger-1774621660349.jpg',
'Width': 3415},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75193405-f3d2-518f-a4e0-0725e03a8299/75193405-f3d2-518f-a4e0-0725e03a8299_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3333767,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9030/20459030/interior_front_seats-1774621117754.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75193405-f3d2-518f-a4e0-0725e03a8299/75193405-f3d2-518f-a4e0-0725e03a8299_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3748685,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9030/20459030/interior_rear_seats-1774621054412.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75193405-f3d2-518f-a4e0-0725e03a8299/75193405-f3d2-518f-a4e0-0725e03a8299_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1989370,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9030/20459030/interior_dashboard-1774621058158.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75193405-f3d2-518f-a4e0-0725e03a8299/75193405-f3d2-518f-a4e0-0725e03a8299_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3443801,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9030/20459030/interior_boot-1774621006085.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75193405-f3d2-518f-a4e0-0725e03a8299/75193405-f3d2-518f-a4e0-0725e03a8299_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2244382,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/9030/20459030/docs_service_history-1774774002886.jpg?ixlib=js-3.8.0&auto=format&s=c3c7c1ef6de0da97986e0c5d81a0231b',
'Width': 3024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75193405-f3d2-518f-a4e0-0725e03a8299/75193405-f3d2-518f-a4e0-0725e03a8299_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3387042,
'Height': 3791,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/9030/20459030/docs_service_history-1774711188774.jpg?ixlib=js-3.8.0&auto=format&s=bce30896d22ca09478b484832918d975',
'Width': 5055}],
'price': 10534,
'price_includes_vat': False,
'registration_date': '2016-09-30',
'seats_number': None,
'seller_name': None,
'title': 'Audi TT Sport TDI Ultra',
'transmission': 'manual',
'trim': 'Sport TDI Ultra',
'vin': 'TRUZZZFV0H1006719',
'year': 2016}
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720459030%27 HTTP/1.1" 200 None
2026-03-29 20:11:59 [motorway.uk] INFO: Saving data for 20459030: {'created_time': 1774815119.593591, 'last_price_update_time': 1774815119.593603, 'auction_closing_time': 1774884600.0}
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20459030') HTTP/1.1" 204 0
2026-03-29 20:11:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8563c3ea-9063-5a14-ae79-eeb65c405f5d with identifier: 20417498
2026-03-29 20:11:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8563c3ea-9063-5a14-ae79-eeb65c405f5d with identifier: 20417498
2026-03-29 20:11:59 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8563c3ea-9063-5a14-ae79-eeb65c405f5d with identifier: 20417498 to the API
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:11:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7498/20417498/exterior_rear_driver-1774694789318.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '8563c3ea-9063-5a14-ae79-eeb65c405f5d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'AD72 FYO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20417498',
'listing': 'auction',
'location': 'Cambridgeshire Huntingdon',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 36965,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8563c3ea-9063-5a14-ae79-eeb65c405f5d/8563c3ea-9063-5a14-ae79-eeb65c405f5d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1917335,
'Height': 2608,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7498/20417498/exterior_front_driver-1774694778990.jpg',
'Width': 3477},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8563c3ea-9063-5a14-ae79-eeb65c405f5d/8563c3ea-9063-5a14-ae79-eeb65c405f5d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1864477,
'Height': 2658,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7498/20417498/exterior_rear_driver-1774694789318.jpg',
'Width': 3544},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8563c3ea-9063-5a14-ae79-eeb65c405f5d/8563c3ea-9063-5a14-ae79-eeb65c405f5d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1482227,
'Height': 2378,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7498/20417498/exterior_front_passenger-1774694819545.jpg',
'Width': 3170},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8563c3ea-9063-5a14-ae79-eeb65c405f5d/8563c3ea-9063-5a14-ae79-eeb65c405f5d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1349986,
'Height': 2258,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7498/20417498/exterior_rear_passenger-1774694801599.jpg',
'Width': 3010},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8563c3ea-9063-5a14-ae79-eeb65c405f5d/8563c3ea-9063-5a14-ae79-eeb65c405f5d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3213100,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7498/20417498/interior_front_seats-1774695113201.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8563c3ea-9063-5a14-ae79-eeb65c405f5d/8563c3ea-9063-5a14-ae79-eeb65c405f5d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3132631,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7498/20417498/interior_rear_seats-1774695126830.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8563c3ea-9063-5a14-ae79-eeb65c405f5d/8563c3ea-9063-5a14-ae79-eeb65c405f5d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2114479,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7498/20417498/interior_dashboard-1774788081583.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8563c3ea-9063-5a14-ae79-eeb65c405f5d/8563c3ea-9063-5a14-ae79-eeb65c405f5d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2404277,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7498/20417498/instrument_cluster-1774695224342.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8563c3ea-9063-5a14-ae79-eeb65c405f5d/8563c3ea-9063-5a14-ae79-eeb65c405f5d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3873843,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7498/20417498/interior_boot-1774695205620.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8563c3ea-9063-5a14-ae79-eeb65c405f5d/8563c3ea-9063-5a14-ae79-eeb65c405f5d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354900,
'Height': 2799,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7498/20417498/docs_service_history-1774720335255.jpg?ixlib=js-3.8.0&auto=format&s=b98d8a0100022c5b764af60726d761c8',
'Width': 1921}],
'price': 22296,
'price_includes_vat': False,
'registration_date': '2023-02-14',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Range Rover Velar D MHEV Auto',
'transmission': 'automatic',
'trim': 'Velar D MHEV Auto',
'vin': 'SALYA2AN6PA364071',
'year': 2023}
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720417498%27 HTTP/1.1" 200 None
2026-03-29 20:12:00 [motorway.uk] INFO: Saving data for 20417498: {'created_time': 1774815120.072683, 'last_price_update_time': 1774815120.072699, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20417498') HTTP/1.1" 204 0
2026-03-29 20:12:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4057/20364057/exterior_front_driver-1774623649374.jpg> (referer: None)
2026-03-29 20:12:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3011/20493011/interior_boot-1774780719625.jpg> (referer: None)
2026-03-29 20:12:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9789/20489789/exterior_rear_driver-1774708519356.jpg> (referer: None)
2026-03-29 20:12:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4359/20404359/interior_dashboard-1774713152904.jpg> (referer: None)
2026-03-29 20:12:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4057/20364057/interior_dashboard-1774681799078.jpg> (referer: None)
2026-03-29 20:12:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3011/20493011/exterior_front_passenger-1774780161181.jpg> (referer: None)
2026-03-29 20:12:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4057/20364057/instrument_cluster-1774624261079.jpg> (referer: None)
2026-03-29 20:12:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9564/3909564/interior_boot-1774694050083.jpeg> (referer: None)
2026-03-29 20:12:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4057/20364057/interior_boot-1774624263069.jpg> (referer: None)
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b66290>
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120af6f0-63fc-5b28-b658-d5524b422829/120af6f0-63fc-5b28-b658-d5524b422829_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4057%252F20364057%252Fexterior_front_driver-1774623649374.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4057/20364057/exterior_front_driver-1774623649374.jpg saved to cache
2026-03-29 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 120af6f0-63fc-5b28-b658-d5524b422829
2026-03-29 20:12:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:12:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582d5590>
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b9ce8e-9596-516e-9334-697510f61bfc/80b9ce8e-9596-516e-9334-697510f61bfc_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3011%252F20493011%252Finterior_boot-1774780719625.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3011/20493011/interior_boot-1774780719625.jpg saved to cache
2026-03-29 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 80b9ce8e-9596-516e-9334-697510f61bfc
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65853c450>
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa60fb8d-0c5a-520b-85d7-28248fe15f71/fa60fb8d-0c5a-520b-85d7-28248fe15f71_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9789%252F20489789%252Fexterior_rear_driver-1774708519356.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9789/20489789/exterior_rear_driver-1774708519356.jpg saved to cache
2026-03-29 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fa60fb8d-0c5a-520b-85d7-28248fe15f71
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65900b7d0>
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39367f78-574d-5919-ba05-6796acb4f138/39367f78-574d-5919-ba05-6796acb4f138_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4359%252F20404359%252Finterior_dashboard-1774713152904.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4359/20404359/interior_dashboard-1774713152904.jpg saved to cache
2026-03-29 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 39367f78-574d-5919-ba05-6796acb4f138
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a1ac10>
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120af6f0-63fc-5b28-b658-d5524b422829/120af6f0-63fc-5b28-b658-d5524b422829_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4057%252F20364057%252Finterior_dashboard-1774681799078.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4057/20364057/interior_dashboard-1774681799078.jpg saved to cache
2026-03-29 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 120af6f0-63fc-5b28-b658-d5524b422829
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65998ca10>
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b9ce8e-9596-516e-9334-697510f61bfc/80b9ce8e-9596-516e-9334-697510f61bfc_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3011%252F20493011%252Fexterior_front_passenger-1774780161181.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3011/20493011/exterior_front_passenger-1774780161181.jpg saved to cache
2026-03-29 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 80b9ce8e-9596-516e-9334-697510f61bfc
2026-03-29 20:12:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80b9ce8e-9596-516e-9334-697510f61bfc, skipping ID generation
2026-03-29 20:12:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80b9ce8e-9596-516e-9334-697510f61bfc with scrape type 1
2026-03-29 20:12:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 80b9ce8e-9596-516e-9334-697510f61bfc sending to next pipeline
2026-03-29 20:12:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 80b9ce8e-9596-516e-9334-697510f61bfc, identifier: 20493011
2026-03-29 20:12:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c62350>
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120af6f0-63fc-5b28-b658-d5524b422829/120af6f0-63fc-5b28-b658-d5524b422829_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4057%252F20364057%252Finstrument_cluster-1774624261079.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4057/20364057/instrument_cluster-1774624261079.jpg saved to cache
2026-03-29 20:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 120af6f0-63fc-5b28-b658-d5524b422829
2026-03-29 20:12:01 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:01 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:01 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b"\x00\x03\x00\x00\x00'`\xfc\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xf8\x17\x00'W\xa0\x00\x00\x00\x00"
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65900b490>
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db2fee49-d68f-5e30-bf65-b160a07ccdb5/db2fee49-d68f-5e30-bf65-b160a07ccdb5_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9564%252F3909564%252Finterior_boot-1774694050083.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9564/3909564/interior_boot-1774694050083.jpeg saved to cache
2026-03-29 20:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item db2fee49-d68f-5e30-bf65-b160a07ccdb5
2026-03-29 20:12:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a1a010>
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120af6f0-63fc-5b28-b658-d5524b422829/120af6f0-63fc-5b28-b658-d5524b422829_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4057%252F20364057%252Finterior_boot-1774624263069.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4057/20364057/interior_boot-1774624263069.jpg saved to cache
2026-03-29 20:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 120af6f0-63fc-5b28-b658-d5524b422829
2026-03-29 20:12:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 120af6f0-63fc-5b28-b658-d5524b422829, skipping ID generation
2026-03-29 20:12:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 120af6f0-63fc-5b28-b658-d5524b422829 with scrape type 1
2026-03-29 20:12:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 120af6f0-63fc-5b28-b658-d5524b422829 sending to next pipeline
2026-03-29 20:12:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 120af6f0-63fc-5b28-b658-d5524b422829, identifier: 20364057
2026-03-29 20:12:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 80b9ce8e-9596-516e-9334-697510f61bfc with identifier: 20493011
2026-03-29 20:12:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 80b9ce8e-9596-516e-9334-697510f61bfc with identifier: 20493011
2026-03-29 20:12:01 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 80b9ce8e-9596-516e-9334-697510f61bfc with identifier: 20493011 to the API
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3011/20493011/exterior_front_passenger-1774780161181.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '80b9ce8e-9596-516e-9334-697510f61bfc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'GL71 BHV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20493011',
'listing': 'auction',
'location': 'East Sussex Crowborough',
'make': 'Hyundai',
'model': 'I20',
'odometer': 29958,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b9ce8e-9596-516e-9334-697510f61bfc/80b9ce8e-9596-516e-9334-697510f61bfc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2201911,
'Height': 2666,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3011/20493011/exterior_front_driver-1774780074564.jpg',
'Width': 3555},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b9ce8e-9596-516e-9334-697510f61bfc/80b9ce8e-9596-516e-9334-697510f61bfc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2477699,
'Height': 2745,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3011/20493011/exterior_rear_driver-1774780106966.jpg',
'Width': 3660},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b9ce8e-9596-516e-9334-697510f61bfc/80b9ce8e-9596-516e-9334-697510f61bfc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2418949,
'Height': 2661,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3011/20493011/exterior_front_passenger-1774780161181.jpg',
'Width': 3548},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b9ce8e-9596-516e-9334-697510f61bfc/80b9ce8e-9596-516e-9334-697510f61bfc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2796526,
'Height': 2801,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3011/20493011/exterior_rear_passenger-1774780145762.jpg',
'Width': 3734},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b9ce8e-9596-516e-9334-697510f61bfc/80b9ce8e-9596-516e-9334-697510f61bfc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4830706,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3011/20493011/interior_front_seats-1774780646435.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b9ce8e-9596-516e-9334-697510f61bfc/80b9ce8e-9596-516e-9334-697510f61bfc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5021266,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3011/20493011/interior_rear_seats-1774780666574.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b9ce8e-9596-516e-9334-697510f61bfc/80b9ce8e-9596-516e-9334-697510f61bfc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1916020,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3011/20493011/interior_dashboard-1774780754001.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b9ce8e-9596-516e-9334-697510f61bfc/80b9ce8e-9596-516e-9334-697510f61bfc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2763420,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3011/20493011/instrument_cluster-1774780935302.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b9ce8e-9596-516e-9334-697510f61bfc/80b9ce8e-9596-516e-9334-697510f61bfc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4173593,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3011/20493011/interior_boot-1774780719625.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b9ce8e-9596-516e-9334-697510f61bfc/80b9ce8e-9596-516e-9334-697510f61bfc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329535,
'Height': 1445,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3011/20493011/docs_service_history-1774781207144.jpg?ixlib=js-3.8.0&auto=format&s=bca3cf2cbb93a018adbc6de29cb06d9b',
'Width': 2045}],
'price': 10013,
'price_includes_vat': False,
'registration_date': '2021-11-30',
'seats_number': None,
'seller_name': None,
'title': 'Hyundai I20 Element T-GDi',
'transmission': 'manual',
'trim': 'Element T-GDi',
'vin': 'NLHBN51GLNZ099323',
'year': 2021}
2026-03-29 20:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720493011%27 HTTP/1.1" 200 None
2026-03-29 20:12:02 [motorway.uk] INFO: Saving data for 20493011: {'created_time': 1774815122.006546, 'last_price_update_time': 1774815122.006561, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20493011') HTTP/1.1" 204 0
2026-03-29 20:12:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 120af6f0-63fc-5b28-b658-d5524b422829 with identifier: 20364057
2026-03-29 20:12:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 120af6f0-63fc-5b28-b658-d5524b422829 with identifier: 20364057
2026-03-29 20:12:02 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 120af6f0-63fc-5b28-b658-d5524b422829 with identifier: 20364057 to the API
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/4057/20364057/interior_boot-1774624263069.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '120af6f0-63fc-5b28-b658-d5524b422829',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FL20 FDX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20364057',
'listing': 'auction',
'location': 'Derbyshire Swadlincote',
'make': 'Jaguar',
'model': 'F-PACE',
'odometer': 39302,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120af6f0-63fc-5b28-b658-d5524b422829/120af6f0-63fc-5b28-b658-d5524b422829_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1369896,
'Height': 2480,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4057/20364057/exterior_front_driver-1774623649374.jpg',
'Width': 3306},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120af6f0-63fc-5b28-b658-d5524b422829/120af6f0-63fc-5b28-b658-d5524b422829_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1893936,
'Height': 2543,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4057/20364057/exterior_rear_driver-1774626930061.jpg',
'Width': 3391},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120af6f0-63fc-5b28-b658-d5524b422829/120af6f0-63fc-5b28-b658-d5524b422829_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1266943,
'Height': 2348,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4057/20364057/exterior_front_passenger-1774623694995.jpg',
'Width': 3130},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120af6f0-63fc-5b28-b658-d5524b422829/120af6f0-63fc-5b28-b658-d5524b422829_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2257753,
'Height': 2658,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4057/20364057/exterior_rear_passenger-1774626916511.jpg',
'Width': 3544},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120af6f0-63fc-5b28-b658-d5524b422829/120af6f0-63fc-5b28-b658-d5524b422829_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4357800,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4057/20364057/interior_front_seats-1774624159955.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120af6f0-63fc-5b28-b658-d5524b422829/120af6f0-63fc-5b28-b658-d5524b422829_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2788459,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4057/20364057/interior_rear_seats-1774624182721.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120af6f0-63fc-5b28-b658-d5524b422829/120af6f0-63fc-5b28-b658-d5524b422829_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1979644,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4057/20364057/interior_dashboard-1774681799078.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120af6f0-63fc-5b28-b658-d5524b422829/120af6f0-63fc-5b28-b658-d5524b422829_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2552942,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4057/20364057/instrument_cluster-1774624261079.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120af6f0-63fc-5b28-b658-d5524b422829/120af6f0-63fc-5b28-b658-d5524b422829_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3885383,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4057/20364057/interior_boot-1774624263069.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120af6f0-63fc-5b28-b658-d5524b422829/120af6f0-63fc-5b28-b658-d5524b422829_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3457847,
'Height': 3052,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4057/20364057/docs_service_history-1774625051381.jpg?ixlib=js-3.8.0&auto=format&s=38c76e075ce551861086d0f2b515c53e',
'Width': 2100}],
'price': 20925,
'price_includes_vat': False,
'registration_date': '2020-06-08',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar F-PACE Chequered Flag AWD D A',
'transmission': 'automatic',
'trim': 'Chequered Flag AWD D A',
'vin': 'SADCA2AN2LA642450',
'year': 2020}
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720364057%27 HTTP/1.1" 200 None
2026-03-29 20:12:02 [motorway.uk] INFO: Saving data for 20364057: {'created_time': 1774815122.421015, 'last_price_update_time': 1774815122.421026, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20364057') HTTP/1.1" 204 0
2026-03-29 20:12:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9564/3909564/instrument_cluster-1774694105399.jpeg> (referer: None)
2026-03-29 20:12:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9789/20489789/exterior_front_driver-1774708237201.jpg> (referer: None)
2026-03-29 20:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9564/3909564/interior_dashboard-1774694047896.jpeg> (referer: None)
2026-03-29 20:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4359/20404359/exterior_rear_passenger-1774712683498.jpg> (referer: None)
2026-03-29 20:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4359/20404359/exterior_front_passenger-1774712718419.jpg> (referer: None)
2026-03-29 20:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9564/3909564/interior_rear_seats-1774694016491.jpeg> (referer: None)
2026-03-29 20:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4359/20404359/interior_front_seats-1774713692603.jpg> (referer: None)
2026-03-29 20:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4359/20404359/interior_rear_seats-1774713113113.jpg> (referer: None)
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a81050>
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db2fee49-d68f-5e30-bf65-b160a07ccdb5/db2fee49-d68f-5e30-bf65-b160a07ccdb5_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9564%252F3909564%252Finstrument_cluster-1774694105399.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9564/3909564/instrument_cluster-1774694105399.jpeg saved to cache
2026-03-29 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item db2fee49-d68f-5e30-bf65-b160a07ccdb5
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598f0d50>
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa60fb8d-0c5a-520b-85d7-28248fe15f71/fa60fb8d-0c5a-520b-85d7-28248fe15f71_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9789%252F20489789%252Fexterior_front_driver-1774708237201.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9789/20489789/exterior_front_driver-1774708237201.jpg saved to cache
2026-03-29 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa60fb8d-0c5a-520b-85d7-28248fe15f71
2026-03-29 20:12:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa60fb8d-0c5a-520b-85d7-28248fe15f71, skipping ID generation
2026-03-29 20:12:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa60fb8d-0c5a-520b-85d7-28248fe15f71 with scrape type 1
2026-03-29 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa60fb8d-0c5a-520b-85d7-28248fe15f71 sending to next pipeline
2026-03-29 20:12:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: fa60fb8d-0c5a-520b-85d7-28248fe15f71, identifier: 20489789
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e19d10>
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db2fee49-d68f-5e30-bf65-b160a07ccdb5/db2fee49-d68f-5e30-bf65-b160a07ccdb5_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9564%252F3909564%252Finterior_dashboard-1774694047896.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9564/3909564/interior_dashboard-1774694047896.jpeg saved to cache
2026-03-29 20:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item db2fee49-d68f-5e30-bf65-b160a07ccdb5
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658521150>
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39367f78-574d-5919-ba05-6796acb4f138/39367f78-574d-5919-ba05-6796acb4f138_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4359%252F20404359%252Fexterior_rear_passenger-1774712683498.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4359/20404359/exterior_rear_passenger-1774712683498.jpg saved to cache
2026-03-29 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 39367f78-574d-5919-ba05-6796acb4f138
2026-03-29 20:12:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cf18d0>
2026-03-29 20:12:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39367f78-574d-5919-ba05-6796acb4f138/39367f78-574d-5919-ba05-6796acb4f138_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4359%252F20404359%252Fexterior_front_passenger-1774712718419.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4359/20404359/exterior_front_passenger-1774712718419.jpg saved to cache
2026-03-29 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 39367f78-574d-5919-ba05-6796acb4f138
2026-03-29 20:12:03 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:03 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:03 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00)B\x02\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02$U\x00)8\xa6\x00\x00\x00\x00'
2026-03-29 20:12:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b19590>
2026-03-29 20:12:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db2fee49-d68f-5e30-bf65-b160a07ccdb5/db2fee49-d68f-5e30-bf65-b160a07ccdb5_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9564%252F3909564%252Finterior_rear_seats-1774694016491.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9564/3909564/interior_rear_seats-1774694016491.jpeg saved to cache
2026-03-29 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db2fee49-d68f-5e30-bf65-b160a07ccdb5
2026-03-29 20:12:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599ee9d0>
2026-03-29 20:12:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39367f78-574d-5919-ba05-6796acb4f138/39367f78-574d-5919-ba05-6796acb4f138_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4359%252F20404359%252Finterior_front_seats-1774713692603.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4359/20404359/interior_front_seats-1774713692603.jpg saved to cache
2026-03-29 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 39367f78-574d-5919-ba05-6796acb4f138
2026-03-29 20:12:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658520510>
2026-03-29 20:12:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39367f78-574d-5919-ba05-6796acb4f138/39367f78-574d-5919-ba05-6796acb4f138_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4359%252F20404359%252Finterior_rear_seats-1774713113113.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4359/20404359/interior_rear_seats-1774713113113.jpg saved to cache
2026-03-29 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 39367f78-574d-5919-ba05-6796acb4f138
2026-03-29 20:12:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 39367f78-574d-5919-ba05-6796acb4f138, skipping ID generation
2026-03-29 20:12:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39367f78-574d-5919-ba05-6796acb4f138 with scrape type 1
2026-03-29 20:12:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 39367f78-574d-5919-ba05-6796acb4f138 sending to next pipeline
2026-03-29 20:12:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 39367f78-574d-5919-ba05-6796acb4f138, identifier: 20404359
2026-03-29 20:12:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: fa60fb8d-0c5a-520b-85d7-28248fe15f71 with identifier: 20489789
2026-03-29 20:12:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: fa60fb8d-0c5a-520b-85d7-28248fe15f71 with identifier: 20489789
2026-03-29 20:12:03 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: fa60fb8d-0c5a-520b-85d7-28248fe15f71 with identifier: 20489789 to the API
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9789/20489789/exterior_front_driver-1774708237201.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'fa60fb8d-0c5a-520b-85d7-28248fe15f71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'DX70 KHK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20489789',
'listing': 'auction',
'location': 'Northamptonshire Kettering',
'make': 'Ford',
'model': 'Transit',
'odometer': 63581,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa60fb8d-0c5a-520b-85d7-28248fe15f71/fa60fb8d-0c5a-520b-85d7-28248fe15f71_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1700218,
'Height': 2692,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9789/20489789/exterior_front_driver-1774708237201.jpg',
'Width': 3589},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa60fb8d-0c5a-520b-85d7-28248fe15f71/fa60fb8d-0c5a-520b-85d7-28248fe15f71_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1324246,
'Height': 2423,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9789/20489789/exterior_rear_driver-1774708519356.jpg',
'Width': 3230},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa60fb8d-0c5a-520b-85d7-28248fe15f71/fa60fb8d-0c5a-520b-85d7-28248fe15f71_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1375607,
'Height': 2524,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9789/20489789/exterior_front_passenger-1774708293965.jpg',
'Width': 3365},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa60fb8d-0c5a-520b-85d7-28248fe15f71/fa60fb8d-0c5a-520b-85d7-28248fe15f71_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1761771,
'Height': 2906,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9789/20489789/exterior_rear_passenger-1774708545508.jpg',
'Width': 3875},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa60fb8d-0c5a-520b-85d7-28248fe15f71/fa60fb8d-0c5a-520b-85d7-28248fe15f71_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3349394,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9789/20489789/interior_front_seats-1774708856298.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa60fb8d-0c5a-520b-85d7-28248fe15f71/fa60fb8d-0c5a-520b-85d7-28248fe15f71_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2543105,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9789/20489789/interior_dashboard-1774710418022.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa60fb8d-0c5a-520b-85d7-28248fe15f71/fa60fb8d-0c5a-520b-85d7-28248fe15f71_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2094182,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9789/20489789/instrument_cluster-1774708946122.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa60fb8d-0c5a-520b-85d7-28248fe15f71/fa60fb8d-0c5a-520b-85d7-28248fe15f71_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3141380,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9789/20489789/interior_boot-1774708907450.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa60fb8d-0c5a-520b-85d7-28248fe15f71/fa60fb8d-0c5a-520b-85d7-28248fe15f71_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 452749,
'Height': 1686,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/9789/20489789/docs_service_history-1774709739140.jpg?ixlib=js-3.8.0&auto=format&s=9ad4a6920814d13d7b840b36fd08b3fe',
'Width': 2248},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa60fb8d-0c5a-520b-85d7-28248fe15f71/fa60fb8d-0c5a-520b-85d7-28248fe15f71_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 551276,
'Height': 2561,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9789/20489789/docs_service_history-1774709331134.jpg?ixlib=js-3.8.0&auto=format&s=d0c84980a093545363f255f46f52a5db',
'Width': 1916}],
'price': 7551,
'price_includes_vat': False,
'registration_date': '2020-09-30',
'seats_number': None,
'seller_name': None,
'title': 'Ford Transit Connect 200 LTD TDCI',
'transmission': 'manual',
'trim': 'Connect 200 LTD TDCI',
'vin': 'WF0RXXWPGRLD87387',
'year': 2020}
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720489789%27 HTTP/1.1" 200 None
2026-03-29 20:12:04 [motorway.uk] INFO: Saving data for 20489789: {'created_time': 1774815124.04565, 'last_price_update_time': 1774815124.045661, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20489789') HTTP/1.1" 204 0
2026-03-29 20:12:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 39367f78-574d-5919-ba05-6796acb4f138 with identifier: 20404359
2026-03-29 20:12:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 39367f78-574d-5919-ba05-6796acb4f138 with identifier: 20404359
2026-03-29 20:12:04 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 39367f78-574d-5919-ba05-6796acb4f138 with identifier: 20404359 to the API
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/4359/20404359/interior_rear_seats-1774713113113.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '39367f78-574d-5919-ba05-6796acb4f138',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'CJ73 OHS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20404359',
'listing': 'auction',
'location': 'Caerphilly County Borough Newport',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 19435,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39367f78-574d-5919-ba05-6796acb4f138/39367f78-574d-5919-ba05-6796acb4f138_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1426192,
'Height': 2194,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4359/20404359/exterior_front_driver-1774712638498.jpg',
'Width': 2925},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39367f78-574d-5919-ba05-6796acb4f138/39367f78-574d-5919-ba05-6796acb4f138_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1429278,
'Height': 2213,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4359/20404359/exterior_rear_driver-1774712659399.jpg',
'Width': 2951},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39367f78-574d-5919-ba05-6796acb4f138/39367f78-574d-5919-ba05-6796acb4f138_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2302829,
'Height': 2663,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4359/20404359/exterior_front_passenger-1774712718419.jpg',
'Width': 3550},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39367f78-574d-5919-ba05-6796acb4f138/39367f78-574d-5919-ba05-6796acb4f138_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1824696,
'Height': 2582,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4359/20404359/exterior_rear_passenger-1774712683498.jpg',
'Width': 3442},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39367f78-574d-5919-ba05-6796acb4f138/39367f78-574d-5919-ba05-6796acb4f138_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3066180,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4359/20404359/interior_front_seats-1774713692603.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39367f78-574d-5919-ba05-6796acb4f138/39367f78-574d-5919-ba05-6796acb4f138_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3662338,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4359/20404359/interior_rear_seats-1774713113113.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39367f78-574d-5919-ba05-6796acb4f138/39367f78-574d-5919-ba05-6796acb4f138_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1579222,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4359/20404359/interior_dashboard-1774713152904.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39367f78-574d-5919-ba05-6796acb4f138/39367f78-574d-5919-ba05-6796acb4f138_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3431759,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4359/20404359/interior_boot-1774713171118.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39367f78-574d-5919-ba05-6796acb4f138/39367f78-574d-5919-ba05-6796acb4f138_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5143663,
'Height': 3380,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4359/20404359/docs_service_history-1774713293235.jpg?ixlib=js-3.8.0&auto=format&s=692ed88e91d96917947d7352a3b95730',
'Width': 2331},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39367f78-574d-5919-ba05-6796acb4f138/39367f78-574d-5919-ba05-6796acb4f138_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 969062,
'Height': 2023,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4359/20404359/wheels_front_driver-1774713764458.jpg',
'Width': 2697}],
'price': 28625,
'price_includes_vat': False,
'registration_date': '2023-12-29',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Range Rover Evoque DYN SE D MHEV A',
'transmission': 'automatic',
'trim': 'Evoque DYN SE D MHEV A',
'vin': 'SALZA2ANXRH240223',
'year': 2023}
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720404359%27 HTTP/1.1" 200 None
2026-03-29 20:12:04 [motorway.uk] INFO: Saving data for 20404359: {'created_time': 1774815124.458111, 'last_price_update_time': 1774815124.458121, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20404359') HTTP/1.1" 204 0
2026-03-29 20:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9564/3909564/exterior_front_driver-1774694228173.jpeg> (referer: None)
2026-03-29 20:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2266/19842266/exterior_front_passenger-1774709631194.jpg> (referer: None)
2026-03-29 20:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2266/19842266/exterior_rear_driver-1774709595662.jpg> (referer: None)
2026-03-29 20:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2266/19842266/exterior_rear_passenger-1774709606834.jpg> (referer: None)
2026-03-29 20:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9564/3909564/exterior_front_passenger-1774694273019.jpeg> (referer: None)
2026-03-29 20:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9564/3909564/exterior_rear_driver-1774694147813.jpeg> (referer: None)
2026-03-29 20:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9564/3909564/interior_front_seats-1774693916993.jpeg> (referer: None)
2026-03-29 20:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658698c50>
2026-03-29 20:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db2fee49-d68f-5e30-bf65-b160a07ccdb5/db2fee49-d68f-5e30-bf65-b160a07ccdb5_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9564%252F3909564%252Fexterior_front_driver-1774694228173.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9564/3909564/exterior_front_driver-1774694228173.jpeg saved to cache
2026-03-29 20:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db2fee49-d68f-5e30-bf65-b160a07ccdb5
2026-03-29 20:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e1b610>
2026-03-29 20:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c6331c-023f-5573-b956-bdd7ef96c4c6/d6c6331c-023f-5573-b956-bdd7ef96c4c6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2266%252F19842266%252Fexterior_front_passenger-1774709631194.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2266/19842266/exterior_front_passenger-1774709631194.jpg saved to cache
2026-03-29 20:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6c6331c-023f-5573-b956-bdd7ef96c4c6
2026-03-29 20:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b0e450>
2026-03-29 20:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c6331c-023f-5573-b956-bdd7ef96c4c6/d6c6331c-023f-5573-b956-bdd7ef96c4c6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2266%252F19842266%252Fexterior_rear_driver-1774709595662.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2266/19842266/exterior_rear_driver-1774709595662.jpg saved to cache
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d6c6331c-023f-5573-b956-bdd7ef96c4c6
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65850c810>
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c6331c-023f-5573-b956-bdd7ef96c4c6/d6c6331c-023f-5573-b956-bdd7ef96c4c6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2266%252F19842266%252Fexterior_rear_passenger-1774709606834.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2266/19842266/exterior_rear_passenger-1774709606834.jpg saved to cache
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6c6331c-023f-5573-b956-bdd7ef96c4c6
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f1cc90>
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db2fee49-d68f-5e30-bf65-b160a07ccdb5/db2fee49-d68f-5e30-bf65-b160a07ccdb5_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9564%252F3909564%252Fexterior_front_passenger-1774694273019.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9564/3909564/exterior_front_passenger-1774694273019.jpeg saved to cache
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db2fee49-d68f-5e30-bf65-b160a07ccdb5
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65850f410>
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db2fee49-d68f-5e30-bf65-b160a07ccdb5/db2fee49-d68f-5e30-bf65-b160a07ccdb5_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9564%252F3909564%252Fexterior_rear_driver-1774694147813.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9564/3909564/exterior_rear_driver-1774694147813.jpeg saved to cache
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db2fee49-d68f-5e30-bf65-b160a07ccdb5
2026-03-29 20:12:05 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:05 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:05 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00,-\xf0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x81\xd0\x00,$\x94\x00\x00\x00\x00'
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589c7650>
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db2fee49-d68f-5e30-bf65-b160a07ccdb5/db2fee49-d68f-5e30-bf65-b160a07ccdb5_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9564%252F3909564%252Finterior_front_seats-1774693916993.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9564/3909564/interior_front_seats-1774693916993.jpeg saved to cache
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db2fee49-d68f-5e30-bf65-b160a07ccdb5
2026-03-29 20:12:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db2fee49-d68f-5e30-bf65-b160a07ccdb5, skipping ID generation
2026-03-29 20:12:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db2fee49-d68f-5e30-bf65-b160a07ccdb5 with scrape type 1
2026-03-29 20:12:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db2fee49-d68f-5e30-bf65-b160a07ccdb5 sending to next pipeline
2026-03-29 20:12:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: db2fee49-d68f-5e30-bf65-b160a07ccdb5, identifier: 3909564
2026-03-29 20:12:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: db2fee49-d68f-5e30-bf65-b160a07ccdb5 with identifier: 3909564
2026-03-29 20:12:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: db2fee49-d68f-5e30-bf65-b160a07ccdb5 with identifier: 3909564
2026-03-29 20:12:05 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: db2fee49-d68f-5e30-bf65-b160a07ccdb5 with identifier: 3909564 to the API
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/9564/3909564/interior_front_seats-1774693916993.jpeg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'db2fee49-d68f-5e30-bf65-b160a07ccdb5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'XJ17 JAY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/3909564',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Jaguar',
'model': 'XJ Series',
'odometer': 49380,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db2fee49-d68f-5e30-bf65-b160a07ccdb5/db2fee49-d68f-5e30-bf65-b160a07ccdb5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1654777,
'Height': 2690,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9564/3909564/exterior_front_driver-1774694228173.jpeg',
'Width': 3586},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db2fee49-d68f-5e30-bf65-b160a07ccdb5/db2fee49-d68f-5e30-bf65-b160a07ccdb5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2000854,
'Height': 2999,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9564/3909564/exterior_rear_driver-1774694147813.jpeg',
'Width': 3999},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db2fee49-d68f-5e30-bf65-b160a07ccdb5/db2fee49-d68f-5e30-bf65-b160a07ccdb5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1767106,
'Height': 2793,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9564/3909564/exterior_front_passenger-1774694273019.jpeg',
'Width': 3724},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db2fee49-d68f-5e30-bf65-b160a07ccdb5/db2fee49-d68f-5e30-bf65-b160a07ccdb5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1493540,
'Height': 2678,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9564/3909564/exterior_rear_passenger-1774694140342.jpeg',
'Width': 3571},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db2fee49-d68f-5e30-bf65-b160a07ccdb5/db2fee49-d68f-5e30-bf65-b160a07ccdb5_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3059648,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9564/3909564/interior_front_seats-1774693916993.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db2fee49-d68f-5e30-bf65-b160a07ccdb5/db2fee49-d68f-5e30-bf65-b160a07ccdb5_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2844247,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9564/3909564/interior_rear_seats-1774694016491.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db2fee49-d68f-5e30-bf65-b160a07ccdb5/db2fee49-d68f-5e30-bf65-b160a07ccdb5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1553882,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9564/3909564/interior_dashboard-1774694047896.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db2fee49-d68f-5e30-bf65-b160a07ccdb5/db2fee49-d68f-5e30-bf65-b160a07ccdb5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1012049,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9564/3909564/instrument_cluster-1774694105399.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db2fee49-d68f-5e30-bf65-b160a07ccdb5/db2fee49-d68f-5e30-bf65-b160a07ccdb5_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2775315,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9564/3909564/interior_boot-1774694050083.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db2fee49-d68f-5e30-bf65-b160a07ccdb5/db2fee49-d68f-5e30-bf65-b160a07ccdb5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370768,
'Height': 2868,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9564/3909564/docs_service_history-1774695097047.jpeg?ixlib=js-3.8.0&auto=format&s=5a548c3ebdd8f203995b89c9fd98884a',
'Width': 1320}],
'price': 14433,
'price_includes_vat': False,
'registration_date': '2017-03-22',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar XJ Portfolio V6 D Auto',
'transmission': 'automatic',
'trim': 'XJ Portfolio V6 D Auto',
'vin': 'SAJAC1695HNW03940',
'year': 2017}
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273909564%27 HTTP/1.1" 200 None
2026-03-29 20:12:06 [motorway.uk] INFO: Saving data for 3909564: {'created_time': 1774815126.063784, 'last_price_update_time': 1774815126.063797, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='3909564') HTTP/1.1" 204 0
2026-03-29 20:12:06 [scrapy.extensions.logstats] INFO: Crawled 76 pages (at 27 pages/min), scraped 33 items (at 26 items/min)
2026-03-29 20:12:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 252MiB
2026-03-29 20:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3451/7263451/7263451-interior_rear_seats-default-1774532529401.jpg> (referer: None)
2026-03-29 20:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3451/7263451/7263451-exterior_front_passenger-default-1774532409014.jpg> (referer: None)
2026-03-29 20:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3712/20493712/interior_dashboard-1774778878540.jpg> (referer: None)
2026-03-29 20:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3451/7263451/7263451-interior_front_seats-default-1774532501079.jpg> (referer: None)
2026-03-29 20:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2266/19842266/exterior_front_driver-1774709578906.jpg> (referer: None)
2026-03-29 20:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3451/7263451/7263451-exterior_rear_driver-default-1774532377683.jpg> (referer: None)
2026-03-29 20:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6653/20406653/interior_boot-1774698147271.jpg> (referer: None)
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584c6b10>
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cebe8506-187c-53c7-b3ab-8d6a67c0ecde/cebe8506-187c-53c7-b3ab-8d6a67c0ecde_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3451%252F7263451%252F7263451-interior_rear_seats-default-1774532529401.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3451/7263451/7263451-interior_rear_seats-default-1774532529401.jpg saved to cache
2026-03-29 20:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cebe8506-187c-53c7-b3ab-8d6a67c0ecde
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be03590>
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cebe8506-187c-53c7-b3ab-8d6a67c0ecde/cebe8506-187c-53c7-b3ab-8d6a67c0ecde_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3451%252F7263451%252F7263451-exterior_front_passenger-default-1774532409014.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3451/7263451/7263451-exterior_front_passenger-default-1774532409014.jpg saved to cache
2026-03-29 20:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cebe8506-187c-53c7-b3ab-8d6a67c0ecde
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f0ca90>
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e31cb8c-b819-5889-afd6-bc69ea59e649/4e31cb8c-b819-5889-afd6-bc69ea59e649_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3712%252F20493712%252Finterior_dashboard-1774778878540.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3712/20493712/interior_dashboard-1774778878540.jpg saved to cache
2026-03-29 20:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4e31cb8c-b819-5889-afd6-bc69ea59e649
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599da010>
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cebe8506-187c-53c7-b3ab-8d6a67c0ecde/cebe8506-187c-53c7-b3ab-8d6a67c0ecde_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3451%252F7263451%252F7263451-interior_front_seats-default-1774532501079.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3451/7263451/7263451-interior_front_seats-default-1774532501079.jpg saved to cache
2026-03-29 20:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cebe8506-187c-53c7-b3ab-8d6a67c0ecde
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d760d0>
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6c6331c-023f-5573-b956-bdd7ef96c4c6/d6c6331c-023f-5573-b956-bdd7ef96c4c6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2266%252F19842266%252Fexterior_front_driver-1774709578906.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2266/19842266/exterior_front_driver-1774709578906.jpg saved to cache
2026-03-29 20:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6c6331c-023f-5573-b956-bdd7ef96c4c6
2026-03-29 20:12:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6c6331c-023f-5573-b956-bdd7ef96c4c6, skipping ID generation
2026-03-29 20:12:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6c6331c-023f-5573-b956-bdd7ef96c4c6 with scrape type 1
2026-03-29 20:12:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6c6331c-023f-5573-b956-bdd7ef96c4c6 sending to next pipeline
2026-03-29 20:12:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d6c6331c-023f-5573-b956-bdd7ef96c4c6, identifier: 19842266
2026-03-29 20:12:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65856a7d0>
2026-03-29 20:12:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cebe8506-187c-53c7-b3ab-8d6a67c0ecde/cebe8506-187c-53c7-b3ab-8d6a67c0ecde_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3451%252F7263451%252F7263451-exterior_rear_driver-default-1774532377683.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3451/7263451/7263451-exterior_rear_driver-default-1774532377683.jpg saved to cache
2026-03-29 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cebe8506-187c-53c7-b3ab-8d6a67c0ecde
2026-03-29 20:12:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f0ce90>
2026-03-29 20:12:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b32c733-0254-5a36-91b0-9956f3b111dc/5b32c733-0254-5a36-91b0-9956f3b111dc_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6653%252F20406653%252Finterior_boot-1774698147271.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6653/20406653/interior_boot-1774698147271.jpg saved to cache
2026-03-29 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5b32c733-0254-5a36-91b0-9956f3b111dc
2026-03-29 20:12:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d6c6331c-023f-5573-b956-bdd7ef96c4c6 with identifier: 19842266
2026-03-29 20:12:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d6c6331c-023f-5573-b956-bdd7ef96c4c6 with identifier: 19842266
2026-03-29 20:12:07 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d6c6331c-023f-5573-b956-bdd7ef96c4c6 with identifier: 19842266 to the API
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2266/19842266/exterior_front_driver-1774709578906.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'd6c6331c-023f-5573-b956-bdd7ef96c4c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'RE69 NYR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19842266',
'listing': 'auction',
'location': 'West Yorkshire Leeds',
'make': 'Audi',
'model': 'A1',
'odometer': 40860,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c6331c-023f-5573-b956-bdd7ef96c4c6/d6c6331c-023f-5573-b956-bdd7ef96c4c6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1547766,
'Height': 2519,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2266/19842266/exterior_front_driver-1774709578906.jpg',
'Width': 3359},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c6331c-023f-5573-b956-bdd7ef96c4c6/d6c6331c-023f-5573-b956-bdd7ef96c4c6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1533853,
'Height': 2414,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2266/19842266/exterior_rear_driver-1774709595662.jpg',
'Width': 3219},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c6331c-023f-5573-b956-bdd7ef96c4c6/d6c6331c-023f-5573-b956-bdd7ef96c4c6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1222278,
'Height': 2149,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2266/19842266/exterior_front_passenger-1774709631194.jpg',
'Width': 2865},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c6331c-023f-5573-b956-bdd7ef96c4c6/d6c6331c-023f-5573-b956-bdd7ef96c4c6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1642328,
'Height': 2595,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2266/19842266/exterior_rear_passenger-1774709606834.jpg',
'Width': 3460},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c6331c-023f-5573-b956-bdd7ef96c4c6/d6c6331c-023f-5573-b956-bdd7ef96c4c6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3203559,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2266/19842266/interior_front_seats-1774710377916.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c6331c-023f-5573-b956-bdd7ef96c4c6/d6c6331c-023f-5573-b956-bdd7ef96c4c6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2752197,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2266/19842266/interior_rear_seats-1774710414345.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c6331c-023f-5573-b956-bdd7ef96c4c6/d6c6331c-023f-5573-b956-bdd7ef96c4c6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2847635,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2266/19842266/interior_dashboard-1774710462661.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c6331c-023f-5573-b956-bdd7ef96c4c6/d6c6331c-023f-5573-b956-bdd7ef96c4c6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2033919,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2266/19842266/instrument_cluster-1774710461779.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c6331c-023f-5573-b956-bdd7ef96c4c6/d6c6331c-023f-5573-b956-bdd7ef96c4c6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3693297,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2266/19842266/interior_boot-1774710552641.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6c6331c-023f-5573-b956-bdd7ef96c4c6/d6c6331c-023f-5573-b956-bdd7ef96c4c6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106112,
'Height': 1453,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/2266/19842266/docs_service_history-1774779850438.jpg?ixlib=js-3.8.0&auto=format&s=8fd6a747746f35fad171aca8e205bcc5',
'Width': 1090}],
'price': 12171,
'price_includes_vat': False,
'registration_date': '2019-11-11',
'seats_number': None,
'seller_name': None,
'title': 'Audi A1 S Line 30 TFSI',
'transmission': 'manual',
'trim': 'S Line 30 TFSI',
'vin': 'WAUZZZGB8LR013679',
'year': 2019}
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719842266%27 HTTP/1.1" 200 None
2026-03-29 20:12:07 [motorway.uk] INFO: Saving data for 19842266: {'created_time': 1774815127.615853, 'last_price_update_time': 1774815127.615889, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19842266') HTTP/1.1" 204 0
2026-03-29 20:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=288&page=8&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3712/20493712/interior_rear_seats-1774778862055.jpg> (referer: None)
2026-03-29 20:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3451/7263451/7263451-interior_dashboard-default-1774532561200.jpg> (referer: None)
2026-03-29 20:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3712/20493712/interior_front_seats-1774778396048.jpg> (referer: None)
2026-03-29 20:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6653/20406653/interior_dashboard-1774705306055.jpg> (referer: None)
2026-03-29 20:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6653/20406653/interior_front_seats-1774698524066.jpg> (referer: None)
2026-03-29 20:12:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6653/20406653/interior_rear_seats-1774698210152.jpg> (referer: None)
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 20470032
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 19734640
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 20455021
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720455021%27 HTTP/1.1" 200 None
2026-03-29 20:12:07 [motorway.uk] INFO: Scrape type for 20455021: 1
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 20237507
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 20489983
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 20393410
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 19840923
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 20462094
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 16271814
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 16318590
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716318590%27 HTTP/1.1" 200 None
2026-03-29 20:12:07 [motorway.uk] INFO: Scrape type for 16318590: 1
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 20487406
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 19679688
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 16422959
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 20496326
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 14326949
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 20457094
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 20453358
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 19940066
2026-03-29 20:12:07 [motorway.uk] INFO: Found listing with ID: 13623460
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713623460%27 HTTP/1.1" 200 None
2026-03-29 20:12:07 [motorway.uk] INFO: Scrape type for 13623460: 1
2026-03-29 20:12:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a82450>
2026-03-29 20:12:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e31cb8c-b819-5889-afd6-bc69ea59e649/4e31cb8c-b819-5889-afd6-bc69ea59e649_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3712%252F20493712%252Finterior_rear_seats-1774778862055.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3712/20493712/interior_rear_seats-1774778862055.jpg saved to cache
2026-03-29 20:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4e31cb8c-b819-5889-afd6-bc69ea59e649
2026-03-29 20:12:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a82790>
2026-03-29 20:12:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cebe8506-187c-53c7-b3ab-8d6a67c0ecde/cebe8506-187c-53c7-b3ab-8d6a67c0ecde_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3451%252F7263451%252F7263451-interior_dashboard-default-1774532561200.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3451/7263451/7263451-interior_dashboard-default-1774532561200.jpg saved to cache
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cebe8506-187c-53c7-b3ab-8d6a67c0ecde
2026-03-29 20:12:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cebe8506-187c-53c7-b3ab-8d6a67c0ecde, skipping ID generation
2026-03-29 20:12:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cebe8506-187c-53c7-b3ab-8d6a67c0ecde with scrape type 1
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cebe8506-187c-53c7-b3ab-8d6a67c0ecde sending to next pipeline
2026-03-29 20:12:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: cebe8506-187c-53c7-b3ab-8d6a67c0ecde, identifier: 7263451
2026-03-29 20:12:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: cebe8506-187c-53c7-b3ab-8d6a67c0ecde with identifier: 7263451
2026-03-29 20:12:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: cebe8506-187c-53c7-b3ab-8d6a67c0ecde with identifier: 7263451
2026-03-29 20:12:08 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: cebe8506-187c-53c7-b3ab-8d6a67c0ecde with identifier: 7263451 to the API
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3451/7263451/7263451-interior_dashboard-default-1774532561200.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'cebe8506-187c-53c7-b3ab-8d6a67c0ecde',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PRN 777Y',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/7263451',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Volvo',
'model': 'XC90',
'odometer': 69357,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cebe8506-187c-53c7-b3ab-8d6a67c0ecde/cebe8506-187c-53c7-b3ab-8d6a67c0ecde_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1361934,
'Height': 2513,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3451/7263451/7263451-exterior_front_driver-default-1774532324215.jpg',
'Width': 3351},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cebe8506-187c-53c7-b3ab-8d6a67c0ecde/cebe8506-187c-53c7-b3ab-8d6a67c0ecde_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1469182,
'Height': 2505,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3451/7263451/7263451-exterior_rear_driver-default-1774532377683.jpg',
'Width': 3340},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cebe8506-187c-53c7-b3ab-8d6a67c0ecde/cebe8506-187c-53c7-b3ab-8d6a67c0ecde_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1530858,
'Height': 2732,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3451/7263451/7263451-exterior_front_passenger-default-1774532409014.jpg',
'Width': 3642},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cebe8506-187c-53c7-b3ab-8d6a67c0ecde/cebe8506-187c-53c7-b3ab-8d6a67c0ecde_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1310313,
'Height': 2638,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3451/7263451/7263451-exterior_rear_passenger-default-1774532440229.jpg',
'Width': 3517},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cebe8506-187c-53c7-b3ab-8d6a67c0ecde/cebe8506-187c-53c7-b3ab-8d6a67c0ecde_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2334066,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3451/7263451/7263451-interior_front_seats-default-1774532501079.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cebe8506-187c-53c7-b3ab-8d6a67c0ecde/cebe8506-187c-53c7-b3ab-8d6a67c0ecde_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2229537,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3451/7263451/7263451-interior_rear_seats-default-1774532529401.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cebe8506-187c-53c7-b3ab-8d6a67c0ecde/cebe8506-187c-53c7-b3ab-8d6a67c0ecde_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2367203,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3451/7263451/7263451-interior_dashboard-default-1774532561200.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cebe8506-187c-53c7-b3ab-8d6a67c0ecde/cebe8506-187c-53c7-b3ab-8d6a67c0ecde_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1801008,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3451/7263451/7263451-instrument_cluster-default-1774532719836.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cebe8506-187c-53c7-b3ab-8d6a67c0ecde/cebe8506-187c-53c7-b3ab-8d6a67c0ecde_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2905710,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3451/7263451/7263451-interior_boot-default-1774532562379.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cebe8506-187c-53c7-b3ab-8d6a67c0ecde/cebe8506-187c-53c7-b3ab-8d6a67c0ecde_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1375003,
'Height': 2803,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/3451/7263451/7263451-docs_service_history-modified-1774533951178.jpeg?ixlib=js-3.8.0&auto=format&s=0b701a9d5aa2f31e5e2c60977061ee66',
'Width': 3737}],
'price': 22172,
'price_includes_vat': False,
'registration_date': '2018-05-04',
'seats_number': None,
'seller_name': None,
'title': 'Volvo XC90 Inscript PRO D5 PP AWD A',
'transmission': 'automatic',
'trim': 'Inscript PRO D5 PP AWD A',
'vin': 'YV1LF68TCJ1353087',
'year': 2018}
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277263451%27 HTTP/1.1" 200 None
2026-03-29 20:12:08 [motorway.uk] INFO: Saving data for 7263451: {'created_time': 1774815128.530959, 'last_price_update_time': 1774815128.53097, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='7263451') HTTP/1.1" 204 0
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 19930182
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 19899454
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 19785042
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 18874288
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 20490925
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 8725249
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 20487634
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 20485866
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 20387201
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 18839860
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 17987243
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717987243%27 HTTP/1.1" 200 None
2026-03-29 20:12:08 [motorway.uk] INFO: Scrape type for 17987243: 0
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 14223294
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 20439498
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 20130616
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 19164973
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 19699947
2026-03-29 20:12:08 [motorway.uk] INFO: Found listing with ID: 20316056
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720316056%27 HTTP/1.1" 200 None
2026-03-29 20:12:08 [motorway.uk] INFO: Scrape type for 20316056: 1
2026-03-29 20:12:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658382b90>
2026-03-29 20:12:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e31cb8c-b819-5889-afd6-bc69ea59e649/4e31cb8c-b819-5889-afd6-bc69ea59e649_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3712%252F20493712%252Finterior_front_seats-1774778396048.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3712/20493712/interior_front_seats-1774778396048.jpg saved to cache
2026-03-29 20:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4e31cb8c-b819-5889-afd6-bc69ea59e649
2026-03-29 20:12:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583808d0>
2026-03-29 20:12:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b32c733-0254-5a36-91b0-9956f3b111dc/5b32c733-0254-5a36-91b0-9956f3b111dc_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6653%252F20406653%252Finterior_dashboard-1774705306055.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6653/20406653/interior_dashboard-1774705306055.jpg saved to cache
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5b32c733-0254-5a36-91b0-9956f3b111dc
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c4e690>
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b32c733-0254-5a36-91b0-9956f3b111dc/5b32c733-0254-5a36-91b0-9956f3b111dc_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6653%252F20406653%252Finterior_front_seats-1774698524066.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6653/20406653/interior_front_seats-1774698524066.jpg saved to cache
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5b32c733-0254-5a36-91b0-9956f3b111dc
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a38390>
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b32c733-0254-5a36-91b0-9956f3b111dc/5b32c733-0254-5a36-91b0-9956f3b111dc_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6653%252F20406653%252Finterior_rear_seats-1774698210152.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6653/20406653/interior_rear_seats-1774698210152.jpg saved to cache
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5b32c733-0254-5a36-91b0-9956f3b111dc
2026-03-29 20:12:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3712/20493712/exterior_rear_driver-1774778349138.jpg> (referer: None)
2026-03-29 20:12:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3712/20493712/exterior_rear_passenger-1774720684106.jpg> (referer: None)
2026-03-29 20:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6653/20406653/exterior_rear_passenger-1774697615461.jpg> (referer: None)
2026-03-29 20:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6653/20406653/exterior_front_passenger-1774697596482.jpg> (referer: None)
2026-03-29 20:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5595/20475595/exterior_rear_passenger-1774705915980.jpg> (referer: None)
2026-03-29 20:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6653/20406653/exterior_rear_driver-1774697589442.jpg> (referer: None)
2026-03-29 20:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3712/20493712/exterior_front_passenger-1774779592621.jpg> (referer: None)
2026-03-29 20:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5595/20475595/exterior_front_passenger-1774706005995.jpg> (referer: None)
2026-03-29 20:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5595/20475595/interior_front_seats-1774706463895.jpg> (referer: None)
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65999d410>
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e31cb8c-b819-5889-afd6-bc69ea59e649/4e31cb8c-b819-5889-afd6-bc69ea59e649_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3712%252F20493712%252Fexterior_rear_driver-1774778349138.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3712/20493712/exterior_rear_driver-1774778349138.jpg saved to cache
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4e31cb8c-b819-5889-afd6-bc69ea59e649
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ad0810>
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e31cb8c-b819-5889-afd6-bc69ea59e649/4e31cb8c-b819-5889-afd6-bc69ea59e649_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3712%252F20493712%252Fexterior_rear_passenger-1774720684106.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3712/20493712/exterior_rear_passenger-1774720684106.jpg saved to cache
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4e31cb8c-b819-5889-afd6-bc69ea59e649
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582dcf50>
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b32c733-0254-5a36-91b0-9956f3b111dc/5b32c733-0254-5a36-91b0-9956f3b111dc_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6653%252F20406653%252Fexterior_rear_passenger-1774697615461.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6653/20406653/exterior_rear_passenger-1774697615461.jpg saved to cache
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5b32c733-0254-5a36-91b0-9956f3b111dc
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a79b50>
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b32c733-0254-5a36-91b0-9956f3b111dc/5b32c733-0254-5a36-91b0-9956f3b111dc_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6653%252F20406653%252Fexterior_front_passenger-1774697596482.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6653/20406653/exterior_front_passenger-1774697596482.jpg saved to cache
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5b32c733-0254-5a36-91b0-9956f3b111dc
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582de350>
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a91851d-c8c8-5681-a9de-54cb820b5a7c/8a91851d-c8c8-5681-a9de-54cb820b5a7c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5595%252F20475595%252Fexterior_rear_passenger-1774705915980.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5595/20475595/exterior_rear_passenger-1774705915980.jpg saved to cache
2026-03-29 20:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8a91851d-c8c8-5681-a9de-54cb820b5a7c
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ce6050>
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b32c733-0254-5a36-91b0-9956f3b111dc/5b32c733-0254-5a36-91b0-9956f3b111dc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6653%252F20406653%252Fexterior_rear_driver-1774697589442.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6653/20406653/exterior_rear_driver-1774697589442.jpg saved to cache
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5b32c733-0254-5a36-91b0-9956f3b111dc
2026-03-29 20:12:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b32c733-0254-5a36-91b0-9956f3b111dc, skipping ID generation
2026-03-29 20:12:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b32c733-0254-5a36-91b0-9956f3b111dc with scrape type 1
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b32c733-0254-5a36-91b0-9956f3b111dc sending to next pipeline
2026-03-29 20:12:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5b32c733-0254-5a36-91b0-9956f3b111dc, identifier: 20406653
2026-03-29 20:12:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf67e10>
2026-03-29 20:12:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e31cb8c-b819-5889-afd6-bc69ea59e649/4e31cb8c-b819-5889-afd6-bc69ea59e649_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3712%252F20493712%252Fexterior_front_passenger-1774779592621.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3712/20493712/exterior_front_passenger-1774779592621.jpg saved to cache
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4e31cb8c-b819-5889-afd6-bc69ea59e649
2026-03-29 20:12:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e31cb8c-b819-5889-afd6-bc69ea59e649, skipping ID generation
2026-03-29 20:12:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e31cb8c-b819-5889-afd6-bc69ea59e649 with scrape type 1
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e31cb8c-b819-5889-afd6-bc69ea59e649 sending to next pipeline
2026-03-29 20:12:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 4e31cb8c-b819-5889-afd6-bc69ea59e649, identifier: 20493712
2026-03-29 20:12:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d99490>
2026-03-29 20:12:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a91851d-c8c8-5681-a9de-54cb820b5a7c/8a91851d-c8c8-5681-a9de-54cb820b5a7c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5595%252F20475595%252Fexterior_front_passenger-1774706005995.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5595/20475595/exterior_front_passenger-1774706005995.jpg saved to cache
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8a91851d-c8c8-5681-a9de-54cb820b5a7c
2026-03-29 20:12:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65853c110>
2026-03-29 20:12:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a91851d-c8c8-5681-a9de-54cb820b5a7c/8a91851d-c8c8-5681-a9de-54cb820b5a7c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5595%252F20475595%252Finterior_front_seats-1774706463895.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5595/20475595/interior_front_seats-1774706463895.jpg saved to cache
2026-03-29 20:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8a91851d-c8c8-5681-a9de-54cb820b5a7c
2026-03-29 20:12:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5b32c733-0254-5a36-91b0-9956f3b111dc with identifier: 20406653
2026-03-29 20:12:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5b32c733-0254-5a36-91b0-9956f3b111dc with identifier: 20406653
2026-03-29 20:12:10 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5b32c733-0254-5a36-91b0-9956f3b111dc with identifier: 20406653 to the API
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6653/20406653/exterior_rear_driver-1774697589442.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Electric',
'id': '5b32c733-0254-5a36-91b0-9956f3b111dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PN70 RLX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20406653',
'listing': 'auction',
'location': 'Lancashire Burnley',
'make': 'Hyundai',
'model': 'Kona',
'odometer': 88000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b32c733-0254-5a36-91b0-9956f3b111dc/5b32c733-0254-5a36-91b0-9956f3b111dc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1820197,
'Height': 2580,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6653/20406653/exterior_front_driver-1774697593191.jpg',
'Width': 3440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b32c733-0254-5a36-91b0-9956f3b111dc/5b32c733-0254-5a36-91b0-9956f3b111dc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1737793,
'Height': 2444,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6653/20406653/exterior_rear_driver-1774697589442.jpg',
'Width': 3258},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b32c733-0254-5a36-91b0-9956f3b111dc/5b32c733-0254-5a36-91b0-9956f3b111dc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1515019,
'Height': 2381,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6653/20406653/exterior_front_passenger-1774697596482.jpg',
'Width': 3174},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b32c733-0254-5a36-91b0-9956f3b111dc/5b32c733-0254-5a36-91b0-9956f3b111dc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1334484,
'Height': 2304,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6653/20406653/exterior_rear_passenger-1774697615461.jpg',
'Width': 3072},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b32c733-0254-5a36-91b0-9956f3b111dc/5b32c733-0254-5a36-91b0-9956f3b111dc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2399766,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6653/20406653/interior_front_seats-1774698524066.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b32c733-0254-5a36-91b0-9956f3b111dc/5b32c733-0254-5a36-91b0-9956f3b111dc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2427750,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6653/20406653/interior_rear_seats-1774698210152.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b32c733-0254-5a36-91b0-9956f3b111dc/5b32c733-0254-5a36-91b0-9956f3b111dc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2524110,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6653/20406653/interior_dashboard-1774705306055.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b32c733-0254-5a36-91b0-9956f3b111dc/5b32c733-0254-5a36-91b0-9956f3b111dc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2918379,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6653/20406653/interior_boot-1774698147271.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b32c733-0254-5a36-91b0-9956f3b111dc/5b32c733-0254-5a36-91b0-9956f3b111dc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 877432,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6653/20406653/docs_service_history-1774698368810.jpg?ixlib=js-3.8.0&auto=format&s=1f5e8ac4252f95b699619b3eef866665',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b32c733-0254-5a36-91b0-9956f3b111dc/5b32c733-0254-5a36-91b0-9956f3b111dc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 957813,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6653/20406653/docs_service_history-1774698390118.jpg?ixlib=js-3.8.0&auto=format&s=9f4f51bfa437df58af807d5268d83eb9',
'Width': 3840}],
'price': 6667,
'price_includes_vat': False,
'registration_date': '2020-09-08',
'seats_number': None,
'seller_name': None,
'title': 'Hyundai Kona Premium SE EV',
'transmission': 'automatic',
'trim': 'Premium SE EV',
'vin': 'KMHK581GULU088531',
'year': 2020}
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720406653%27 HTTP/1.1" 200 None
2026-03-29 20:12:10 [motorway.uk] INFO: Saving data for 20406653: {'created_time': 1774815130.982693, 'last_price_update_time': 1774815130.982706, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20406653') HTTP/1.1" 204 0
2026-03-29 20:12:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 4e31cb8c-b819-5889-afd6-bc69ea59e649 with identifier: 20493712
2026-03-29 20:12:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 4e31cb8c-b819-5889-afd6-bc69ea59e649 with identifier: 20493712
2026-03-29 20:12:11 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 4e31cb8c-b819-5889-afd6-bc69ea59e649 with identifier: 20493712 to the API
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/3712/20493712/exterior_front_passenger-1774779592621.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '4e31cb8c-b819-5889-afd6-bc69ea59e649',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HL19 WYX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20493712',
'listing': 'auction',
'location': 'Warwickshire Coventry',
'make': 'BMW',
'model': 'X5',
'odometer': 69000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e31cb8c-b819-5889-afd6-bc69ea59e649/4e31cb8c-b819-5889-afd6-bc69ea59e649_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 628982,
'Height': 1394,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3712/20493712/exterior_front_driver-1774778332922.jpg',
'Width': 1859},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e31cb8c-b819-5889-afd6-bc69ea59e649/4e31cb8c-b819-5889-afd6-bc69ea59e649_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1015832,
'Height': 1779,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3712/20493712/exterior_rear_driver-1774778349138.jpg',
'Width': 2372},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e31cb8c-b819-5889-afd6-bc69ea59e649/4e31cb8c-b819-5889-afd6-bc69ea59e649_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2325747,
'Height': 2526,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3712/20493712/exterior_front_passenger-1774779592621.jpg',
'Width': 3368},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e31cb8c-b819-5889-afd6-bc69ea59e649/4e31cb8c-b819-5889-afd6-bc69ea59e649_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1137871,
'Height': 2051,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3712/20493712/exterior_rear_passenger-1774720684106.jpg',
'Width': 2734},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e31cb8c-b819-5889-afd6-bc69ea59e649/4e31cb8c-b819-5889-afd6-bc69ea59e649_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2518099,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3712/20493712/interior_front_seats-1774778396048.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e31cb8c-b819-5889-afd6-bc69ea59e649/4e31cb8c-b819-5889-afd6-bc69ea59e649_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1195636,
'Height': 2239,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3712/20493712/interior_rear_seats-1774778862055.jpg',
'Width': 2986},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e31cb8c-b819-5889-afd6-bc69ea59e649/4e31cb8c-b819-5889-afd6-bc69ea59e649_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1483759,
'Height': 2206,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3712/20493712/interior_dashboard-1774778878540.jpg',
'Width': 2941},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e31cb8c-b819-5889-afd6-bc69ea59e649/4e31cb8c-b819-5889-afd6-bc69ea59e649_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1250368,
'Height': 2077,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3712/20493712/interior_boot-1774778459253.jpg',
'Width': 2769},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e31cb8c-b819-5889-afd6-bc69ea59e649/4e31cb8c-b819-5889-afd6-bc69ea59e649_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2690211,
'Height': 1134,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3712/20493712/docs_service_history-1774721097254.jpg?ixlib=js-3.8.0&auto=format&s=135d2e1733e99783674d512e7e5a37df',
'Width': 2824},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e31cb8c-b819-5889-afd6-bc69ea59e649/4e31cb8c-b819-5889-afd6-bc69ea59e649_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2387206,
'Height': 1003,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3712/20493712/docs_service_history-1774721132026.jpg?ixlib=js-3.8.0&auto=format&s=e6a1614f78e213454053c7d9be84a956',
'Width': 2853}],
'price': 28188,
'price_includes_vat': False,
'registration_date': '2019-06-30',
'seats_number': None,
'seller_name': None,
'title': 'BMW X5 xDrive 30d M Sport Auto',
'transmission': 'automatic',
'trim': 'xDrive 30d M Sport Auto',
'vin': 'WBACV62060LM93905',
'year': 2019}
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720493712%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [motorway.uk] INFO: Saving data for 20493712: {'created_time': 1774815131.500047, 'last_price_update_time': 1774815131.500057, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20493712') HTTP/1.1" 204 0
2026-03-29 20:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20485204.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5595/20475595/exterior_front_driver-1774705631705.jpg> (referer: None)
2026-03-29 20:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5595/20475595/exterior_rear_driver-1774705888251.jpg> (referer: None)
2026-03-29 20:12:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0721ec40-eb07-5ddb-a686-6b47fbaded82 with identifier: 20485204
2026-03-29 20:12:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0721ec40-eb07-5ddb-a686-6b47fbaded82 with scrape type 1
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0721ec40-eb07-5ddb-a686-6b47fbaded82
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5204%252F20485204%252Fexterior_front_driver-1774694100415.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5204/20485204/exterior_front_driver-1774694100415.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5204%252F20485204%252Fexterior_rear_driver-1774694119386.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5204/20485204/exterior_rear_driver-1774694119386.jpg not downloaded yet
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5204%252F20485204%252Fexterior_front_passenger-1774694153135.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5204/20485204/exterior_front_passenger-1774694153135.jpg not downloaded yet
2026-03-29 20:12:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20484858.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589c6050>
2026-03-29 20:12:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a91851d-c8c8-5681-a9de-54cb820b5a7c/8a91851d-c8c8-5681-a9de-54cb820b5a7c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5595%252F20475595%252Fexterior_front_driver-1774705631705.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5595/20475595/exterior_front_driver-1774705631705.jpg saved to cache
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8a91851d-c8c8-5681-a9de-54cb820b5a7c
2026-03-29 20:12:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658aa2cd0>
2026-03-29 20:12:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a91851d-c8c8-5681-a9de-54cb820b5a7c/8a91851d-c8c8-5681-a9de-54cb820b5a7c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5595%252F20475595%252Fexterior_rear_driver-1774705888251.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5595/20475595/exterior_rear_driver-1774705888251.jpg saved to cache
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8a91851d-c8c8-5681-a9de-54cb820b5a7c
2026-03-29 20:12:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8a91851d-c8c8-5681-a9de-54cb820b5a7c, skipping ID generation
2026-03-29 20:12:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a91851d-c8c8-5681-a9de-54cb820b5a7c with scrape type 1
2026-03-29 20:12:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8a91851d-c8c8-5681-a9de-54cb820b5a7c sending to next pipeline
2026-03-29 20:12:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8a91851d-c8c8-5681-a9de-54cb820b5a7c, identifier: 20475595
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5204%252F20485204%252Fexterior_rear_passenger-1774694138987.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5204/20485204/exterior_rear_passenger-1774694138987.jpg not downloaded yet
2026-03-29 20:12:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8a91851d-c8c8-5681-a9de-54cb820b5a7c with identifier: 20475595
2026-03-29 20:12:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8a91851d-c8c8-5681-a9de-54cb820b5a7c with identifier: 20475595
2026-03-29 20:12:12 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8a91851d-c8c8-5681-a9de-54cb820b5a7c with identifier: 20475595 to the API
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5595/20475595/exterior_rear_driver-1774705888251.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Electric',
'id': '8a91851d-c8c8-5681-a9de-54cb820b5a7c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OV71 GDO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20475595',
'listing': 'auction',
'location': 'Caerphilly County Borough Blackwood',
'make': 'Hyundai',
'model': 'IONIQ',
'odometer': 42263,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a91851d-c8c8-5681-a9de-54cb820b5a7c/8a91851d-c8c8-5681-a9de-54cb820b5a7c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1229008,
'Height': 2324,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5595/20475595/exterior_front_driver-1774705631705.jpg',
'Width': 3099},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a91851d-c8c8-5681-a9de-54cb820b5a7c/8a91851d-c8c8-5681-a9de-54cb820b5a7c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2242867,
'Height': 2842,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5595/20475595/exterior_rear_driver-1774705888251.jpg',
'Width': 3789},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a91851d-c8c8-5681-a9de-54cb820b5a7c/8a91851d-c8c8-5681-a9de-54cb820b5a7c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2033937,
'Height': 2825,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5595/20475595/exterior_front_passenger-1774706005995.jpg',
'Width': 3766},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a91851d-c8c8-5681-a9de-54cb820b5a7c/8a91851d-c8c8-5681-a9de-54cb820b5a7c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1574093,
'Height': 2399,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5595/20475595/exterior_rear_passenger-1774705915980.jpg',
'Width': 3199},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a91851d-c8c8-5681-a9de-54cb820b5a7c/8a91851d-c8c8-5681-a9de-54cb820b5a7c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3833404,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5595/20475595/interior_front_seats-1774706463895.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a91851d-c8c8-5681-a9de-54cb820b5a7c/8a91851d-c8c8-5681-a9de-54cb820b5a7c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2920373,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5595/20475595/interior_rear_seats-1774706487090.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a91851d-c8c8-5681-a9de-54cb820b5a7c/8a91851d-c8c8-5681-a9de-54cb820b5a7c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2892640,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5595/20475595/interior_dashboard-1774706533202.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a91851d-c8c8-5681-a9de-54cb820b5a7c/8a91851d-c8c8-5681-a9de-54cb820b5a7c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2668326,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5595/20475595/instrument_cluster-1774706552467.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a91851d-c8c8-5681-a9de-54cb820b5a7c/8a91851d-c8c8-5681-a9de-54cb820b5a7c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2693149,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5595/20475595/interior_boot-1774706553598.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a91851d-c8c8-5681-a9de-54cb820b5a7c/8a91851d-c8c8-5681-a9de-54cb820b5a7c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4490011,
'Height': 3775,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5595/20475595/docs_service_history-1774707053371.jpg?ixlib=js-3.8.0&auto=format&s=70e1b438c677f039a72cebb273c014e1',
'Width': 2440}],
'price': 7774,
'price_includes_vat': False,
'registration_date': '2021-09-30',
'seats_number': None,
'seller_name': None,
'title': 'Hyundai Ioniq Premium EV',
'transmission': 'automatic',
'trim': 'Ioniq Premium EV',
'vin': 'KMHC851JUNU083066',
'year': 2021}
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720475595%27 HTTP/1.1" 200 None
2026-03-29 20:12:12 [motorway.uk] INFO: Saving data for 20475595: {'created_time': 1774815132.507874, 'last_price_update_time': 1774815132.507886, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20475595') HTTP/1.1" 204 0
2026-03-29 20:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13623460.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5204%252F20485204%252Finterior_front_seats-1774695368464.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5204/20485204/interior_front_seats-1774695368464.jpg not downloaded yet
2026-03-29 20:12:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d48d50c4-9834-5936-a9aa-fda0ba02f560 with identifier: 20484858
2026-03-29 20:12:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d48d50c4-9834-5936-a9aa-fda0ba02f560 with scrape type 1
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d48d50c4-9834-5936-a9aa-fda0ba02f560
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4858%252F20484858%252Fexterior_front_driver-1774698907439.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4858/20484858/exterior_front_driver-1774698907439.jpg not downloaded yet
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5204%252F20485204%252Finterior_rear_seats-1774695417151.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5204/20485204/interior_rear_seats-1774695417151.jpg not downloaded yet
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4858%252F20484858%252Fexterior_rear_driver-1774698947922.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4858/20484858/exterior_rear_driver-1774698947922.jpg not downloaded yet
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5204%252F20485204%252Finterior_dashboard-1774695404319.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5204/20485204/interior_dashboard-1774695404319.jpg not downloaded yet
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4858%252F20484858%252Fexterior_front_passenger-1774698999007.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4858/20484858/exterior_front_passenger-1774698999007.jpg not downloaded yet
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5204%252F20485204%252Finstrument_cluster-1774695016064.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5204/20485204/instrument_cluster-1774695016064.jpg not downloaded yet
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4858%252F20484858%252Fexterior_rear_passenger-1774698978009.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4858/20484858/exterior_rear_passenger-1774698978009.jpg not downloaded yet
2026-03-29 20:12:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7c9a127-9c7d-50a5-9226-b618e43a603b with identifier: 13623460
2026-03-29 20:12:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7c9a127-9c7d-50a5-9226-b618e43a603b with scrape type 1
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d7c9a127-9c7d-50a5-9226-b618e43a603b
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3460%252F13623460%252Fexterior_front_driver-1774532214778.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3460/13623460/exterior_front_driver-1774532214778.jpeg not downloaded yet
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5204%252F20485204%252Finterior_boot-1774695441053.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5204/20485204/interior_boot-1774695441053.jpg not downloaded yet
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4858%252F20484858%252Finterior_front_seats-1774699927814.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4858/20484858/interior_front_seats-1774699927814.jpg not downloaded yet
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3460%252F13623460%252Fexterior_rear_driver-1774532271702.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3460/13623460/exterior_rear_driver-1774532271702.jpeg not downloaded yet
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5204%252F20485204%252Fdocs_service_history-1774695726726.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8a6d8625968d0d11dda255c81b3e37aa%27 HTTP/1.1" 200 None
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5204/20485204/docs_service_history-1774695726726.jpg?ixlib=js-3.8.0&auto=format&s=8a6d8625968d0d11dda255c81b3e37aa not downloaded yet
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4858%252F20484858%252Finterior_rear_seats-1774699957502.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4858/20484858/interior_rear_seats-1774699957502.jpg not downloaded yet
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3460%252F13623460%252Fexterior_front_passenger-1774532232914.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3460/13623460/exterior_front_passenger-1774532232914.jpeg not downloaded yet
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4858%252F20484858%252Finterior_dashboard-1774699999784.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4858/20484858/interior_dashboard-1774699999784.jpg not downloaded yet
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3460%252F13623460%252Fexterior_rear_passenger-1774532256471.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3460/13623460/exterior_rear_passenger-1774532256471.jpeg not downloaded yet
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4858%252F20484858%252Finstrument_cluster-1774700020558.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4858/20484858/instrument_cluster-1774700020558.jpg not downloaded yet
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3460%252F13623460%252Finterior_front_seats-1774532290431.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3460/13623460/interior_front_seats-1774532290431.jpeg not downloaded yet
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4858%252F20484858%252Finterior_boot-1774700002604.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4858/20484858/interior_boot-1774700002604.jpg not downloaded yet
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3460%252F13623460%252F13623460-interior_dashboard-modified-1774621303317.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3460/13623460/13623460-interior_dashboard-modified-1774621303317.jpeg not downloaded yet
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4858%252F20484858%252Fdocs_service_history-1774700419828.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8bc4162ca44e297d0bb642d221cc908b%27 HTTP/1.1" 200 None
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4858/20484858/docs_service_history-1774700419828.jpg?ixlib=js-3.8.0&auto=format&s=8bc4162ca44e297d0bb642d221cc908b not downloaded yet
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3460%252F13623460%252Finterior_boot-1774532376697.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3460/13623460/interior_boot-1774532376697.jpeg not downloaded yet
2026-03-29 20:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20316056.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3460%252F13623460%252Fdocs_service_history-1774532747187.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9136541ef76f0a6558876911bbc2a417%27 HTTP/1.1" 200 None
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3460/13623460/docs_service_history-1774532747187.jpeg?ixlib=js-3.8.0&auto=format&s=9136541ef76f0a6558876911bbc2a417 not downloaded yet
2026-03-29 20:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5222/20445222/exterior_rear_passenger-1774708867303.jpg> (referer: None)
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3460%252F13623460%252Fwheels_front_driver-1774532408868.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3460/13623460/wheels_front_driver-1774532408868.jpeg not downloaded yet
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3460%252F13623460%252Fwheels_rear_driver-1774532445607.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3460/13623460/wheels_rear_driver-1774532445607.jpeg not downloaded yet
2026-03-29 20:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5222/20445222/exterior_rear_driver-1774708838817.jpg> (referer: None)
2026-03-29 20:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5204/20485204/exterior_rear_driver-1774694119386.jpg> (referer: None)
2026-03-29 20:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9933/19439933/exterior_front_passenger-1774691337401.jpg> (referer: None)
2026-03-29 20:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5222/20445222/exterior_front_passenger-1774708883385.jpg> (referer: None)
2026-03-29 20:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5222/20445222/interior_dashboard-1774712087105.jpg> (referer: None)
2026-03-29 20:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9933/19439933/exterior_front_driver-1774691300361.jpg> (referer: None)
2026-03-29 20:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5222/20445222/instrument_cluster-1774710545899.jpg> (referer: None)
2026-03-29 20:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5204/20485204/exterior_rear_passenger-1774694138987.jpg> (referer: None)
2026-03-29 20:12:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97c2e6bf-a4bd-5cd8-be4c-34c4452376c9 with identifier: 20316056
2026-03-29 20:12:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97c2e6bf-a4bd-5cd8-be4c-34c4452376c9 with scrape type 1
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 97c2e6bf-a4bd-5cd8-be4c-34c4452376c9
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6056%252F20316056%252Fexterior_front_driver-1774543989978.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6056/20316056/exterior_front_driver-1774543989978.jpg not downloaded yet
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6056%252F20316056%252Fexterior_rear_driver-1774544014074.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6056/20316056/exterior_rear_driver-1774544014074.jpg not downloaded yet
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6056%252F20316056%252Fexterior_front_passenger-1774544046718.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6056/20316056/exterior_front_passenger-1774544046718.jpg not downloaded yet
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659af1c10>
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76711b8f-a805-5b8d-b9f7-930302629b4f/76711b8f-a805-5b8d-b9f7-930302629b4f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5222%252F20445222%252Fexterior_rear_passenger-1774708867303.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5222/20445222/exterior_rear_passenger-1774708867303.jpg saved to cache
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 76711b8f-a805-5b8d-b9f7-930302629b4f
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6056%252F20316056%252Fexterior_rear_passenger-1774544028155.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6056/20316056/exterior_rear_passenger-1774544028155.jpg not downloaded yet
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6056%252F20316056%252Finterior_front_seats-1774544667569.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6056/20316056/interior_front_seats-1774544667569.jpg not downloaded yet
2026-03-29 20:12:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5222/20445222/interior_front_seats-1774709433164.jpg> (referer: None)
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6056%252F20316056%252Finterior_rear_seats-1774544675661.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6056/20316056/interior_rear_seats-1774544675661.jpg not downloaded yet
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589f16d0>
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76711b8f-a805-5b8d-b9f7-930302629b4f/76711b8f-a805-5b8d-b9f7-930302629b4f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5222%252F20445222%252Fexterior_rear_driver-1774708838817.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5222/20445222/exterior_rear_driver-1774708838817.jpg saved to cache
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 76711b8f-a805-5b8d-b9f7-930302629b4f
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599c3b50>
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0721ec40-eb07-5ddb-a686-6b47fbaded82/0721ec40-eb07-5ddb-a686-6b47fbaded82_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5204%252F20485204%252Fexterior_rear_driver-1774694119386.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5204/20485204/exterior_rear_driver-1774694119386.jpg saved to cache
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0721ec40-eb07-5ddb-a686-6b47fbaded82
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599c0c50>
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_638c1877-1923-56ce-9b59-81661e7ea35a/638c1877-1923-56ce-9b59-81661e7ea35a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9933%252F19439933%252Fexterior_front_passenger-1774691337401.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9933/19439933/exterior_front_passenger-1774691337401.jpg saved to cache
2026-03-29 20:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 638c1877-1923-56ce-9b59-81661e7ea35a
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65bf03710>
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76711b8f-a805-5b8d-b9f7-930302629b4f/76711b8f-a805-5b8d-b9f7-930302629b4f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5222%252F20445222%252Fexterior_front_passenger-1774708883385.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5222/20445222/exterior_front_passenger-1774708883385.jpg saved to cache
2026-03-29 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 76711b8f-a805-5b8d-b9f7-930302629b4f
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65853dc50>
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76711b8f-a805-5b8d-b9f7-930302629b4f/76711b8f-a805-5b8d-b9f7-930302629b4f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5222%252F20445222%252Finterior_dashboard-1774712087105.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5222/20445222/interior_dashboard-1774712087105.jpg saved to cache
2026-03-29 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 76711b8f-a805-5b8d-b9f7-930302629b4f
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599c0750>
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_638c1877-1923-56ce-9b59-81661e7ea35a/638c1877-1923-56ce-9b59-81661e7ea35a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9933%252F19439933%252Fexterior_front_driver-1774691300361.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9933/19439933/exterior_front_driver-1774691300361.jpg saved to cache
2026-03-29 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 638c1877-1923-56ce-9b59-81661e7ea35a
2026-03-29 20:12:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 638c1877-1923-56ce-9b59-81661e7ea35a, skipping ID generation
2026-03-29 20:12:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 638c1877-1923-56ce-9b59-81661e7ea35a with scrape type 1
2026-03-29 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 638c1877-1923-56ce-9b59-81661e7ea35a sending to next pipeline
2026-03-29 20:12:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 638c1877-1923-56ce-9b59-81661e7ea35a, identifier: 19439933
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659af0f50>
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76711b8f-a805-5b8d-b9f7-930302629b4f/76711b8f-a805-5b8d-b9f7-930302629b4f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5222%252F20445222%252Finstrument_cluster-1774710545899.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5222/20445222/instrument_cluster-1774710545899.jpg saved to cache
2026-03-29 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 76711b8f-a805-5b8d-b9f7-930302629b4f
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589f22d0>
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0721ec40-eb07-5ddb-a686-6b47fbaded82/0721ec40-eb07-5ddb-a686-6b47fbaded82_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5204%252F20485204%252Fexterior_rear_passenger-1774694138987.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5204/20485204/exterior_rear_passenger-1774694138987.jpg saved to cache
2026-03-29 20:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0721ec40-eb07-5ddb-a686-6b47fbaded82
2026-03-29 20:12:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 638c1877-1923-56ce-9b59-81661e7ea35a with identifier: 19439933
2026-03-29 20:12:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 638c1877-1923-56ce-9b59-81661e7ea35a with identifier: 19439933
2026-03-29 20:12:14 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 638c1877-1923-56ce-9b59-81661e7ea35a with identifier: 19439933 to the API
2026-03-29 20:12:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9933/19439933/exterior_front_driver-1774691300361.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '638c1877-1923-56ce-9b59-81661e7ea35a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KU75 ZXA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19439933',
'listing': 'auction',
'location': 'West Sussex Haywards Heath',
'make': 'Audi',
'model': 'A7',
'odometer': 2900,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_638c1877-1923-56ce-9b59-81661e7ea35a/638c1877-1923-56ce-9b59-81661e7ea35a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2277678,
'Height': 2522,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9933/19439933/exterior_front_driver-1774691300361.jpg',
'Width': 3363},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_638c1877-1923-56ce-9b59-81661e7ea35a/638c1877-1923-56ce-9b59-81661e7ea35a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2902662,
'Height': 2912,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9933/19439933/exterior_rear_driver-1774691311036.jpg',
'Width': 3882},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_638c1877-1923-56ce-9b59-81661e7ea35a/638c1877-1923-56ce-9b59-81661e7ea35a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1893328,
'Height': 2386,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9933/19439933/exterior_front_passenger-1774691337401.jpg',
'Width': 3181},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_638c1877-1923-56ce-9b59-81661e7ea35a/638c1877-1923-56ce-9b59-81661e7ea35a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2444399,
'Height': 2914,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9933/19439933/exterior_rear_passenger-1774691314998.jpg',
'Width': 3885},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_638c1877-1923-56ce-9b59-81661e7ea35a/638c1877-1923-56ce-9b59-81661e7ea35a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2809087,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9933/19439933/interior_front_seats-1774699405878.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_638c1877-1923-56ce-9b59-81661e7ea35a/638c1877-1923-56ce-9b59-81661e7ea35a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4449673,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9933/19439933/interior_rear_seats-1774691771920.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_638c1877-1923-56ce-9b59-81661e7ea35a/638c1877-1923-56ce-9b59-81661e7ea35a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2746634,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9933/19439933/interior_dashboard-1774699421932.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_638c1877-1923-56ce-9b59-81661e7ea35a/638c1877-1923-56ce-9b59-81661e7ea35a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1528738,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9933/19439933/instrument_cluster-1774699435929.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_638c1877-1923-56ce-9b59-81661e7ea35a/638c1877-1923-56ce-9b59-81661e7ea35a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3532956,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9933/19439933/interior_boot-1774692119349.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_638c1877-1923-56ce-9b59-81661e7ea35a/638c1877-1923-56ce-9b59-81661e7ea35a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2067767,
'Height': 2903,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9933/19439933/wheels_front_driver-1774691385202.jpg',
'Width': 3871}],
'price': 39300,
'price_includes_vat': False,
'registration_date': '2025-09-24',
'seats_number': None,
'seller_name': None,
'title': 'Audi A7 S Line 45 TFSI MHEV Quat SA',
'transmission': 'automatic',
'trim': 'S Line 45 TFSI MHEV Quat SA',
'vin': 'WAUZZZF21SN001462',
'year': 2025}
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719439933%27 HTTP/1.1" 200 None
2026-03-29 20:12:15 [motorway.uk] INFO: Saving data for 19439933: {'created_time': 1774815135.13526, 'last_price_update_time': 1774815135.135273, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19439933') HTTP/1.1" 204 0
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6056%252F20316056%252Finterior_dashboard-1774544698317.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6056/20316056/interior_dashboard-1774544698317.jpg not downloaded yet
2026-03-29 20:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13059915.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6056%252F20316056%252Finstrument_cluster-1774544774505.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6056/20316056/instrument_cluster-1774544774505.jpg not downloaded yet
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c1bbd0>
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76711b8f-a805-5b8d-b9f7-930302629b4f/76711b8f-a805-5b8d-b9f7-930302629b4f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5222%252F20445222%252Finterior_front_seats-1774709433164.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5222/20445222/interior_front_seats-1774709433164.jpg saved to cache
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 76711b8f-a805-5b8d-b9f7-930302629b4f
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6056%252F20316056%252Finterior_boot-1774544705322.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6056/20316056/interior_boot-1774544705322.jpg not downloaded yet
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6056%252F20316056%252Fdocs_service_history-1774595555890.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1138eaffbd80ffb39046d5093877e222%27 HTTP/1.1" 200 None
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6056/20316056/docs_service_history-1774595555890.jpg?ixlib=js-3.8.0&auto=format&s=1138eaffbd80ffb39046d5093877e222 not downloaded yet
2026-03-29 20:12:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 744e62d4-2c73-5caa-81f3-18c326fa97b3 with identifier: 13059915
2026-03-29 20:12:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 744e62d4-2c73-5caa-81f3-18c326fa97b3 with scrape type 1
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 744e62d4-2c73-5caa-81f3-18c326fa97b3
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9915%252F13059915%252Fexterior_front_driver-1774690376460.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9915/13059915/exterior_front_driver-1774690376460.jpg not downloaded yet
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9915%252F13059915%252Fexterior_rear_driver-1774690393009.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9915/13059915/exterior_rear_driver-1774690393009.jpg not downloaded yet
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9915%252F13059915%252Fexterior_front_passenger-1774702675930.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9915/13059915/exterior_front_passenger-1774702675930.jpg not downloaded yet
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9915%252F13059915%252Fexterior_rear_passenger-1774702685405.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9915/13059915/exterior_rear_passenger-1774702685405.jpg not downloaded yet
2026-03-29 20:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20455021.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=324&page=9&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9915%252F13059915%252Finterior_front_seats-1774702696386.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9915/13059915/interior_front_seats-1774702696386.jpg not downloaded yet
2026-03-29 20:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5222/20445222/interior_rear_seats-1774710284759.jpg> (referer: None)
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9915%252F13059915%252Finterior_rear_seats-1774694743574.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9915/13059915/interior_rear_seats-1774694743574.jpg not downloaded yet
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9915%252F13059915%252Finterior_dashboard-1774694789098.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9915/13059915/interior_dashboard-1774694789098.jpg not downloaded yet
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9915%252F13059915%252Finstrument_cluster-1774694828022.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9915/13059915/instrument_cluster-1774694828022.jpg not downloaded yet
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9915%252F13059915%252Finterior_boot-1774695821563.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9915/13059915/interior_boot-1774695821563.jpg not downloaded yet
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9915%252F13059915%252Fdocs_service_history-1774702438845.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db8664cffd9b4eb559e98d98dd70dba73%27 HTTP/1.1" 200 None
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9915/13059915/docs_service_history-1774702438845.jpg?ixlib=js-3.8.0&auto=format&s=b8664cffd9b4eb559e98d98dd70dba73 not downloaded yet
2026-03-29 20:12:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c9d9d90-2edb-5a25-9711-964e615e77b7 with identifier: 20455021
2026-03-29 20:12:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c9d9d90-2edb-5a25-9711-964e615e77b7 with scrape type 1
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7c9d9d90-2edb-5a25-9711-964e615e77b7
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5021%252F20455021%252F20455021-exterior_front_driver-modified-1774774206868.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5021/20455021/20455021-exterior_front_driver-modified-1774774206868.jpeg not downloaded yet
2026-03-29 20:12:15 [motorway.uk] INFO: Found listing with ID: 20418717
2026-03-29 20:12:15 [motorway.uk] INFO: Found listing with ID: 20488067
2026-03-29 20:12:15 [motorway.uk] INFO: Found listing with ID: 20395274
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720395274%27 HTTP/1.1" 200 None
2026-03-29 20:12:15 [motorway.uk] INFO: Scrape type for 20395274: 1
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5021%252F20455021%252F20455021-exterior_rear_driver-modified-1774773106239.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5021/20455021/20455021-exterior_rear_driver-modified-1774773106239.jpeg not downloaded yet
2026-03-29 20:12:15 [motorway.uk] INFO: Found listing with ID: 20486896
2026-03-29 20:12:15 [motorway.uk] INFO: Found listing with ID: 20440824
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720440824%27 HTTP/1.1" 200 None
2026-03-29 20:12:15 [motorway.uk] INFO: Scrape type for 20440824: 1
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cc5350>
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76711b8f-a805-5b8d-b9f7-930302629b4f/76711b8f-a805-5b8d-b9f7-930302629b4f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5222%252F20445222%252Finterior_rear_seats-1774710284759.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5222/20445222/interior_rear_seats-1774710284759.jpg saved to cache
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 76711b8f-a805-5b8d-b9f7-930302629b4f
2026-03-29 20:12:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5021%252F20455021%252F20455021-exterior_front_passenger-modified-1774773026613.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5021/20455021/20455021-exterior_front_passenger-modified-1774773026613.jpeg not downloaded yet
2026-03-29 20:12:15 [motorway.uk] INFO: Found listing with ID: 20375069
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720375069%27 HTTP/1.1" 200 None
2026-03-29 20:12:16 [motorway.uk] INFO: Scrape type for 20375069: 1
2026-03-29 20:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3460/13623460/interior_boot-1774532376697.jpeg> (referer: None)
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5021%252F20455021%252F20455021-exterior_rear_passenger-modified-1774772910482.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5021/20455021/20455021-exterior_rear_passenger-modified-1774772910482.jpeg not downloaded yet
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 20346137
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 18144090
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 20494274
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 17611268
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 20483899
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 20483826
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720483826%27 HTTP/1.1" 200 None
2026-03-29 20:12:16 [motorway.uk] INFO: Scrape type for 20483826: 1
2026-03-29 20:12:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5021%252F20455021%252F20455021-interior_front_seats-modified-1774772825223.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5021/20455021/20455021-interior_front_seats-modified-1774772825223.jpeg not downloaded yet
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 20469913
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 20459015
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 20471501
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 16772824
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 20121550
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 17470157
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 19824525
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 20370017
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 20382041
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 20428604
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 20185351
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 14545909
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714545909%27 HTTP/1.1" 200 None
2026-03-29 20:12:16 [motorway.uk] INFO: Scrape type for 14545909: 1
2026-03-29 20:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3460/13623460/wheels_front_driver-1774532408868.jpeg> (referer: None)
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5021%252F20455021%252F20455021-interior_rear_seats-modified-1774772807361.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5021/20455021/20455021-interior_rear_seats-modified-1774772807361.jpeg not downloaded yet
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 20188633
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720188633%27 HTTP/1.1" 200 None
2026-03-29 20:12:16 [motorway.uk] INFO: Scrape type for 20188633: 1
2026-03-29 20:12:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:16 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 146 - value: b'Apple\x00'
2026-03-29 20:12:16 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'iPhone 11\x00'
2026-03-29 20:12:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 162 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 170 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:16 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 178 - value: b'26.3.1\x00'
2026-03-29 20:12:16 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 186 - value: b'2026:03:26 13:39:32\x00'
2026-03-29 20:12:16 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 206 - value: b'iPhone 11\x00'
2026-03-29 20:12:16 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xd8'
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a7c810>
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7c9a127-9c7d-50a5-9226-b618e43a603b/d7c9a127-9c7d-50a5-9226-b618e43a603b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3460%252F13623460%252Finterior_boot-1774532376697.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3460/13623460/interior_boot-1774532376697.jpeg saved to cache
2026-03-29 20:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d7c9a127-9c7d-50a5-9226-b618e43a603b
2026-03-29 20:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/9915/13059915/docs_service_history-1774702438845.jpg?ixlib=js-3.8.0&auto=format&s=b8664cffd9b4eb559e98d98dd70dba73> (referer: None)
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5021%252F20455021%252F20455021-interior_dashboard-modified-1774772788496.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5021/20455021/20455021-interior_dashboard-modified-1774772788496.jpeg not downloaded yet
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 17103119
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 19976195
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 20476001
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 20489379
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 14248545
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714248545%27 HTTP/1.1" 200 None
2026-03-29 20:12:16 [motorway.uk] INFO: Scrape type for 14248545: 1
2026-03-29 20:12:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5021%252F20455021%252Finstrument_cluster-1774721496316.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5021/20455021/instrument_cluster-1774721496316.jpg not downloaded yet
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 20489087
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720489087%27 HTTP/1.1" 200 None
2026-03-29 20:12:16 [motorway.uk] INFO: Scrape type for 20489087: 1
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5021%252F20455021%252F20455021-interior_boot-modified-1774772766057.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5021/20455021/20455021-interior_boot-modified-1774772766057.jpeg not downloaded yet
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 9706336
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 20235497
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 19465246
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 20474206
2026-03-29 20:12:16 [motorway.uk] INFO: Found listing with ID: 17699246
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658356bd0>
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7c9a127-9c7d-50a5-9226-b618e43a603b/d7c9a127-9c7d-50a5-9226-b618e43a603b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3460%252F13623460%252Fwheels_front_driver-1774532408868.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3460/13623460/wheels_front_driver-1774532408868.jpeg saved to cache
2026-03-29 20:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d7c9a127-9c7d-50a5-9226-b618e43a603b
2026-03-29 20:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3460/13623460/wheels_rear_driver-1774532445607.jpeg> (referer: None)
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5021%252F20455021%252Fdocs_service_history-1774641013048.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D281c81df0159e3acad4be340c16f4059%27 HTTP/1.1" 200 None
2026-03-29 20:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5021/20455021/docs_service_history-1774641013048.jpg?ixlib=js-3.8.0&auto=format&s=281c81df0159e3acad4be340c16f4059 not downloaded yet
2026-03-29 20:12:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d5af10>
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_744e62d4-2c73-5caa-81f3-18c326fa97b3/744e62d4-2c73-5caa-81f3-18c326fa97b3_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9915%252F13059915%252Fdocs_service_history-1774702438845.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db8664cffd9b4eb559e98d98dd70dba73') HTTP/1.1" 204 0
2026-03-29 20:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9915/13059915/docs_service_history-1774702438845.jpg?ixlib=js-3.8.0&auto=format&s=b8664cffd9b4eb559e98d98dd70dba73 saved to cache
2026-03-29 20:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 744e62d4-2c73-5caa-81f3-18c326fa97b3
2026-03-29 20:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6056/20316056/instrument_cluster-1774544774505.jpg> (referer: None)
2026-03-29 20:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6056/20316056/exterior_rear_driver-1774544014074.jpg> (referer: None)
2026-03-29 20:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6056/20316056/exterior_rear_passenger-1774544028155.jpg> (referer: None)
2026-03-29 20:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5021/20455021/20455021-exterior_front_driver-modified-1774774206868.jpeg> (referer: None)
2026-03-29 20:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6056/20316056/exterior_front_driver-1774543989978.jpg> (referer: None)
2026-03-29 20:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3460/13623460/docs_service_history-1774532747187.jpeg?ixlib=js-3.8.0&auto=format&s=9136541ef76f0a6558876911bbc2a417> (referer: None)
2026-03-29 20:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6056/20316056/exterior_front_passenger-1774544046718.jpg> (referer: None)
2026-03-29 20:12:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6056/20316056/interior_dashboard-1774544698317.jpg> (referer: None)
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599dc9d0>
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7c9a127-9c7d-50a5-9226-b618e43a603b/d7c9a127-9c7d-50a5-9226-b618e43a603b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3460%252F13623460%252Fwheels_rear_driver-1774532445607.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3460/13623460/wheels_rear_driver-1774532445607.jpeg saved to cache
2026-03-29 20:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d7c9a127-9c7d-50a5-9226-b618e43a603b
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599dde10>
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c2e6bf-a4bd-5cd8-be4c-34c4452376c9/97c2e6bf-a4bd-5cd8-be4c-34c4452376c9_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6056%252F20316056%252Finstrument_cluster-1774544774505.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6056/20316056/instrument_cluster-1774544774505.jpg saved to cache
2026-03-29 20:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 97c2e6bf-a4bd-5cd8-be4c-34c4452376c9
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ad2f90>
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c2e6bf-a4bd-5cd8-be4c-34c4452376c9/97c2e6bf-a4bd-5cd8-be4c-34c4452376c9_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6056%252F20316056%252Fexterior_rear_driver-1774544014074.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6056/20316056/exterior_rear_driver-1774544014074.jpg saved to cache
2026-03-29 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 97c2e6bf-a4bd-5cd8-be4c-34c4452376c9
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659aa8510>
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c2e6bf-a4bd-5cd8-be4c-34c4452376c9/97c2e6bf-a4bd-5cd8-be4c-34c4452376c9_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6056%252F20316056%252Fexterior_rear_passenger-1774544028155.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6056/20316056/exterior_rear_passenger-1774544028155.jpg saved to cache
2026-03-29 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 97c2e6bf-a4bd-5cd8-be4c-34c4452376c9
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ad2750>
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c9d9d90-2edb-5a25-9711-964e615e77b7/7c9d9d90-2edb-5a25-9711-964e615e77b7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5021%252F20455021%252F20455021-exterior_front_driver-modified-1774774206868.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5021/20455021/20455021-exterior_front_driver-modified-1774774206868.jpeg saved to cache
2026-03-29 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c9d9d90-2edb-5a25-9711-964e615e77b7
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e94290>
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c2e6bf-a4bd-5cd8-be4c-34c4452376c9/97c2e6bf-a4bd-5cd8-be4c-34c4452376c9_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6056%252F20316056%252Fexterior_front_driver-1774543989978.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6056/20316056/exterior_front_driver-1774543989978.jpg saved to cache
2026-03-29 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97c2e6bf-a4bd-5cd8-be4c-34c4452376c9
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ad3290>
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7c9a127-9c7d-50a5-9226-b618e43a603b/d7c9a127-9c7d-50a5-9226-b618e43a603b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3460%252F13623460%252Fdocs_service_history-1774532747187.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9136541ef76f0a6558876911bbc2a417') HTTP/1.1" 204 0
2026-03-29 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3460/13623460/docs_service_history-1774532747187.jpeg?ixlib=js-3.8.0&auto=format&s=9136541ef76f0a6558876911bbc2a417 saved to cache
2026-03-29 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d7c9a127-9c7d-50a5-9226-b618e43a603b
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659aa9f90>
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c2e6bf-a4bd-5cd8-be4c-34c4452376c9/97c2e6bf-a4bd-5cd8-be4c-34c4452376c9_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6056%252F20316056%252Fexterior_front_passenger-1774544046718.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6056/20316056/exterior_front_passenger-1774544046718.jpg saved to cache
2026-03-29 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 97c2e6bf-a4bd-5cd8-be4c-34c4452376c9
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ad25d0>
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c2e6bf-a4bd-5cd8-be4c-34c4452376c9/97c2e6bf-a4bd-5cd8-be4c-34c4452376c9_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6056%252F20316056%252Finterior_dashboard-1774544698317.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6056/20316056/interior_dashboard-1774544698317.jpg saved to cache
2026-03-29 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 97c2e6bf-a4bd-5cd8-be4c-34c4452376c9
2026-03-29 20:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16318590.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6056/20316056/interior_rear_seats-1774544675661.jpg> (referer: None)
2026-03-29 20:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5021/20455021/docs_service_history-1774641013048.jpg?ixlib=js-3.8.0&auto=format&s=281c81df0159e3acad4be340c16f4059> (referer: None)
2026-03-29 20:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6056/20316056/interior_front_seats-1774544667569.jpg> (referer: None)
2026-03-29 20:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5021/20455021/20455021-interior_boot-modified-1774772766057.jpeg> (referer: None)
2026-03-29 20:12:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ae620fb-8abe-5723-810d-75deb7c2265b with identifier: 16318590
2026-03-29 20:12:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ae620fb-8abe-5723-810d-75deb7c2265b with scrape type 1
2026-03-29 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5ae620fb-8abe-5723-810d-75deb7c2265b
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8590%252F16318590%252Fexterior_front_driver-1774709978071.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8590/16318590/exterior_front_driver-1774709978071.jpg not downloaded yet
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8590%252F16318590%252Fexterior_rear_driver-1774710020679.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8590/16318590/exterior_rear_driver-1774710020679.jpg not downloaded yet
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8590%252F16318590%252Fexterior_front_passenger-1774710623029.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8590/16318590/exterior_front_passenger-1774710623029.jpg not downloaded yet
2026-03-29 20:12:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d99590>
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c2e6bf-a4bd-5cd8-be4c-34c4452376c9/97c2e6bf-a4bd-5cd8-be4c-34c4452376c9_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6056%252F20316056%252Finterior_rear_seats-1774544675661.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6056/20316056/interior_rear_seats-1774544675661.jpg saved to cache
2026-03-29 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 97c2e6bf-a4bd-5cd8-be4c-34c4452376c9
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cce350>
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c9d9d90-2edb-5a25-9711-964e615e77b7/7c9d9d90-2edb-5a25-9711-964e615e77b7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5021%252F20455021%252Fdocs_service_history-1774641013048.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D281c81df0159e3acad4be340c16f4059') HTTP/1.1" 204 0
2026-03-29 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5021/20455021/docs_service_history-1774641013048.jpg?ixlib=js-3.8.0&auto=format&s=281c81df0159e3acad4be340c16f4059 saved to cache
2026-03-29 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7c9d9d90-2edb-5a25-9711-964e615e77b7
2026-03-29 20:12:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ccced0>
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97c2e6bf-a4bd-5cd8-be4c-34c4452376c9/97c2e6bf-a4bd-5cd8-be4c-34c4452376c9_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6056%252F20316056%252Finterior_front_seats-1774544667569.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6056/20316056/interior_front_seats-1774544667569.jpg saved to cache
2026-03-29 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 97c2e6bf-a4bd-5cd8-be4c-34c4452376c9
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e84690>
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c9d9d90-2edb-5a25-9711-964e615e77b7/7c9d9d90-2edb-5a25-9711-964e615e77b7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5021%252F20455021%252F20455021-interior_boot-modified-1774772766057.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5021/20455021/20455021-interior_boot-modified-1774772766057.jpeg saved to cache
2026-03-29 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7c9d9d90-2edb-5a25-9711-964e615e77b7
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8590%252F16318590%252Fexterior_rear_passenger-1774710017564.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8590/16318590/exterior_rear_passenger-1774710017564.jpg not downloaded yet
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8590%252F16318590%252Finterior_front_seats-1774710450575.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8590/16318590/interior_front_seats-1774710450575.jpg not downloaded yet
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8590%252F16318590%252Finterior_rear_seats-1774710475273.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8590/16318590/interior_rear_seats-1774710475273.jpg not downloaded yet
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8590%252F16318590%252Finterior_dashboard-1774715678164.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8590/16318590/interior_dashboard-1774715678164.jpg not downloaded yet
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8590%252F16318590%252Finstrument_cluster-1774710537926.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8590/16318590/instrument_cluster-1774710537926.jpg not downloaded yet
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8590%252F16318590%252Finterior_boot-1774715960973.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8590/16318590/interior_boot-1774715960973.jpg not downloaded yet
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8590%252F16318590%252Fdocs_service_history-1774710787468.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D01d8b508f5b85cb4daee77b22c290376%27 HTTP/1.1" 200 None
2026-03-29 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8590/16318590/docs_service_history-1774710787468.jpg?ixlib=js-3.8.0&auto=format&s=01d8b508f5b85cb4daee77b22c290376 not downloaded yet
2026-03-29 20:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14545909.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5021/20455021/20455021-interior_rear_seats-modified-1774772807361.jpeg> (referer: None)
2026-03-29 20:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5021/20455021/instrument_cluster-1774721496316.jpg> (referer: None)
2026-03-29 20:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5021/20455021/20455021-interior_dashboard-modified-1774772788496.jpeg> (referer: None)
2026-03-29 20:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5021/20455021/20455021-interior_front_seats-modified-1774772825223.jpeg> (referer: None)
2026-03-29 20:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8590/16318590/exterior_front_driver-1774709978071.jpg> (referer: None)
2026-03-29 20:12:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2abd2501-9460-592c-b79c-9a443f1d59f9 with identifier: 14545909
2026-03-29 20:12:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2abd2501-9460-592c-b79c-9a443f1d59f9 with scrape type 1
2026-03-29 20:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2abd2501-9460-592c-b79c-9a443f1d59f9
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5909%252F14545909%252Fexterior_front_driver-1770199181488.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5909/14545909/exterior_front_driver-1770199181488.jpg not downloaded yet
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5909%252F14545909%252Fexterior_rear_driver-1770199218956.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5909/14545909/exterior_rear_driver-1770199218956.jpg not downloaded yet
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5909%252F14545909%252Fexterior_front_passenger-1774713708029.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5909/14545909/exterior_front_passenger-1774713708029.jpg not downloaded yet
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a6b350>
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c9d9d90-2edb-5a25-9711-964e615e77b7/7c9d9d90-2edb-5a25-9711-964e615e77b7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5021%252F20455021%252F20455021-interior_rear_seats-modified-1774772807361.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5021/20455021/20455021-interior_rear_seats-modified-1774772807361.jpeg saved to cache
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7c9d9d90-2edb-5a25-9711-964e615e77b7
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b0dfd0>
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c9d9d90-2edb-5a25-9711-964e615e77b7/7c9d9d90-2edb-5a25-9711-964e615e77b7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5021%252F20455021%252Finstrument_cluster-1774721496316.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5021/20455021/instrument_cluster-1774721496316.jpg saved to cache
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7c9d9d90-2edb-5a25-9711-964e615e77b7
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e73f90>
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c9d9d90-2edb-5a25-9711-964e615e77b7/7c9d9d90-2edb-5a25-9711-964e615e77b7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5021%252F20455021%252F20455021-interior_dashboard-modified-1774772788496.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5021/20455021/20455021-interior_dashboard-modified-1774772788496.jpeg saved to cache
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7c9d9d90-2edb-5a25-9711-964e615e77b7
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e70850>
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c9d9d90-2edb-5a25-9711-964e615e77b7/7c9d9d90-2edb-5a25-9711-964e615e77b7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5021%252F20455021%252F20455021-interior_front_seats-modified-1774772825223.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5021/20455021/20455021-interior_front_seats-modified-1774772825223.jpeg saved to cache
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7c9d9d90-2edb-5a25-9711-964e615e77b7
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5909%252F14545909%252Fexterior_rear_passenger-1770199226374.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5909/14545909/exterior_rear_passenger-1770199226374.jpg not downloaded yet
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e4d290>
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ae620fb-8abe-5723-810d-75deb7c2265b/5ae620fb-8abe-5723-810d-75deb7c2265b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8590%252F16318590%252Fexterior_front_driver-1774709978071.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8590/16318590/exterior_front_driver-1774709978071.jpg saved to cache
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5ae620fb-8abe-5723-810d-75deb7c2265b
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5909%252F14545909%252Finterior_front_seats-1774713721785.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5909/14545909/interior_front_seats-1774713721785.jpg not downloaded yet
2026-03-29 20:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=360&page=10&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5909%252F14545909%252Finterior_rear_seats-1774713738868.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5909/14545909/interior_rear_seats-1774713738868.jpg not downloaded yet
2026-03-29 20:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8590/16318590/docs_service_history-1774710787468.jpg?ixlib=js-3.8.0&auto=format&s=01d8b508f5b85cb4daee77b22c290376> (referer: None)
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5909%252F14545909%252Finterior_dashboard-1774713761646.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5909/14545909/interior_dashboard-1774713761646.jpg not downloaded yet
2026-03-29 20:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20375069.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5909%252F14545909%252Finstrument_cluster-1770199784942.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5909/14545909/instrument_cluster-1770199784942.jpg not downloaded yet
2026-03-29 20:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8590/16318590/interior_boot-1774715960973.jpg> (referer: None)
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5909%252F14545909%252Finterior_boot-1774713774778.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5909/14545909/interior_boot-1774713774778.jpg not downloaded yet
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F5909%252F14545909%252Fdocs_service_history-1770291895528.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D68fa0814af2c2bf0c0e8a0f8082c4183%27 HTTP/1.1" 200 None
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/5909/14545909/docs_service_history-1770291895528.jpg?ixlib=js-3.8.0&auto=format&s=68fa0814af2c2bf0c0e8a0f8082c4183 not downloaded yet
2026-03-29 20:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20188633.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:19 [motorway.uk] INFO: Found listing with ID: 18969142
2026-03-29 20:12:19 [motorway.uk] INFO: Found listing with ID: 19163712
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719163712%27 HTTP/1.1" 200 None
2026-03-29 20:12:19 [motorway.uk] INFO: Scrape type for 19163712: 1
2026-03-29 20:12:19 [motorway.uk] INFO: Found listing with ID: 10452717
2026-03-29 20:12:19 [motorway.uk] INFO: Found listing with ID: 18171472
2026-03-29 20:12:19 [motorway.uk] INFO: Found listing with ID: 20302141
2026-03-29 20:12:19 [motorway.uk] INFO: Found listing with ID: 20404971
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720404971%27 HTTP/1.1" 200 None
2026-03-29 20:12:19 [motorway.uk] INFO: Scrape type for 20404971: 1
2026-03-29 20:12:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584c6b50>
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ae620fb-8abe-5723-810d-75deb7c2265b/5ae620fb-8abe-5723-810d-75deb7c2265b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8590%252F16318590%252Fdocs_service_history-1774710787468.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D01d8b508f5b85cb4daee77b22c290376') HTTP/1.1" 204 0
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8590/16318590/docs_service_history-1774710787468.jpg?ixlib=js-3.8.0&auto=format&s=01d8b508f5b85cb4daee77b22c290376 saved to cache
2026-03-29 20:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5ae620fb-8abe-5723-810d-75deb7c2265b
2026-03-29 20:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8590/16318590/exterior_rear_driver-1774710020679.jpg> (referer: None)
2026-03-29 20:12:19 [motorway.uk] INFO: Found listing with ID: 19535149
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719535149%27 HTTP/1.1" 200 None
2026-03-29 20:12:19 [motorway.uk] INFO: Scrape type for 19535149: 1
2026-03-29 20:12:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca95e281-722d-5524-af50-e20c753704bd with identifier: 20375069
2026-03-29 20:12:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca95e281-722d-5524-af50-e20c753704bd with scrape type 1
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ca95e281-722d-5524-af50-e20c753704bd
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5069%252F20375069%252F20375069-exterior_front_driver-modified-1774710995586.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5069/20375069/20375069-exterior_front_driver-modified-1774710995586.jpeg not downloaded yet
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65856a5d0>
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ae620fb-8abe-5723-810d-75deb7c2265b/5ae620fb-8abe-5723-810d-75deb7c2265b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8590%252F16318590%252Finterior_boot-1774715960973.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8590/16318590/interior_boot-1774715960973.jpg saved to cache
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5ae620fb-8abe-5723-810d-75deb7c2265b
2026-03-29 20:12:20 [motorway.uk] INFO: Found listing with ID: 20368231
2026-03-29 20:12:20 [motorway.uk] INFO: Found listing with ID: 19585852
2026-03-29 20:12:20 [motorway.uk] INFO: Found listing with ID: 20303922
2026-03-29 20:12:20 [motorway.uk] INFO: Found listing with ID: 19960180
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719960180%27 HTTP/1.1" 200 None
2026-03-29 20:12:20 [motorway.uk] INFO: Scrape type for 19960180: 1
2026-03-29 20:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8590/16318590/exterior_front_passenger-1774710623029.jpg> (referer: None)
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5069%252F20375069%252Fexterior_rear_driver-1774547293591.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5069/20375069/exterior_rear_driver-1774547293591.jpg not downloaded yet
2026-03-29 20:12:20 [motorway.uk] INFO: Found listing with ID: 17662839
2026-03-29 20:12:20 [motorway.uk] INFO: Found listing with ID: 20459994
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720459994%27 HTTP/1.1" 200 None
2026-03-29 20:12:20 [motorway.uk] INFO: Scrape type for 20459994: 1
2026-03-29 20:12:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce090b55-06ff-5006-8916-c6981ec81536 with identifier: 20188633
2026-03-29 20:12:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce090b55-06ff-5006-8916-c6981ec81536 with scrape type 1
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ce090b55-06ff-5006-8916-c6981ec81536
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8633%252F20188633%252Fexterior_front_driver-1774694157539.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8633/20188633/exterior_front_driver-1774694157539.jpg not downloaded yet
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e86c50>
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ae620fb-8abe-5723-810d-75deb7c2265b/5ae620fb-8abe-5723-810d-75deb7c2265b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8590%252F16318590%252Fexterior_rear_driver-1774710020679.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8590/16318590/exterior_rear_driver-1774710020679.jpg saved to cache
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5ae620fb-8abe-5723-810d-75deb7c2265b
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5069%252F20375069%252F20375069-exterior_front_passenger-modified-1774711003434.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5069/20375069/20375069-exterior_front_passenger-modified-1774711003434.jpeg not downloaded yet
2026-03-29 20:12:20 [motorway.uk] INFO: Found listing with ID: 19144130
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719144130%27 HTTP/1.1" 200 None
2026-03-29 20:12:20 [motorway.uk] INFO: Scrape type for 19144130: 1
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8633%252F20188633%252Fexterior_rear_driver-1774694207416.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8633/20188633/exterior_rear_driver-1774694207416.jpg not downloaded yet
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5069%252F20375069%252Fexterior_rear_passenger-1774547286784.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5069/20375069/exterior_rear_passenger-1774547286784.jpg not downloaded yet
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658389410>
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ae620fb-8abe-5723-810d-75deb7c2265b/5ae620fb-8abe-5723-810d-75deb7c2265b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8590%252F16318590%252Fexterior_front_passenger-1774710623029.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8590/16318590/exterior_front_passenger-1774710623029.jpg saved to cache
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5ae620fb-8abe-5723-810d-75deb7c2265b
2026-03-29 20:12:20 [motorway.uk] INFO: Found listing with ID: 20459047
2026-03-29 20:12:20 [motorway.uk] INFO: Found listing with ID: 18354443
2026-03-29 20:12:20 [motorway.uk] INFO: Found listing with ID: 20148114
2026-03-29 20:12:20 [motorway.uk] INFO: Found listing with ID: 12711502
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712711502%27 HTTP/1.1" 200 None
2026-03-29 20:12:20 [motorway.uk] INFO: Scrape type for 12711502: 1
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8633%252F20188633%252Fexterior_front_passenger-1774694251418.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8633/20188633/exterior_front_passenger-1774694251418.jpg not downloaded yet
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5069%252F20375069%252Finterior_front_seats-1774709626766.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5069/20375069/interior_front_seats-1774709626766.jpg not downloaded yet
2026-03-29 20:12:20 [motorway.uk] INFO: Found listing with ID: 19337875
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719337875%27 HTTP/1.1" 200 None
2026-03-29 20:12:20 [motorway.uk] INFO: Scrape type for 19337875: 1
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8633%252F20188633%252Fexterior_rear_passenger-1774694231035.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8633/20188633/exterior_rear_passenger-1774694231035.jpg not downloaded yet
2026-03-29 20:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8590/16318590/instrument_cluster-1774710537926.jpg> (referer: None)
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5069%252F20375069%252Finterior_rear_seats-1774709632439.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5069/20375069/interior_rear_seats-1774709632439.jpg not downloaded yet
2026-03-29 20:12:20 [motorway.uk] INFO: Found listing with ID: 10813763
2026-03-29 20:12:20 [motorway.uk] INFO: Found listing with ID: 18907003
2026-03-29 20:12:20 [motorway.uk] INFO: Found listing with ID: 15916141
2026-03-29 20:12:20 [motorway.uk] INFO: Found listing with ID: 20257823
2026-03-29 20:12:20 [motorway.uk] INFO: Found listing with ID: 20475074
2026-03-29 20:12:20 [motorway.uk] INFO: Found listing with ID: 15870409
2026-03-29 20:12:20 [motorway.uk] INFO: Found listing with ID: 20251970
2026-03-29 20:12:20 [motorway.uk] INFO: Found listing with ID: 17727943
2026-03-29 20:12:20 [motorway.uk] INFO: Found listing with ID: 20462595
2026-03-29 20:12:20 [motorway.uk] INFO: Found listing with ID: 20192465
2026-03-29 20:12:20 [motorway.uk] INFO: Found listing with ID: 20063535
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720063535%27 HTTP/1.1" 200 None
2026-03-29 20:12:20 [motorway.uk] INFO: Scrape type for 20063535: 1
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8633%252F20188633%252Finterior_front_seats-1774694938092.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8633/20188633/interior_front_seats-1774694938092.jpg not downloaded yet
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5069%252F20375069%252F20375069-interior_dashboard-modified-1774711029255.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5069/20375069/20375069-interior_dashboard-modified-1774711029255.jpeg not downloaded yet
2026-03-29 20:12:20 [motorway.uk] INFO: Found listing with ID: 20333711
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720333711%27 HTTP/1.1" 200 None
2026-03-29 20:12:20 [motorway.uk] INFO: Scrape type for 20333711: 1
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8633%252F20188633%252Finterior_rear_seats-1774694943323.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8633/20188633/interior_rear_seats-1774694943323.jpg not downloaded yet
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5069%252F20375069%252F20375069-interior_boot-modified-1774711040459.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5069/20375069/20375069-interior_boot-modified-1774711040459.jpeg not downloaded yet
2026-03-29 20:12:20 [motorway.uk] INFO: Found listing with ID: 18068486
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718068486%27 HTTP/1.1" 200 None
2026-03-29 20:12:20 [motorway.uk] INFO: Scrape type for 18068486: 1
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8633%252F20188633%252Finterior_dashboard-1774694992309.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8633/20188633/interior_dashboard-1774694992309.jpg not downloaded yet
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5069%252F20375069%252Fdocs_service_history-1774709801512.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddb459fc442c7a86c08a37ee684dd2236%27 HTTP/1.1" 200 None
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5069/20375069/docs_service_history-1774709801512.jpg?ixlib=js-3.8.0&auto=format&s=db459fc442c7a86c08a37ee684dd2236 not downloaded yet
2026-03-29 20:12:20 [motorway.uk] INFO: Found listing with ID: 20437958
2026-03-29 20:12:20 [motorway.uk] INFO: Found listing with ID: 20459514
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720459514%27 HTTP/1.1" 200 None
2026-03-29 20:12:20 [motorway.uk] INFO: Scrape type for 20459514: 1
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8633%252F20188633%252Finstrument_cluster-1774695045332.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8633/20188633/instrument_cluster-1774695045332.jpg not downloaded yet
2026-03-29 20:12:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658447ad0>
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ae620fb-8abe-5723-810d-75deb7c2265b/5ae620fb-8abe-5723-810d-75deb7c2265b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8590%252F16318590%252Finstrument_cluster-1774710537926.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8590/16318590/instrument_cluster-1774710537926.jpg saved to cache
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5ae620fb-8abe-5723-810d-75deb7c2265b
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5069%252F20375069%252F20375069-damage_dents-modified-1774711056840.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5069/20375069/20375069-damage_dents-modified-1774711056840.jpeg not downloaded yet
2026-03-29 20:12:20 [motorway.uk] INFO: Found listing with ID: 18787282
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718787282%27 HTTP/1.1" 200 None
2026-03-29 20:12:21 [motorway.uk] INFO: Scrape type for 18787282: 1
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8633%252F20188633%252Finterior_boot-1774694982706.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8633/20188633/interior_boot-1774694982706.jpg not downloaded yet
2026-03-29 20:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14248545.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:21 [motorway.uk] INFO: Found listing with ID: 10538324
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8633%252F20188633%252Fdocs_service_history-1774695386642.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D91a8a483ee7fdb27ea433ca256ed374a%27 HTTP/1.1" 200 None
2026-03-29 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8633/20188633/docs_service_history-1774695386642.jpg?ixlib=js-3.8.0&auto=format&s=91a8a483ee7fdb27ea433ca256ed374a not downloaded yet
2026-03-29 20:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8590/16318590/exterior_rear_passenger-1774710017564.jpg> (referer: None)
2026-03-29 20:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5909/14545909/interior_rear_seats-1774713738868.jpg> (referer: None)
2026-03-29 20:12:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20489087.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5909/14545909/exterior_front_driver-1770199181488.jpg> (referer: None)
2026-03-29 20:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5909/14545909/exterior_rear_driver-1770199218956.jpg> (referer: None)
2026-03-29 20:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5909/14545909/exterior_front_passenger-1774713708029.jpg> (referer: None)
2026-03-29 20:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5909/14545909/interior_dashboard-1774713761646.jpg> (referer: None)
2026-03-29 20:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5909/14545909/exterior_rear_passenger-1770199226374.jpg> (referer: None)
2026-03-29 20:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5909/14545909/instrument_cluster-1770199784942.jpg> (referer: None)
2026-03-29 20:12:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 078918a6-cbc1-546f-baed-55f276171b75 with identifier: 14248545
2026-03-29 20:12:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 078918a6-cbc1-546f-baed-55f276171b75 with scrape type 1
2026-03-29 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 078918a6-cbc1-546f-baed-55f276171b75
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8545%252F14248545%252Fexterior_front_driver-1774703329814.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8545/14248545/exterior_front_driver-1774703329814.jpg not downloaded yet
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8545%252F14248545%252Fexterior_rear_driver-1774703203117.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8545/14248545/exterior_rear_driver-1774703203117.jpg not downloaded yet
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8545%252F14248545%252Fexterior_front_passenger-1774703206725.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8545/14248545/exterior_front_passenger-1774703206725.jpg not downloaded yet
2026-03-29 20:12:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be00ed0>
2026-03-29 20:12:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ae620fb-8abe-5723-810d-75deb7c2265b/5ae620fb-8abe-5723-810d-75deb7c2265b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8590%252F16318590%252Fexterior_rear_passenger-1774710017564.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8590/16318590/exterior_rear_passenger-1774710017564.jpg saved to cache
2026-03-29 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5ae620fb-8abe-5723-810d-75deb7c2265b
2026-03-29 20:12:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be02110>
2026-03-29 20:12:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2abd2501-9460-592c-b79c-9a443f1d59f9/2abd2501-9460-592c-b79c-9a443f1d59f9_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5909%252F14545909%252Finterior_rear_seats-1774713738868.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5909/14545909/interior_rear_seats-1774713738868.jpg saved to cache
2026-03-29 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2abd2501-9460-592c-b79c-9a443f1d59f9
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8545%252F14248545%252Fexterior_rear_passenger-1774703205185.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8545/14248545/exterior_rear_passenger-1774703205185.jpg not downloaded yet
2026-03-29 20:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5069/20375069/20375069-damage_dents-modified-1774711056840.jpeg> (referer: None)
2026-03-29 20:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5069/20375069/interior_front_seats-1774709626766.jpg> (referer: None)
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8545%252F14248545%252Finterior_front_seats-1774703931514.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8545/14248545/interior_front_seats-1774703931514.jpg not downloaded yet
2026-03-29 20:12:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a5eb4df-43a6-573a-8311-3f760ecc7bd6 with identifier: 20489087
2026-03-29 20:12:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a5eb4df-43a6-573a-8311-3f760ecc7bd6 with scrape type 1
2026-03-29 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4a5eb4df-43a6-573a-8311-3f760ecc7bd6
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9087%252F20489087%252Fexterior_front_driver-1774793428367.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9087/20489087/exterior_front_driver-1774793428367.jpg not downloaded yet
2026-03-29 20:12:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659992610>
2026-03-29 20:12:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2abd2501-9460-592c-b79c-9a443f1d59f9/2abd2501-9460-592c-b79c-9a443f1d59f9_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5909%252F14545909%252Fexterior_front_driver-1770199181488.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5909/14545909/exterior_front_driver-1770199181488.jpg saved to cache
2026-03-29 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2abd2501-9460-592c-b79c-9a443f1d59f9
2026-03-29 20:12:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ec37d0>
2026-03-29 20:12:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2abd2501-9460-592c-b79c-9a443f1d59f9/2abd2501-9460-592c-b79c-9a443f1d59f9_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5909%252F14545909%252Fexterior_rear_driver-1770199218956.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5909/14545909/exterior_rear_driver-1770199218956.jpg saved to cache
2026-03-29 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2abd2501-9460-592c-b79c-9a443f1d59f9
2026-03-29 20:12:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e10e90>
2026-03-29 20:12:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2abd2501-9460-592c-b79c-9a443f1d59f9/2abd2501-9460-592c-b79c-9a443f1d59f9_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5909%252F14545909%252Fexterior_front_passenger-1774713708029.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5909/14545909/exterior_front_passenger-1774713708029.jpg saved to cache
2026-03-29 20:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2abd2501-9460-592c-b79c-9a443f1d59f9
2026-03-29 20:12:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f04b90>
2026-03-29 20:12:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2abd2501-9460-592c-b79c-9a443f1d59f9/2abd2501-9460-592c-b79c-9a443f1d59f9_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5909%252F14545909%252Finterior_dashboard-1774713761646.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5909/14545909/interior_dashboard-1774713761646.jpg saved to cache
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2abd2501-9460-592c-b79c-9a443f1d59f9
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b38a50>
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2abd2501-9460-592c-b79c-9a443f1d59f9/2abd2501-9460-592c-b79c-9a443f1d59f9_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5909%252F14545909%252Fexterior_rear_passenger-1770199226374.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5909/14545909/exterior_rear_passenger-1770199226374.jpg saved to cache
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2abd2501-9460-592c-b79c-9a443f1d59f9
2026-03-29 20:12:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f7ac90>
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2abd2501-9460-592c-b79c-9a443f1d59f9/2abd2501-9460-592c-b79c-9a443f1d59f9_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5909%252F14545909%252Finstrument_cluster-1770199784942.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5909/14545909/instrument_cluster-1770199784942.jpg saved to cache
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2abd2501-9460-592c-b79c-9a443f1d59f9
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8545%252F14248545%252Finterior_rear_seats-1774703929919.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8545/14248545/interior_rear_seats-1774703929919.jpg not downloaded yet
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9087%252F20489087%252Fexterior_rear_driver-1774792158110.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9087/20489087/exterior_rear_driver-1774792158110.jpg not downloaded yet
2026-03-29 20:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8633/20188633/docs_service_history-1774695386642.jpg?ixlib=js-3.8.0&auto=format&s=91a8a483ee7fdb27ea433ca256ed374a> (referer: None)
2026-03-29 20:12:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8545%252F14248545%252Finterior_dashboard-1774704981622.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8545/14248545/interior_dashboard-1774704981622.jpg not downloaded yet
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9087%252F20489087%252Fexterior_front_passenger-1774792111264.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9087/20489087/exterior_front_passenger-1774792111264.jpg not downloaded yet
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658439e10>
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca95e281-722d-5524-af50-e20c753704bd/ca95e281-722d-5524-af50-e20c753704bd_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5069%252F20375069%252F20375069-damage_dents-modified-1774711056840.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5069/20375069/20375069-damage_dents-modified-1774711056840.jpeg saved to cache
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ca95e281-722d-5524-af50-e20c753704bd
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65bf02b90>
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca95e281-722d-5524-af50-e20c753704bd/ca95e281-722d-5524-af50-e20c753704bd_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5069%252F20375069%252Finterior_front_seats-1774709626766.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5069/20375069/interior_front_seats-1774709626766.jpg saved to cache
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ca95e281-722d-5524-af50-e20c753704bd
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8545%252F14248545%252Finstrument_cluster-1774704954209.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8545/14248545/instrument_cluster-1774704954209.jpg not downloaded yet
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9087%252F20489087%252Fexterior_rear_passenger-1774792128907.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9087/20489087/exterior_rear_passenger-1774792128907.jpg not downloaded yet
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8545%252F14248545%252Finterior_boot-1774703934861.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8545/14248545/interior_boot-1774703934861.jpg not downloaded yet
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9087%252F20489087%252Finterior_front_seats-1774792202154.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9087/20489087/interior_front_seats-1774792202154.jpg not downloaded yet
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b64a90>
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce090b55-06ff-5006-8916-c6981ec81536/ce090b55-06ff-5006-8916-c6981ec81536_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8633%252F20188633%252Fdocs_service_history-1774695386642.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D91a8a483ee7fdb27ea433ca256ed374a') HTTP/1.1" 204 0
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8633/20188633/docs_service_history-1774695386642.jpg?ixlib=js-3.8.0&auto=format&s=91a8a483ee7fdb27ea433ca256ed374a saved to cache
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ce090b55-06ff-5006-8916-c6981ec81536
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8545%252F14248545%252Fdocs_service_history-1774704928812.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dccbfd6a2ff8399793e3c35fd0328ae69%27 HTTP/1.1" 200 None
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8545/14248545/docs_service_history-1774704928812.jpg?ixlib=js-3.8.0&auto=format&s=ccbfd6a2ff8399793e3c35fd0328ae69 not downloaded yet
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9087%252F20489087%252Finterior_rear_seats-1774792227949.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9087/20489087/interior_rear_seats-1774792227949.jpg not downloaded yet
2026-03-29 20:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20483826.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20395274.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9087%252F20489087%252Finterior_dashboard-1774792344481.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9087/20489087/interior_dashboard-1774792344481.jpg not downloaded yet
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9087%252F20489087%252Finterior_boot-1774792291177.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9087/20489087/interior_boot-1774792291177.jpg not downloaded yet
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9087%252F20489087%252Fdocs_service_history-1774793325868.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbd5523232ec8a86963a6e97f8b7dc5b4%27 HTTP/1.1" 200 None
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9087/20489087/docs_service_history-1774793325868.jpg?ixlib=js-3.8.0&auto=format&s=bd5523232ec8a86963a6e97f8b7dc5b4 not downloaded yet
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9087%252F20489087%252Fdocs_service_history-1774793342503.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6c2ed023ff5baf1dc440bd64f75e9641%27 HTTP/1.1" 200 None
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9087/20489087/docs_service_history-1774793342503.jpg?ixlib=js-3.8.0&auto=format&s=6c2ed023ff5baf1dc440bd64f75e9641 not downloaded yet
2026-03-29 20:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9087/20489087/exterior_front_driver-1774793428367.jpg> (referer: None)
2026-03-29 20:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8545/14248545/exterior_front_passenger-1774703206725.jpg> (referer: None)
2026-03-29 20:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8545/14248545/exterior_rear_passenger-1774703205185.jpg> (referer: None)
2026-03-29 20:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8545/14248545/exterior_rear_driver-1774703203117.jpg> (referer: None)
2026-03-29 20:12:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 037941b9-b90d-505f-8816-7a50f76d1edf with identifier: 20483826
2026-03-29 20:12:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 037941b9-b90d-505f-8816-7a50f76d1edf with scrape type 1
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 037941b9-b90d-505f-8816-7a50f76d1edf
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3826%252F20483826%252Fexterior_front_driver-1774688349281.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3826/20483826/exterior_front_driver-1774688349281.jpg not downloaded yet
2026-03-29 20:12:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb80d0c4-ede0-56f1-9074-5ee67e1fb450 with identifier: 20395274
2026-03-29 20:12:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb80d0c4-ede0-56f1-9074-5ee67e1fb450 with scrape type 1
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb80d0c4-ede0-56f1-9074-5ee67e1fb450
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5274%252F20395274%252Fexterior_front_driver-1774706247141.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5274/20395274/exterior_front_driver-1774706247141.jpg not downloaded yet
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3826%252F20483826%252Fexterior_rear_driver-1774688354628.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3826/20483826/exterior_rear_driver-1774688354628.jpg not downloaded yet
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5274%252F20395274%252Fexterior_rear_driver-1774687893547.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5274/20395274/exterior_rear_driver-1774687893547.jpg not downloaded yet
2026-03-29 20:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19163712.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3826%252F20483826%252Fexterior_front_passenger-1774688347859.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3826/20483826/exterior_front_passenger-1774688347859.jpg not downloaded yet
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5274%252F20395274%252Fexterior_front_passenger-1774706265925.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5274/20395274/exterior_front_passenger-1774706265925.jpg not downloaded yet
2026-03-29 20:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8545/14248545/exterior_front_driver-1774703329814.jpg> (referer: None)
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3826%252F20483826%252Fexterior_rear_passenger-1774688354120.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3826/20483826/exterior_rear_passenger-1774688354120.jpg not downloaded yet
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5274%252F20395274%252Fexterior_rear_passenger-1774687891237.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5274/20395274/exterior_rear_passenger-1774687891237.jpg not downloaded yet
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b2fad0>
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a5eb4df-43a6-573a-8311-3f760ecc7bd6/4a5eb4df-43a6-573a-8311-3f760ecc7bd6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9087%252F20489087%252Fexterior_front_driver-1774793428367.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9087/20489087/exterior_front_driver-1774793428367.jpg saved to cache
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a5eb4df-43a6-573a-8311-3f760ecc7bd6
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c20e10>
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_078918a6-cbc1-546f-baed-55f276171b75/078918a6-cbc1-546f-baed-55f276171b75_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8545%252F14248545%252Fexterior_front_passenger-1774703206725.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8545/14248545/exterior_front_passenger-1774703206725.jpg saved to cache
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 078918a6-cbc1-546f-baed-55f276171b75
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c71050>
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_078918a6-cbc1-546f-baed-55f276171b75/078918a6-cbc1-546f-baed-55f276171b75_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8545%252F14248545%252Fexterior_rear_passenger-1774703205185.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8545/14248545/exterior_rear_passenger-1774703205185.jpg saved to cache
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 078918a6-cbc1-546f-baed-55f276171b75
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c72790>
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_078918a6-cbc1-546f-baed-55f276171b75/078918a6-cbc1-546f-baed-55f276171b75_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8545%252F14248545%252Fexterior_rear_driver-1774703203117.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8545/14248545/exterior_rear_driver-1774703203117.jpg saved to cache
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 078918a6-cbc1-546f-baed-55f276171b75
2026-03-29 20:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8633/20188633/instrument_cluster-1774695045332.jpg> (referer: None)
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3826%252F20483826%252Finterior_front_seats-1774689335866.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3826/20483826/interior_front_seats-1774689335866.jpg not downloaded yet
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5274%252F20395274%252Finterior_front_seats-1774688459387.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5274/20395274/interior_front_seats-1774688459387.jpg not downloaded yet
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3826%252F20483826%252Finterior_rear_seats-1774689312053.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3826/20483826/interior_rear_seats-1774689312053.jpg not downloaded yet
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5274%252F20395274%252Finterior_rear_seats-1774688507957.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5274/20395274/interior_rear_seats-1774688507957.jpg not downloaded yet
2026-03-29 20:12:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9cd61ed-b382-563e-9bf8-47c0c2b42e62 with identifier: 19163712
2026-03-29 20:12:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9cd61ed-b382-563e-9bf8-47c0c2b42e62 with scrape type 1
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f9cd61ed-b382-563e-9bf8-47c0c2b42e62
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3712%252F19163712%252Fexterior_front_driver-1771349037240.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3712/19163712/exterior_front_driver-1771349037240.jpeg not downloaded yet
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c14610>
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_078918a6-cbc1-546f-baed-55f276171b75/078918a6-cbc1-546f-baed-55f276171b75_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8545%252F14248545%252Fexterior_front_driver-1774703329814.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8545/14248545/exterior_front_driver-1774703329814.jpg saved to cache
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 078918a6-cbc1-546f-baed-55f276171b75
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3826%252F20483826%252Finterior_dashboard-1774698053241.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3826/20483826/interior_dashboard-1774698053241.jpg not downloaded yet
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5274%252F20395274%252Finterior_dashboard-1774706169451.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5274/20395274/interior_dashboard-1774706169451.jpg not downloaded yet
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3712%252F19163712%252Fexterior_rear_driver-1771260682586.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3712/19163712/exterior_rear_driver-1771260682586.jpeg not downloaded yet
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3826%252F20483826%252Finterior_boot-1774689323050.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3826/20483826/interior_boot-1774689323050.jpg not downloaded yet
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5274%252F20395274%252Finstrument_cluster-1774688786297.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5274/20395274/instrument_cluster-1774688786297.jpg not downloaded yet
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3712%252F19163712%252Fexterior_front_passenger-1771260669791.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3712/19163712/exterior_front_passenger-1771260669791.jpeg not downloaded yet
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586f5210>
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce090b55-06ff-5006-8916-c6981ec81536/ce090b55-06ff-5006-8916-c6981ec81536_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8633%252F20188633%252Finstrument_cluster-1774695045332.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8633/20188633/instrument_cluster-1774695045332.jpg saved to cache
2026-03-29 20:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ce090b55-06ff-5006-8916-c6981ec81536
2026-03-29 20:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9087/20489087/docs_service_history-1774793342503.jpg?ixlib=js-3.8.0&auto=format&s=6c2ed023ff5baf1dc440bd64f75e9641> (referer: None)
2026-03-29 20:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9087/20489087/docs_service_history-1774793325868.jpg?ixlib=js-3.8.0&auto=format&s=bd5523232ec8a86963a6e97f8b7dc5b4> (referer: None)
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3826%252F20483826%252Fdamage_scratches-1774688834005.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3826/20483826/damage_scratches-1774688834005.jpg not downloaded yet
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5274%252F20395274%252Finterior_boot-1774688683857.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5274/20395274/interior_boot-1774688683857.jpg not downloaded yet
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3712%252F19163712%252Fexterior_rear_passenger-1771260676470.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3712/19163712/exterior_rear_passenger-1771260676470.jpeg not downloaded yet
2026-03-29 20:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8545/14248545/interior_front_seats-1774703931514.jpg> (referer: None)
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3826%252F20483826%252Fdamage_dents-1774688759551.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3826/20483826/damage_dents-1774688759551.jpg not downloaded yet
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5274%252F20395274%252Fdocs_service_history-1774703558765.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D022096cc57ed0585a6be7a1e6b41f6f0%27 HTTP/1.1" 200 None
2026-03-29 20:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5274/20395274/docs_service_history-1774703558765.jpg?ixlib=js-3.8.0&auto=format&s=022096cc57ed0585a6be7a1e6b41f6f0 not downloaded yet
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3712%252F19163712%252Finterior_front_seats-1771260672038.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3712/19163712/interior_front_seats-1771260672038.jpeg not downloaded yet
2026-03-29 20:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=396&page=11&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3712%252F19163712%252Finterior_rear_seats-1771253306495.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3712/19163712/interior_rear_seats-1771253306495.jpeg not downloaded yet
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3712%252F19163712%252Finterior_dashboard-1771260699600.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3712/19163712/interior_dashboard-1771260699600.jpeg not downloaded yet
2026-03-29 20:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f68dd0>
2026-03-29 20:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a5eb4df-43a6-573a-8311-3f760ecc7bd6/4a5eb4df-43a6-573a-8311-3f760ecc7bd6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9087%252F20489087%252Fdocs_service_history-1774793342503.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6c2ed023ff5baf1dc440bd64f75e9641') HTTP/1.1" 204 0
2026-03-29 20:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9087/20489087/docs_service_history-1774793342503.jpg?ixlib=js-3.8.0&auto=format&s=6c2ed023ff5baf1dc440bd64f75e9641 saved to cache
2026-03-29 20:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4a5eb4df-43a6-573a-8311-3f760ecc7bd6
2026-03-29 20:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65841cc90>
2026-03-29 20:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a5eb4df-43a6-573a-8311-3f760ecc7bd6/4a5eb4df-43a6-573a-8311-3f760ecc7bd6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9087%252F20489087%252Fdocs_service_history-1774793325868.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbd5523232ec8a86963a6e97f8b7dc5b4') HTTP/1.1" 204 0
2026-03-29 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9087/20489087/docs_service_history-1774793325868.jpg?ixlib=js-3.8.0&auto=format&s=bd5523232ec8a86963a6e97f8b7dc5b4 saved to cache
2026-03-29 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4a5eb4df-43a6-573a-8311-3f760ecc7bd6
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3712%252F19163712%252Finstrument_cluster-1771260670300.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3712/19163712/instrument_cluster-1771260670300.jpeg not downloaded yet
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3712%252F19163712%252Finterior_boot-1771260685785.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3712/19163712/interior_boot-1771260685785.jpeg not downloaded yet
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cf95d0>
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_078918a6-cbc1-546f-baed-55f276171b75/078918a6-cbc1-546f-baed-55f276171b75_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8545%252F14248545%252Finterior_front_seats-1774703931514.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8545/14248545/interior_front_seats-1774703931514.jpg saved to cache
2026-03-29 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 078918a6-cbc1-546f-baed-55f276171b75
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 18237479
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 20424370
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 10385844
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 20023878
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 20463571
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 19486980
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 7743070
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277743070%27 HTTP/1.1" 200 None
2026-03-29 20:12:25 [motorway.uk] INFO: Scrape type for 7743070: 1
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F3712%252F19163712%252Fdocs_service_history-1771692239254.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db546688fb4388b098a0e6869cbd57cb1%27 HTTP/1.1" 200 None
2026-03-29 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/3712/19163712/docs_service_history-1771692239254.jpeg?ixlib=js-3.8.0&auto=format&s=b546688fb4388b098a0e6869cbd57cb1 not downloaded yet
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 11675984
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711675984%27 HTTP/1.1" 200 None
2026-03-29 20:12:25 [motorway.uk] INFO: Scrape type for 11675984: 1
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 11431082
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 20466900
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 20422527
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 20080388
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 12887188
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 20469058
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 19693972
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 19713173
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 19370782
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 19687443
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 19280379
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719280379%27 HTTP/1.1" 200 None
2026-03-29 20:12:25 [motorway.uk] INFO: Scrape type for 19280379: 1
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 20156431
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 19905808
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719905808%27 HTTP/1.1" 200 None
2026-03-29 20:12:25 [motorway.uk] INFO: Scrape type for 19905808: 1
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 20454140
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720454140%27 HTTP/1.1" 200 None
2026-03-29 20:12:25 [motorway.uk] INFO: Scrape type for 20454140: 1
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 20386729
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 20000898
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 20501153
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720501153%27 HTTP/1.1" 200 None
2026-03-29 20:12:25 [motorway.uk] INFO: Scrape type for 20501153: 1
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 20416082
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 18349950
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 20300016
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720300016%27 HTTP/1.1" 200 None
2026-03-29 20:12:25 [motorway.uk] INFO: Scrape type for 20300016: 1
2026-03-29 20:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3826/20483826/exterior_rear_passenger-1774688354120.jpg> (referer: None)
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 11716723
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 20488257
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 8670436
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278670436%27 HTTP/1.1" 200 None
2026-03-29 20:12:25 [motorway.uk] INFO: Scrape type for 8670436: 1
2026-03-29 20:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9087/20489087/interior_rear_seats-1774792227949.jpg> (referer: None)
2026-03-29 20:12:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5274/20395274/exterior_front_driver-1774706247141.jpg> (referer: None)
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 20266056
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 20449935
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 20429190
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 20031424
2026-03-29 20:12:25 [motorway.uk] INFO: Found listing with ID: 14826836
2026-03-29 20:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19960180.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/8545/14248545/docs_service_history-1774704928812.jpg?ixlib=js-3.8.0&auto=format&s=ccbfd6a2ff8399793e3c35fd0328ae69> (referer: None)
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa669901ed0>
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_037941b9-b90d-505f-8816-7a50f76d1edf/037941b9-b90d-505f-8816-7a50f76d1edf_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3826%252F20483826%252Fexterior_rear_passenger-1774688354120.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3826/20483826/exterior_rear_passenger-1774688354120.jpg saved to cache
2026-03-29 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 037941b9-b90d-505f-8816-7a50f76d1edf
2026-03-29 20:12:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:25 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:12:25 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-S931B\x00'
2026-03-29 20:12:25 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:12:25 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'S931BXXS8BZB5\x00'
2026-03-29 20:12:25 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:12:25 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:12:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:25 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:29 14:50:18\x00'
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65bc27450>
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a5eb4df-43a6-573a-8311-3f760ecc7bd6/4a5eb4df-43a6-573a-8311-3f760ecc7bd6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9087%252F20489087%252Finterior_rear_seats-1774792227949.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9087/20489087/interior_rear_seats-1774792227949.jpg saved to cache
2026-03-29 20:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4a5eb4df-43a6-573a-8311-3f760ecc7bd6
2026-03-29 20:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3712/19163712/exterior_front_passenger-1771260669791.jpeg> (referer: None)
2026-03-29 20:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20459514.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8633/20188633/interior_boot-1774694982706.jpg> (referer: None)
2026-03-29 20:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9087/20489087/interior_boot-1774792291177.jpg> (referer: None)
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658525f90>
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb80d0c4-ede0-56f1-9074-5ee67e1fb450/eb80d0c4-ede0-56f1-9074-5ee67e1fb450_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5274%252F20395274%252Fexterior_front_driver-1774706247141.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5274/20395274/exterior_front_driver-1774706247141.jpg saved to cache
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb80d0c4-ede0-56f1-9074-5ee67e1fb450
2026-03-29 20:12:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da09d692-879b-55d0-86c5-5ceca0a57225 with identifier: 19960180
2026-03-29 20:12:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da09d692-879b-55d0-86c5-5ceca0a57225 with scrape type 1
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item da09d692-879b-55d0-86c5-5ceca0a57225
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0180%252F19960180%252Fexterior_front_driver-1774706956031.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0180/19960180/exterior_front_driver-1774706956031.jpg not downloaded yet
2026-03-29 20:12:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ac6a90>
2026-03-29 20:12:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_078918a6-cbc1-546f-baed-55f276171b75/078918a6-cbc1-546f-baed-55f276171b75_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8545%252F14248545%252Fdocs_service_history-1774704928812.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dccbfd6a2ff8399793e3c35fd0328ae69') HTTP/1.1" 204 0
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8545/14248545/docs_service_history-1774704928812.jpg?ixlib=js-3.8.0&auto=format&s=ccbfd6a2ff8399793e3c35fd0328ae69 saved to cache
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 078918a6-cbc1-546f-baed-55f276171b75
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0180%252F19960180%252Fexterior_rear_driver-1774721026133.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0180/19960180/exterior_rear_driver-1774721026133.jpg not downloaded yet
2026-03-29 20:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5274/20395274/exterior_rear_passenger-1774687891237.jpg> (referer: None)
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0180%252F19960180%252Fexterior_front_passenger-1774721041431.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0180/19960180/exterior_front_passenger-1774721041431.jpg not downloaded yet
2026-03-29 20:12:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f9f2d0>
2026-03-29 20:12:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9cd61ed-b382-563e-9bf8-47c0c2b42e62/f9cd61ed-b382-563e-9bf8-47c0c2b42e62_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3712%252F19163712%252Fexterior_front_passenger-1771260669791.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3712/19163712/exterior_front_passenger-1771260669791.jpeg saved to cache
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f9cd61ed-b382-563e-9bf8-47c0c2b42e62
2026-03-29 20:12:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff097339-7833-5dab-9884-10641896398c with identifier: 20459514
2026-03-29 20:12:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff097339-7833-5dab-9884-10641896398c with scrape type 1
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ff097339-7833-5dab-9884-10641896398c
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9514%252F20459514%252Fexterior_front_driver-1774614579745.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9514/20459514/exterior_front_driver-1774614579745.jpg not downloaded yet
2026-03-29 20:12:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d46f10>
2026-03-29 20:12:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce090b55-06ff-5006-8916-c6981ec81536/ce090b55-06ff-5006-8916-c6981ec81536_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8633%252F20188633%252Finterior_boot-1774694982706.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8633/20188633/interior_boot-1774694982706.jpg saved to cache
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ce090b55-06ff-5006-8916-c6981ec81536
2026-03-29 20:12:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:26 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:12:26 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-S931B\x00'
2026-03-29 20:12:26 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:12:26 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'S931BXXS8BZB5\x00'
2026-03-29 20:12:26 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:12:26 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:12:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:26 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:29 14:51:27\x00'
2026-03-29 20:12:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582e9d10>
2026-03-29 20:12:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a5eb4df-43a6-573a-8311-3f760ecc7bd6/4a5eb4df-43a6-573a-8311-3f760ecc7bd6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9087%252F20489087%252Finterior_boot-1774792291177.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9087/20489087/interior_boot-1774792291177.jpg saved to cache
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4a5eb4df-43a6-573a-8311-3f760ecc7bd6
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0180%252F19960180%252Fexterior_rear_passenger-1774706921697.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0180/19960180/exterior_rear_passenger-1774706921697.jpg not downloaded yet
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9514%252F20459514%252Fexterior_rear_driver-1774614612667.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9514/20459514/exterior_rear_driver-1774614612667.jpg not downloaded yet
2026-03-29 20:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18787282.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0180%252F19960180%252Finterior_front_seats-1774716971956.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0180/19960180/interior_front_seats-1774716971956.jpg not downloaded yet
2026-03-29 20:12:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9514%252F20459514%252Fexterior_front_passenger-1774614657403.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9514/20459514/exterior_front_passenger-1774614657403.jpg not downloaded yet
2026-03-29 20:12:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a7afd0>
2026-03-29 20:12:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb80d0c4-ede0-56f1-9074-5ee67e1fb450/eb80d0c4-ede0-56f1-9074-5ee67e1fb450_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5274%252F20395274%252Fexterior_rear_passenger-1774687891237.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5274/20395274/exterior_rear_passenger-1774687891237.jpg saved to cache
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb80d0c4-ede0-56f1-9074-5ee67e1fb450
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0180%252F19960180%252Finterior_rear_seats-1774721061102.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0180/19960180/interior_rear_seats-1774721061102.jpg not downloaded yet
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9514%252F20459514%252Fexterior_rear_passenger-1774614627495.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9514/20459514/exterior_rear_passenger-1774614627495.jpg not downloaded yet
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0180%252F19960180%252Finterior_dashboard-1774721079322.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0180/19960180/interior_dashboard-1774721079322.jpg not downloaded yet
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9514%252F20459514%252Finterior_front_seats-1774615886180.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9514/20459514/interior_front_seats-1774615886180.jpg not downloaded yet
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0180%252F19960180%252Finstrument_cluster-1774707917091.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0180/19960180/instrument_cluster-1774707917091.jpg not downloaded yet
2026-03-29 20:12:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d570834-cb1e-5549-9cdb-d46a645ee5ea with identifier: 18787282
2026-03-29 20:12:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d570834-cb1e-5549-9cdb-d46a645ee5ea with scrape type 1
2026-03-29 20:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4d570834-cb1e-5549-9cdb-d46a645ee5ea
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7282%252F18787282%252Fexterior_front_driver-1774708204892.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7282/18787282/exterior_front_driver-1774708204892.jpg not downloaded yet
2026-03-29 20:12:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9087/20489087/interior_dashboard-1774792344481.jpg> (referer: None)
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9514%252F20459514%252Finterior_rear_seats-1774615944371.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9514/20459514/interior_rear_seats-1774615944371.jpg not downloaded yet
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0180%252F19960180%252Finterior_boot-1774707357393.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0180/19960180/interior_boot-1774707357393.jpg not downloaded yet
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7282%252F18787282%252Fexterior_rear_driver-1774707063789.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7282/18787282/exterior_rear_driver-1774707063789.jpg not downloaded yet
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9514%252F20459514%252Finterior_dashboard-1774615384006.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9514/20459514/interior_dashboard-1774615384006.jpg not downloaded yet
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0180%252F19960180%252Fdocs_service_history-1774707777342.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3591b466643218ac13af1408b8b8cb93%27 HTTP/1.1" 200 None
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0180/19960180/docs_service_history-1774707777342.jpg?ixlib=js-3.8.0&auto=format&s=3591b466643218ac13af1408b8b8cb93 not downloaded yet
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7282%252F18787282%252Fexterior_front_passenger-1774707053926.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7282/18787282/exterior_front_passenger-1774707053926.jpg not downloaded yet
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9514%252F20459514%252Finstrument_cluster-1774615434945.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9514/20459514/instrument_cluster-1774615434945.jpg not downloaded yet
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7282%252F18787282%252Fexterior_rear_passenger-1774707063709.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7282/18787282/exterior_rear_passenger-1774707063709.jpg not downloaded yet
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9514%252F20459514%252Finterior_boot-1774615419939.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9514/20459514/interior_boot-1774615419939.jpg not downloaded yet
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7282%252F18787282%252Finterior_front_seats-1774707670638.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7282/18787282/interior_front_seats-1774707670638.jpg not downloaded yet
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-S931B\x00'
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'S931BXXS8BZB5\x00'
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:29 14:52:09\x00'
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599c3890>
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a5eb4df-43a6-573a-8311-3f760ecc7bd6/4a5eb4df-43a6-573a-8311-3f760ecc7bd6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9087%252F20489087%252Finterior_dashboard-1774792344481.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9087/20489087/interior_dashboard-1774792344481.jpg saved to cache
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4a5eb4df-43a6-573a-8311-3f760ecc7bd6
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9514%252F20459514%252Fdocs_service_history-1774622675580.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D046e9320d1bf68e7405fb1f0a43dade3%27 HTTP/1.1" 200 None
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9514/20459514/docs_service_history-1774622675580.jpg?ixlib=js-3.8.0&auto=format&s=046e9320d1bf68e7405fb1f0a43dade3 not downloaded yet
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7282%252F18787282%252Finterior_rear_seats-1774707661153.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7282/18787282/interior_rear_seats-1774707661153.jpg not downloaded yet
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7282%252F18787282%252Finterior_dashboard-1774707720934.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7282/18787282/interior_dashboard-1774707720934.jpg not downloaded yet
2026-03-29 20:12:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3712/19163712/interior_rear_seats-1771253306495.jpeg> (referer: None)
2026-03-29 20:12:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5274/20395274/instrument_cluster-1774688786297.jpg> (referer: None)
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7282%252F18787282%252Finterior_boot-1774707678420.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7282/18787282/interior_boot-1774707678420.jpg not downloaded yet
2026-03-29 20:12:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0180/19960180/exterior_front_driver-1774706956031.jpg> (referer: None)
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7282%252F18787282%252Fdamage_paintwork-1774707154384.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7282/18787282/damage_paintwork-1774707154384.jpg not downloaded yet
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7282%252F18787282%252Fdamage_windscreen-1774707197953.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7282/18787282/damage_windscreen-1774707197953.jpg not downloaded yet
2026-03-29 20:12:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0180/19960180/exterior_rear_driver-1774721026133.jpg> (referer: None)
2026-03-29 20:12:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3712/19163712/interior_front_seats-1771260672038.jpeg> (referer: None)
2026-03-29 20:12:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0180/19960180/exterior_front_passenger-1774721041431.jpg> (referer: None)
2026-03-29 20:12:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0180/19960180/exterior_rear_passenger-1774706921697.jpg> (referer: None)
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x000\x02O\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x0c\xa4\x00/\xf8=\x00\x00\x00\x00'
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65bbc4f50>
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9cd61ed-b382-563e-9bf8-47c0c2b42e62/f9cd61ed-b382-563e-9bf8-47c0c2b42e62_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3712%252F19163712%252Finterior_rear_seats-1771253306495.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3712/19163712/interior_rear_seats-1771253306495.jpeg saved to cache
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f9cd61ed-b382-563e-9bf8-47c0c2b42e62
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a1ab10>
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb80d0c4-ede0-56f1-9074-5ee67e1fb450/eb80d0c4-ede0-56f1-9074-5ee67e1fb450_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5274%252F20395274%252Finstrument_cluster-1774688786297.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5274/20395274/instrument_cluster-1774688786297.jpg saved to cache
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb80d0c4-ede0-56f1-9074-5ee67e1fb450
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65aacd890>
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da09d692-879b-55d0-86c5-5ceca0a57225/da09d692-879b-55d0-86c5-5ceca0a57225_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0180%252F19960180%252Fexterior_front_driver-1774706956031.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0180/19960180/exterior_front_driver-1774706956031.jpg saved to cache
2026-03-29 20:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da09d692-879b-55d0-86c5-5ceca0a57225
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f07f90>
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da09d692-879b-55d0-86c5-5ceca0a57225/da09d692-879b-55d0-86c5-5ceca0a57225_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0180%252F19960180%252Fexterior_rear_driver-1774721026133.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0180/19960180/exterior_rear_driver-1774721026133.jpg saved to cache
2026-03-29 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item da09d692-879b-55d0-86c5-5ceca0a57225
2026-03-29 20:12:28 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:28 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:28 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x007\xe2\x19\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02W\xe4\x007\xd8\x07\x00\x00\x00\x00'
2026-03-29 20:12:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ac1910>
2026-03-29 20:12:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9cd61ed-b382-563e-9bf8-47c0c2b42e62/f9cd61ed-b382-563e-9bf8-47c0c2b42e62_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3712%252F19163712%252Finterior_front_seats-1771260672038.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3712/19163712/interior_front_seats-1771260672038.jpeg saved to cache
2026-03-29 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f9cd61ed-b382-563e-9bf8-47c0c2b42e62
2026-03-29 20:12:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e1b450>
2026-03-29 20:12:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da09d692-879b-55d0-86c5-5ceca0a57225/da09d692-879b-55d0-86c5-5ceca0a57225_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0180%252F19960180%252Fexterior_front_passenger-1774721041431.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0180/19960180/exterior_front_passenger-1774721041431.jpg saved to cache
2026-03-29 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item da09d692-879b-55d0-86c5-5ceca0a57225
2026-03-29 20:12:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e07a50>
2026-03-29 20:12:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da09d692-879b-55d0-86c5-5ceca0a57225/da09d692-879b-55d0-86c5-5ceca0a57225_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0180%252F19960180%252Fexterior_rear_passenger-1774706921697.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0180/19960180/exterior_rear_passenger-1774706921697.jpg saved to cache
2026-03-29 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item da09d692-879b-55d0-86c5-5ceca0a57225
2026-03-29 20:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9514/20459514/exterior_front_driver-1774614579745.jpg> (referer: None)
2026-03-29 20:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9514/20459514/interior_boot-1774615419939.jpg> (referer: None)
2026-03-29 20:12:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fe10d0>
2026-03-29 20:12:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff097339-7833-5dab-9884-10641896398c/ff097339-7833-5dab-9884-10641896398c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9514%252F20459514%252Fexterior_front_driver-1774614579745.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9514/20459514/exterior_front_driver-1774614579745.jpg saved to cache
2026-03-29 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff097339-7833-5dab-9884-10641896398c
2026-03-29 20:12:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b64810>
2026-03-29 20:12:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff097339-7833-5dab-9884-10641896398c/ff097339-7833-5dab-9884-10641896398c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9514%252F20459514%252Finterior_boot-1774615419939.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9514/20459514/interior_boot-1774615419939.jpg saved to cache
2026-03-29 20:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ff097339-7833-5dab-9884-10641896398c
2026-03-29 20:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7282/18787282/damage_windscreen-1774707197953.jpg> (referer: None)
2026-03-29 20:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7282/18787282/damage_paintwork-1774707154384.jpg> (referer: None)
2026-03-29 20:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7282/18787282/interior_dashboard-1774707720934.jpg> (referer: None)
2026-03-29 20:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7282/18787282/interior_front_seats-1774707670638.jpg> (referer: None)
2026-03-29 20:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9514/20459514/docs_service_history-1774622675580.jpg?ixlib=js-3.8.0&auto=format&s=046e9320d1bf68e7405fb1f0a43dade3> (referer: None)
2026-03-29 20:12:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7282/18787282/exterior_rear_passenger-1774707063709.jpg> (referer: None)
2026-03-29 20:12:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b59710>
2026-03-29 20:12:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d570834-cb1e-5549-9cdb-d46a645ee5ea/4d570834-cb1e-5549-9cdb-d46a645ee5ea_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7282%252F18787282%252Fdamage_windscreen-1774707197953.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7282/18787282/damage_windscreen-1774707197953.jpg saved to cache
2026-03-29 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4d570834-cb1e-5549-9cdb-d46a645ee5ea
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bfae50>
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d570834-cb1e-5549-9cdb-d46a645ee5ea/4d570834-cb1e-5549-9cdb-d46a645ee5ea_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7282%252F18787282%252Fdamage_paintwork-1774707154384.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7282/18787282/damage_paintwork-1774707154384.jpg saved to cache
2026-03-29 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4d570834-cb1e-5549-9cdb-d46a645ee5ea
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a7a7d0>
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d570834-cb1e-5549-9cdb-d46a645ee5ea/4d570834-cb1e-5549-9cdb-d46a645ee5ea_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7282%252F18787282%252Finterior_dashboard-1774707720934.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7282/18787282/interior_dashboard-1774707720934.jpg saved to cache
2026-03-29 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4d570834-cb1e-5549-9cdb-d46a645ee5ea
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599c9ad0>
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d570834-cb1e-5549-9cdb-d46a645ee5ea/4d570834-cb1e-5549-9cdb-d46a645ee5ea_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7282%252F18787282%252Finterior_front_seats-1774707670638.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7282/18787282/interior_front_seats-1774707670638.jpg saved to cache
2026-03-29 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4d570834-cb1e-5549-9cdb-d46a645ee5ea
2026-03-29 20:12:29 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:29 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:29 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00=\x83?\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\nX\xf2\x00=Vq\x00\x00\x00\x00'
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599c9690>
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff097339-7833-5dab-9884-10641896398c/ff097339-7833-5dab-9884-10641896398c_image_9.mpo HTTP/1.1" 201 0
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9514%252F20459514%252Fdocs_service_history-1774622675580.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D046e9320d1bf68e7405fb1f0a43dade3') HTTP/1.1" 204 0
2026-03-29 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9514/20459514/docs_service_history-1774622675580.jpg?ixlib=js-3.8.0&auto=format&s=046e9320d1bf68e7405fb1f0a43dade3 saved to cache
2026-03-29 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ff097339-7833-5dab-9884-10641896398c
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584c45d0>
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d570834-cb1e-5549-9cdb-d46a645ee5ea/4d570834-cb1e-5549-9cdb-d46a645ee5ea_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7282%252F18787282%252Fexterior_rear_passenger-1774707063709.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7282/18787282/exterior_rear_passenger-1774707063709.jpg saved to cache
2026-03-29 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4d570834-cb1e-5549-9cdb-d46a645ee5ea
2026-03-29 20:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9514/20459514/instrument_cluster-1774615434945.jpg> (referer: None)
2026-03-29 20:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7282/18787282/interior_rear_seats-1774707661153.jpg> (referer: None)
2026-03-29 20:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7282/18787282/interior_boot-1774707678420.jpg> (referer: None)
2026-03-29 20:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7282/18787282/exterior_front_passenger-1774707053926.jpg> (referer: None)
2026-03-29 20:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0180/19960180/docs_service_history-1774707777342.jpg?ixlib=js-3.8.0&auto=format&s=3591b466643218ac13af1408b8b8cb93> (referer: None)
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c8c7d0>
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff097339-7833-5dab-9884-10641896398c/ff097339-7833-5dab-9884-10641896398c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9514%252F20459514%252Finstrument_cluster-1774615434945.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9514/20459514/instrument_cluster-1774615434945.jpg saved to cache
2026-03-29 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ff097339-7833-5dab-9884-10641896398c
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659aa4c90>
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d570834-cb1e-5549-9cdb-d46a645ee5ea/4d570834-cb1e-5549-9cdb-d46a645ee5ea_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7282%252F18787282%252Finterior_rear_seats-1774707661153.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7282/18787282/interior_rear_seats-1774707661153.jpg saved to cache
2026-03-29 20:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4d570834-cb1e-5549-9cdb-d46a645ee5ea
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fafe90>
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d570834-cb1e-5549-9cdb-d46a645ee5ea/4d570834-cb1e-5549-9cdb-d46a645ee5ea_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7282%252F18787282%252Finterior_boot-1774707678420.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7282/18787282/interior_boot-1774707678420.jpg saved to cache
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4d570834-cb1e-5549-9cdb-d46a645ee5ea
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a49b50>
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d570834-cb1e-5549-9cdb-d46a645ee5ea/4d570834-cb1e-5549-9cdb-d46a645ee5ea_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7282%252F18787282%252Fexterior_front_passenger-1774707053926.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7282/18787282/exterior_front_passenger-1774707053926.jpg saved to cache
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4d570834-cb1e-5549-9cdb-d46a645ee5ea
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fad810>
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da09d692-879b-55d0-86c5-5ceca0a57225/da09d692-879b-55d0-86c5-5ceca0a57225_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0180%252F19960180%252Fdocs_service_history-1774707777342.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3591b466643218ac13af1408b8b8cb93') HTTP/1.1" 204 0
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0180/19960180/docs_service_history-1774707777342.jpg?ixlib=js-3.8.0&auto=format&s=3591b466643218ac13af1408b8b8cb93 saved to cache
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item da09d692-879b-55d0-86c5-5ceca0a57225
2026-03-29 20:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20404971.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9514/20459514/interior_rear_seats-1774615944371.jpg> (referer: None)
2026-03-29 20:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9514/20459514/interior_dashboard-1774615384006.jpg> (referer: None)
2026-03-29 20:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0180/19960180/instrument_cluster-1774707917091.jpg> (referer: None)
2026-03-29 20:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7282/18787282/exterior_front_driver-1774708204892.jpg> (referer: None)
2026-03-29 20:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7282/18787282/exterior_rear_driver-1774707063789.jpg> (referer: None)
2026-03-29 20:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0180/19960180/interior_boot-1774707357393.jpg> (referer: None)
2026-03-29 20:12:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f271e52e-6d99-53d0-8cc0-da37607c824d with identifier: 20404971
2026-03-29 20:12:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f271e52e-6d99-53d0-8cc0-da37607c824d with scrape type 1
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f271e52e-6d99-53d0-8cc0-da37607c824d
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4971%252F20404971%252Fexterior_front_driver-1774611772197.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4971/20404971/exterior_front_driver-1774611772197.jpg not downloaded yet
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4971%252F20404971%252Fexterior_rear_driver-1774535310704.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4971/20404971/exterior_rear_driver-1774535310704.jpg not downloaded yet
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4971%252F20404971%252Fexterior_front_passenger-1774535328301.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4971/20404971/exterior_front_passenger-1774535328301.jpg not downloaded yet
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ec1910>
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff097339-7833-5dab-9884-10641896398c/ff097339-7833-5dab-9884-10641896398c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9514%252F20459514%252Finterior_rear_seats-1774615944371.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9514/20459514/interior_rear_seats-1774615944371.jpg saved to cache
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ff097339-7833-5dab-9884-10641896398c
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658aa2350>
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff097339-7833-5dab-9884-10641896398c/ff097339-7833-5dab-9884-10641896398c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9514%252F20459514%252Finterior_dashboard-1774615384006.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9514/20459514/interior_dashboard-1774615384006.jpg saved to cache
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ff097339-7833-5dab-9884-10641896398c
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589db1d0>
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da09d692-879b-55d0-86c5-5ceca0a57225/da09d692-879b-55d0-86c5-5ceca0a57225_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0180%252F19960180%252Finstrument_cluster-1774707917091.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0180/19960180/instrument_cluster-1774707917091.jpg saved to cache
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item da09d692-879b-55d0-86c5-5ceca0a57225
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658aa3c90>
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d570834-cb1e-5549-9cdb-d46a645ee5ea/4d570834-cb1e-5549-9cdb-d46a645ee5ea_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7282%252F18787282%252Fexterior_front_driver-1774708204892.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7282/18787282/exterior_front_driver-1774708204892.jpg saved to cache
2026-03-29 20:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4d570834-cb1e-5549-9cdb-d46a645ee5ea
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c0c9d0>
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d570834-cb1e-5549-9cdb-d46a645ee5ea/4d570834-cb1e-5549-9cdb-d46a645ee5ea_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7282%252F18787282%252Fexterior_rear_driver-1774707063789.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7282/18787282/exterior_rear_driver-1774707063789.jpg saved to cache
2026-03-29 20:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4d570834-cb1e-5549-9cdb-d46a645ee5ea
2026-03-29 20:12:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4d570834-cb1e-5549-9cdb-d46a645ee5ea, skipping ID generation
2026-03-29 20:12:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d570834-cb1e-5549-9cdb-d46a645ee5ea with scrape type 1
2026-03-29 20:12:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4d570834-cb1e-5549-9cdb-d46a645ee5ea sending to next pipeline
2026-03-29 20:12:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 4d570834-cb1e-5549-9cdb-d46a645ee5ea, identifier: 18787282
2026-03-29 20:12:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65beec590>
2026-03-29 20:12:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da09d692-879b-55d0-86c5-5ceca0a57225/da09d692-879b-55d0-86c5-5ceca0a57225_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0180%252F19960180%252Finterior_boot-1774707357393.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0180/19960180/interior_boot-1774707357393.jpg saved to cache
2026-03-29 20:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item da09d692-879b-55d0-86c5-5ceca0a57225
2026-03-29 20:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4971%252F20404971%252Fexterior_rear_passenger-1774535325909.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4971/20404971/exterior_rear_passenger-1774535325909.jpg not downloaded yet
2026-03-29 20:12:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 4d570834-cb1e-5549-9cdb-d46a645ee5ea with identifier: 18787282
2026-03-29 20:12:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 4d570834-cb1e-5549-9cdb-d46a645ee5ea with identifier: 18787282
2026-03-29 20:12:31 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 4d570834-cb1e-5549-9cdb-d46a645ee5ea with identifier: 18787282 to the API
2026-03-29 20:12:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7282/18787282/exterior_rear_driver-1774707063789.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '4d570834-cb1e-5549-9cdb-d46a645ee5ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NL67 EKD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18787282',
'listing': 'auction',
'location': 'Northamptonshire Banbury',
'make': 'Toyota',
'model': 'Aygo',
'odometer': 21323,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d570834-cb1e-5549-9cdb-d46a645ee5ea/4d570834-cb1e-5549-9cdb-d46a645ee5ea_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2109340,
'Height': 2537,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7282/18787282/exterior_front_driver-1774708204892.jpg',
'Width': 3383},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d570834-cb1e-5549-9cdb-d46a645ee5ea/4d570834-cb1e-5549-9cdb-d46a645ee5ea_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1448539,
'Height': 2418,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7282/18787282/exterior_rear_driver-1774707063789.jpg',
'Width': 3224},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d570834-cb1e-5549-9cdb-d46a645ee5ea/4d570834-cb1e-5549-9cdb-d46a645ee5ea_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1139829,
'Height': 2246,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7282/18787282/exterior_front_passenger-1774707053926.jpg',
'Width': 2995},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d570834-cb1e-5549-9cdb-d46a645ee5ea/4d570834-cb1e-5549-9cdb-d46a645ee5ea_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1568307,
'Height': 2318,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7282/18787282/exterior_rear_passenger-1774707063709.jpg',
'Width': 3090},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d570834-cb1e-5549-9cdb-d46a645ee5ea/4d570834-cb1e-5549-9cdb-d46a645ee5ea_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2418849,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7282/18787282/interior_front_seats-1774707670638.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d570834-cb1e-5549-9cdb-d46a645ee5ea/4d570834-cb1e-5549-9cdb-d46a645ee5ea_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2482367,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7282/18787282/interior_rear_seats-1774707661153.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d570834-cb1e-5549-9cdb-d46a645ee5ea/4d570834-cb1e-5549-9cdb-d46a645ee5ea_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1817270,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7282/18787282/interior_dashboard-1774707720934.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d570834-cb1e-5549-9cdb-d46a645ee5ea/4d570834-cb1e-5549-9cdb-d46a645ee5ea_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2671207,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7282/18787282/interior_boot-1774707678420.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d570834-cb1e-5549-9cdb-d46a645ee5ea/4d570834-cb1e-5549-9cdb-d46a645ee5ea_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1866534,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7282/18787282/damage_paintwork-1774707154384.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d570834-cb1e-5549-9cdb-d46a645ee5ea/4d570834-cb1e-5549-9cdb-d46a645ee5ea_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1508061,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7282/18787282/damage_windscreen-1774707197953.jpg',
'Width': 3840}],
'price': 5645,
'price_includes_vat': False,
'registration_date': '2018-01-22',
'seats_number': None,
'seller_name': None,
'title': 'Toyota Aygo X-PLAY VVT-i',
'transmission': 'manual',
'trim': 'X-PLAY VVT-i',
'vin': 'JTDKGNEC30N292248',
'year': 2018}
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718787282%27 HTTP/1.1" 200 None
2026-03-29 20:12:32 [motorway.uk] INFO: Saving data for 18787282: {'created_time': 1774815152.167232, 'last_price_update_time': 1774815152.167242, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18787282') HTTP/1.1" 204 0
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4971%252F20404971%252Finterior_front_seats-1774535595043.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4971/20404971/interior_front_seats-1774535595043.jpg not downloaded yet
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4971%252F20404971%252Finterior_rear_seats-1774535609484.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4971/20404971/interior_rear_seats-1774535609484.jpg not downloaded yet
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4971%252F20404971%252Finterior_dashboard-1774535686208.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4971/20404971/interior_dashboard-1774535686208.jpg not downloaded yet
2026-03-29 20:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0180/19960180/interior_dashboard-1774721079322.jpg> (referer: None)
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4971%252F20404971%252Finstrument_cluster-1774697784716.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4971/20404971/instrument_cluster-1774697784716.jpg not downloaded yet
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4971%252F20404971%252Finterior_boot-1774535651254.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4971/20404971/interior_boot-1774535651254.jpg not downloaded yet
2026-03-29 20:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0180/19960180/interior_rear_seats-1774721061102.jpg> (referer: None)
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4971%252F20404971%252Fdocs_service_history-1774558231021.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df693097e66119a4485d4882ca96d949f%27 HTTP/1.1" 200 None
2026-03-29 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4971/20404971/docs_service_history-1774558231021.jpg?ixlib=js-3.8.0&auto=format&s=f693097e66119a4485d4882ca96d949f not downloaded yet
2026-03-29 20:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20501153.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0180/19960180/interior_front_seats-1774716971956.jpg> (referer: None)
2026-03-29 20:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9514/20459514/interior_front_seats-1774615886180.jpg> (referer: None)
2026-03-29 20:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9514/20459514/exterior_rear_passenger-1774614627495.jpg> (referer: None)
2026-03-29 20:12:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c3b210>
2026-03-29 20:12:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da09d692-879b-55d0-86c5-5ceca0a57225/da09d692-879b-55d0-86c5-5ceca0a57225_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0180%252F19960180%252Finterior_dashboard-1774721079322.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0180/19960180/interior_dashboard-1774721079322.jpg saved to cache
2026-03-29 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item da09d692-879b-55d0-86c5-5ceca0a57225
2026-03-29 20:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/8670436.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20454140.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658edde90>
2026-03-29 20:12:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da09d692-879b-55d0-86c5-5ceca0a57225/da09d692-879b-55d0-86c5-5ceca0a57225_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0180%252F19960180%252Finterior_rear_seats-1774721061102.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0180/19960180/interior_rear_seats-1774721061102.jpg saved to cache
2026-03-29 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item da09d692-879b-55d0-86c5-5ceca0a57225
2026-03-29 20:12:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c20b695-14fb-5743-8584-9ffb5ea12cea with identifier: 20501153
2026-03-29 20:12:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c20b695-14fb-5743-8584-9ffb5ea12cea with scrape type 1
2026-03-29 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7c20b695-14fb-5743-8584-9ffb5ea12cea
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1153%252F20501153%252Fexterior_front_driver-1774780573714.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1153/20501153/exterior_front_driver-1774780573714.jpg not downloaded yet
2026-03-29 20:12:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658db3650>
2026-03-29 20:12:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da09d692-879b-55d0-86c5-5ceca0a57225/da09d692-879b-55d0-86c5-5ceca0a57225_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0180%252F19960180%252Finterior_front_seats-1774716971956.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0180/19960180/interior_front_seats-1774716971956.jpg saved to cache
2026-03-29 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item da09d692-879b-55d0-86c5-5ceca0a57225
2026-03-29 20:12:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da09d692-879b-55d0-86c5-5ceca0a57225, skipping ID generation
2026-03-29 20:12:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da09d692-879b-55d0-86c5-5ceca0a57225 with scrape type 1
2026-03-29 20:12:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da09d692-879b-55d0-86c5-5ceca0a57225 sending to next pipeline
2026-03-29 20:12:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: da09d692-879b-55d0-86c5-5ceca0a57225, identifier: 19960180
2026-03-29 20:12:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65836f450>
2026-03-29 20:12:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff097339-7833-5dab-9884-10641896398c/ff097339-7833-5dab-9884-10641896398c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9514%252F20459514%252Finterior_front_seats-1774615886180.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9514/20459514/interior_front_seats-1774615886180.jpg saved to cache
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff097339-7833-5dab-9884-10641896398c
2026-03-29 20:12:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658569590>
2026-03-29 20:12:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff097339-7833-5dab-9884-10641896398c/ff097339-7833-5dab-9884-10641896398c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9514%252F20459514%252Fexterior_rear_passenger-1774614627495.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9514/20459514/exterior_rear_passenger-1774614627495.jpg saved to cache
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ff097339-7833-5dab-9884-10641896398c
2026-03-29 20:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19905808.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: da09d692-879b-55d0-86c5-5ceca0a57225 with identifier: 19960180
2026-03-29 20:12:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: da09d692-879b-55d0-86c5-5ceca0a57225 with identifier: 19960180
2026-03-29 20:12:33 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: da09d692-879b-55d0-86c5-5ceca0a57225 with identifier: 19960180 to the API
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/0180/19960180/interior_front_seats-1774716971956.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'da09d692-879b-55d0-86c5-5ceca0a57225',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OV21 WUJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19960180',
'listing': 'auction',
'location': 'Kent Maidstone',
'make': 'BMW',
'model': '5 Series',
'odometer': 47000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da09d692-879b-55d0-86c5-5ceca0a57225/da09d692-879b-55d0-86c5-5ceca0a57225_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1009253,
'Height': 1613,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0180/19960180/exterior_front_driver-1774706956031.jpg',
'Width': 2151},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da09d692-879b-55d0-86c5-5ceca0a57225/da09d692-879b-55d0-86c5-5ceca0a57225_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1327786,
'Height': 1893,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0180/19960180/exterior_rear_driver-1774721026133.jpg',
'Width': 2524},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da09d692-879b-55d0-86c5-5ceca0a57225/da09d692-879b-55d0-86c5-5ceca0a57225_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1598808,
'Height': 1789,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0180/19960180/exterior_front_passenger-1774721041431.jpg',
'Width': 2385},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da09d692-879b-55d0-86c5-5ceca0a57225/da09d692-879b-55d0-86c5-5ceca0a57225_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2050751,
'Height': 2318,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0180/19960180/exterior_rear_passenger-1774706921697.jpg',
'Width': 3091},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da09d692-879b-55d0-86c5-5ceca0a57225/da09d692-879b-55d0-86c5-5ceca0a57225_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1697690,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0180/19960180/interior_front_seats-1774716971956.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da09d692-879b-55d0-86c5-5ceca0a57225/da09d692-879b-55d0-86c5-5ceca0a57225_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1236125,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0180/19960180/interior_rear_seats-1774721061102.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da09d692-879b-55d0-86c5-5ceca0a57225/da09d692-879b-55d0-86c5-5ceca0a57225_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1604005,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0180/19960180/interior_dashboard-1774721079322.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da09d692-879b-55d0-86c5-5ceca0a57225/da09d692-879b-55d0-86c5-5ceca0a57225_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1340998,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0180/19960180/instrument_cluster-1774707917091.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da09d692-879b-55d0-86c5-5ceca0a57225/da09d692-879b-55d0-86c5-5ceca0a57225_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2688885,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0180/19960180/interior_boot-1774707357393.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da09d692-879b-55d0-86c5-5ceca0a57225/da09d692-879b-55d0-86c5-5ceca0a57225_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1300927,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0180/19960180/docs_service_history-1774707777342.jpg?ixlib=js-3.8.0&auto=format&s=3591b466643218ac13af1408b8b8cb93',
'Width': 3840}],
'price': 27155,
'price_includes_vat': False,
'registration_date': '2021-05-28',
'seats_number': None,
'seller_name': None,
'title': 'BMW 530D xDrive M Sport MHEV Auto',
'transmission': 'automatic',
'trim': '530D xDrive M Sport MHEV Auto',
'vin': 'WBA32AH090CH40016',
'year': 2021}
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719960180%27 HTTP/1.1" 200 None
2026-03-29 20:12:33 [motorway.uk] INFO: Saving data for 19960180: {'created_time': 1774815153.674904, 'last_price_update_time': 1774815153.674913, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19960180') HTTP/1.1" 204 0
2026-03-29 20:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9514/20459514/exterior_front_passenger-1774614657403.jpg> (referer: None)
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1153%252F20501153%252Fexterior_rear_driver-1774780589557.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1153/20501153/exterior_rear_driver-1774780589557.jpg not downloaded yet
2026-03-29 20:12:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4971/20404971/docs_service_history-1774558231021.jpg?ixlib=js-3.8.0&auto=format&s=f693097e66119a4485d4882ca96d949f> (referer: None)
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1153%252F20501153%252Fexterior_front_passenger-1774780602683.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1153/20501153/exterior_front_passenger-1774780602683.jpg not downloaded yet
2026-03-29 20:12:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82168178-cc4e-5df8-89e4-4e7ada4b0faa with identifier: 8670436
2026-03-29 20:12:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82168178-cc4e-5df8-89e4-4e7ada4b0faa with scrape type 1
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82168178-cc4e-5df8-89e4-4e7ada4b0faa
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0436%252F8670436%252Fexterior_front_driver-1747674745528.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0436/8670436/exterior_front_driver-1747674745528.jpeg not downloaded yet
2026-03-29 20:12:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20db1439-e706-5d25-a85a-2dd23c709df1 with identifier: 20454140
2026-03-29 20:12:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20db1439-e706-5d25-a85a-2dd23c709df1 with scrape type 1
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 20db1439-e706-5d25-a85a-2dd23c709df1
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4140%252F20454140%252Fexterior_front_driver-1774704131114.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4140/20454140/exterior_front_driver-1774704131114.jpg not downloaded yet
2026-03-29 20:12:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b8f84f0-d55c-5d56-bb4a-a80a18db2e2c with identifier: 19905808
2026-03-29 20:12:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b8f84f0-d55c-5d56-bb4a-a80a18db2e2c with scrape type 1
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6b8f84f0-d55c-5d56-bb4a-a80a18db2e2c
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5808%252F19905808%252Fexterior_front_driver-1772284905538.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5808/19905808/exterior_front_driver-1772284905538.jpeg already downloaded
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5808%252F19905808%252Fexterior_rear_driver-1772285080593.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5808/19905808/exterior_rear_driver-1772285080593.jpeg already downloaded
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5808%252F19905808%252Fexterior_front_passenger-1772284962001.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5808/19905808/exterior_front_passenger-1772284962001.jpeg already downloaded
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5808%252F19905808%252Fexterior_rear_passenger-1772285082075.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5808/19905808/exterior_rear_passenger-1772285082075.jpeg already downloaded
2026-03-29 20:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5808%252F19905808%252Finterior_front_seats-1772199384425.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5808/19905808/interior_front_seats-1772199384425.jpeg already downloaded
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5808%252F19905808%252Finterior_rear_seats-1772203811798.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5808/19905808/interior_rear_seats-1772203811798.jpeg already downloaded
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5808%252F19905808%252F19905808-interior_dashboard-modified-1772292396283.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5808/19905808/19905808-interior_dashboard-modified-1772292396283.jpeg already downloaded
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5808%252F19905808%252Finterior_boot-1772204102283.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5808/19905808/interior_boot-1772204102283.jpeg already downloaded
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F5808%252F19905808%252Fdocs_service_history-1772296373840.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De59c13e753d1d198c81fb11f7386c45e%27 HTTP/1.1" 200 None
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/5808/19905808/docs_service_history-1772296373840.jpeg?ixlib=js-3.8.0&auto=format&s=e59c13e753d1d198c81fb11f7386c45e already downloaded
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F5808%252F19905808%252Fdocs_service_history-1772296385016.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db2e7d071267176c816c472f4b0f0a5f3%27 HTTP/1.1" 200 None
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/5808/19905808/docs_service_history-1772296385016.jpeg?ixlib=js-3.8.0&auto=format&s=b2e7d071267176c816c472f4b0f0a5f3 already downloaded
2026-03-29 20:12:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6b8f84f0-d55c-5d56-bb4a-a80a18db2e2c, identifier: 19905808
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1153%252F20501153%252Fexterior_rear_passenger-1774780594232.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1153/20501153/exterior_rear_passenger-1774780594232.jpg not downloaded yet
2026-03-29 20:12:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6b8f84f0-d55c-5d56-bb4a-a80a18db2e2c with identifier: 19905808
2026-03-29 20:12:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6b8f84f0-d55c-5d56-bb4a-a80a18db2e2c with identifier: 19905808
2026-03-29 20:12:34 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6b8f84f0-d55c-5d56-bb4a-a80a18db2e2c with identifier: 19905808 to the API
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19905808.json>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.9L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '6b8f84f0-d55c-5d56-bb4a-a80a18db2e2c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'R12 GBH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19905808',
'listing': 'auction',
'location': 'Cornwall Hayle',
'make': 'Audi',
'model': 'RS5',
'odometer': 15200,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 29,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/5808/19905808/exterior_front_driver-1772284905538.jpeg',
'https://motorway-photos-redacted.imgix.net/5808/19905808/exterior_rear_driver-1772285080593.jpeg',
'https://motorway-photos-redacted.imgix.net/5808/19905808/exterior_front_passenger-1772284962001.jpeg',
'https://motorway-photos-redacted.imgix.net/5808/19905808/exterior_rear_passenger-1772285082075.jpeg',
'https://motorway-photos.imgix.net/5808/19905808/interior_front_seats-1772199384425.jpeg',
'https://motorway-photos.imgix.net/5808/19905808/interior_rear_seats-1772203811798.jpeg',
'https://motorway-photos-modified.imgix.net/5808/19905808/19905808-interior_dashboard-modified-1772292396283.jpeg',
'https://motorway-photos.imgix.net/5808/19905808/interior_boot-1772204102283.jpeg',
'https://motorway-service-history-photos.imgix.net/redacted/5808/19905808/docs_service_history-1772296373840.jpeg?ixlib=js-3.8.0&auto=format&s=e59c13e753d1d198c81fb11f7386c45e',
'https://motorway-service-history-photos.imgix.net/redacted/5808/19905808/docs_service_history-1772296385016.jpeg?ixlib=js-3.8.0&auto=format&s=b2e7d071267176c816c472f4b0f0a5f3'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca94d825-58fd-5bdf-b6e3-669145bfb404/ca94d825-58fd-5bdf-b6e3-669145bfb404_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1833814,
'Height': 2944,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5808/19905808/exterior_front_driver-1772284905538.jpeg',
'Width': 3925},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca94d825-58fd-5bdf-b6e3-669145bfb404/ca94d825-58fd-5bdf-b6e3-669145bfb404_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1994004,
'Height': 2914,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5808/19905808/exterior_rear_driver-1772285080593.jpeg',
'Width': 3885},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca94d825-58fd-5bdf-b6e3-669145bfb404/ca94d825-58fd-5bdf-b6e3-669145bfb404_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2135311,
'Height': 3023,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5808/19905808/exterior_front_passenger-1772284962001.jpeg',
'Width': 4031},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca94d825-58fd-5bdf-b6e3-669145bfb404/ca94d825-58fd-5bdf-b6e3-669145bfb404_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2075117,
'Height': 3010,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5808/19905808/exterior_rear_passenger-1772285082075.jpeg',
'Width': 4013},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca94d825-58fd-5bdf-b6e3-669145bfb404/ca94d825-58fd-5bdf-b6e3-669145bfb404_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3087175,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5808/19905808/interior_front_seats-1772199384425.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca94d825-58fd-5bdf-b6e3-669145bfb404/ca94d825-58fd-5bdf-b6e3-669145bfb404_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2543989,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5808/19905808/interior_rear_seats-1772203811798.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca94d825-58fd-5bdf-b6e3-669145bfb404/ca94d825-58fd-5bdf-b6e3-669145bfb404_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2510687,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5808/19905808/19905808-interior_dashboard-modified-1772292396283.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca94d825-58fd-5bdf-b6e3-669145bfb404/ca94d825-58fd-5bdf-b6e3-669145bfb404_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2674484,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5808/19905808/interior_boot-1772204102283.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca94d825-58fd-5bdf-b6e3-669145bfb404/ca94d825-58fd-5bdf-b6e3-669145bfb404_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2385653,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/5808/19905808/docs_service_history-1772296373840.jpeg?ixlib=js-3.8.0&auto=format&s=e59c13e753d1d198c81fb11f7386c45e',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca94d825-58fd-5bdf-b6e3-669145bfb404/ca94d825-58fd-5bdf-b6e3-669145bfb404_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2359995,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/5808/19905808/docs_service_history-1772296385016.jpeg?ixlib=js-3.8.0&auto=format&s=b2e7d071267176c816c472f4b0f0a5f3',
'Width': 4032}],
'price': 36695,
'price_includes_vat': False,
'registration_date': '2020-10-08',
'seats_number': None,
'seller_name': None,
'title': 'Audi RS 5 TFSI Quattro Auto',
'transmission': 'automatic',
'trim': 'RS 5 TFSI Quattro Auto',
'vin': 'WUAZZZF58LA900876',
'year': 2020}
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719905808%27 HTTP/1.1" 200 None
2026-03-29 20:12:34 [motorway.uk] INFO: Saving data for 19905808: {'created_time': 1774815154.647379, 'last_price_update_time': 1774815154.647393, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19905808') HTTP/1.1" 204 0
2026-03-29 20:12:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9514/20459514/exterior_rear_driver-1774614612667.jpg> (referer: None)
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0436%252F8670436%252Fexterior_rear_driver-1747674689543.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0436/8670436/exterior_rear_driver-1747674689543.jpeg not downloaded yet
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4140%252F20454140%252Fexterior_rear_driver-1774704156592.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4140/20454140/exterior_rear_driver-1774704156592.jpg not downloaded yet
2026-03-29 20:12:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20300016.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4971/20404971/exterior_rear_driver-1774535310704.jpg> (referer: None)
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1153%252F20501153%252Finterior_front_seats-1774780846707.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1153/20501153/interior_front_seats-1774780846707.jpg not downloaded yet
2026-03-29 20:12:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4971/20404971/exterior_rear_passenger-1774535325909.jpg> (referer: None)
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0436%252F8670436%252Fexterior_front_passenger-1747674663147.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0436/8670436/exterior_front_passenger-1747674663147.jpeg not downloaded yet
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4140%252F20454140%252Fexterior_front_passenger-1774704192737.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4140/20454140/exterior_front_passenger-1774704192737.jpg not downloaded yet
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a716d0>
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff097339-7833-5dab-9884-10641896398c/ff097339-7833-5dab-9884-10641896398c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9514%252F20459514%252Fexterior_front_passenger-1774614657403.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9514/20459514/exterior_front_passenger-1774614657403.jpg saved to cache
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ff097339-7833-5dab-9884-10641896398c
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658819fd0>
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f271e52e-6d99-53d0-8cc0-da37607c824d/f271e52e-6d99-53d0-8cc0-da37607c824d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4971%252F20404971%252Fdocs_service_history-1774558231021.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df693097e66119a4485d4882ca96d949f') HTTP/1.1" 204 0
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4971/20404971/docs_service_history-1774558231021.jpg?ixlib=js-3.8.0&auto=format&s=f693097e66119a4485d4882ca96d949f saved to cache
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f271e52e-6d99-53d0-8cc0-da37607c824d
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1153%252F20501153%252Finterior_rear_seats-1774780856106.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1153/20501153/interior_rear_seats-1774780856106.jpg not downloaded yet
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0436%252F8670436%252F8670436-exterior_rear_passenger-modified-1747825829195.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0436/8670436/8670436-exterior_rear_passenger-modified-1747825829195.jpeg not downloaded yet
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4140%252F20454140%252Fexterior_rear_passenger-1774704171261.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4140/20454140/exterior_rear_passenger-1774704171261.jpg not downloaded yet
2026-03-29 20:12:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4971/20404971/exterior_front_passenger-1774535328301.jpg> (referer: None)
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1153%252F20501153%252Finterior_dashboard-1774781776410.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1153/20501153/interior_dashboard-1774781776410.jpg not downloaded yet
2026-03-29 20:12:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a08ad0>
2026-03-29 20:12:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff097339-7833-5dab-9884-10641896398c/ff097339-7833-5dab-9884-10641896398c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9514%252F20459514%252Fexterior_rear_driver-1774614612667.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9514/20459514/exterior_rear_driver-1774614612667.jpg saved to cache
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff097339-7833-5dab-9884-10641896398c
2026-03-29 20:12:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff097339-7833-5dab-9884-10641896398c, skipping ID generation
2026-03-29 20:12:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff097339-7833-5dab-9884-10641896398c with scrape type 1
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff097339-7833-5dab-9884-10641896398c sending to next pipeline
2026-03-29 20:12:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ff097339-7833-5dab-9884-10641896398c, identifier: 20459514
2026-03-29 20:12:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2730f448-ff3e-5bc9-a571-3a5672b035db with identifier: 20300016
2026-03-29 20:12:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2730f448-ff3e-5bc9-a571-3a5672b035db with scrape type 1
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2730f448-ff3e-5bc9-a571-3a5672b035db
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0016%252F20300016%252Fexterior_front_driver-1774783740102.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0016/20300016/exterior_front_driver-1774783740102.jpg not downloaded yet
2026-03-29 20:12:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587597d0>
2026-03-29 20:12:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f271e52e-6d99-53d0-8cc0-da37607c824d/f271e52e-6d99-53d0-8cc0-da37607c824d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4971%252F20404971%252Fexterior_rear_driver-1774535310704.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4971/20404971/exterior_rear_driver-1774535310704.jpg saved to cache
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f271e52e-6d99-53d0-8cc0-da37607c824d
2026-03-29 20:12:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586af990>
2026-03-29 20:12:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f271e52e-6d99-53d0-8cc0-da37607c824d/f271e52e-6d99-53d0-8cc0-da37607c824d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4971%252F20404971%252Fexterior_rear_passenger-1774535325909.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4971/20404971/exterior_rear_passenger-1774535325909.jpg saved to cache
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f271e52e-6d99-53d0-8cc0-da37607c824d
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0436%252F8670436%252Finterior_front_seats-1747674911266.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0436/8670436/interior_front_seats-1747674911266.jpeg not downloaded yet
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4140%252F20454140%252Finterior_front_seats-1774705067809.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4140/20454140/interior_front_seats-1774705067809.jpg not downloaded yet
2026-03-29 20:12:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ff097339-7833-5dab-9884-10641896398c with identifier: 20459514
2026-03-29 20:12:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ff097339-7833-5dab-9884-10641896398c with identifier: 20459514
2026-03-29 20:12:35 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ff097339-7833-5dab-9884-10641896398c with identifier: 20459514 to the API
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9514/20459514/exterior_rear_driver-1774614612667.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'ff097339-7833-5dab-9884-10641896398c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'HK22 MLY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20459514',
'listing': 'auction',
'location': 'None None',
'make': 'BMW',
'model': 'X5',
'odometer': 69000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff097339-7833-5dab-9884-10641896398c/ff097339-7833-5dab-9884-10641896398c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2148817,
'Height': 2539,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9514/20459514/exterior_front_driver-1774614579745.jpg',
'Width': 3385},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff097339-7833-5dab-9884-10641896398c/ff097339-7833-5dab-9884-10641896398c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2910283,
'Height': 2954,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9514/20459514/exterior_rear_driver-1774614612667.jpg',
'Width': 3938},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff097339-7833-5dab-9884-10641896398c/ff097339-7833-5dab-9884-10641896398c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2668767,
'Height': 2810,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9514/20459514/exterior_front_passenger-1774614657403.jpg',
'Width': 3746},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff097339-7833-5dab-9884-10641896398c/ff097339-7833-5dab-9884-10641896398c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2200487,
'Height': 2646,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9514/20459514/exterior_rear_passenger-1774614627495.jpg',
'Width': 3528},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff097339-7833-5dab-9884-10641896398c/ff097339-7833-5dab-9884-10641896398c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1836088,
'Height': 2575,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9514/20459514/interior_front_seats-1774615886180.jpg',
'Width': 3433},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff097339-7833-5dab-9884-10641896398c/ff097339-7833-5dab-9884-10641896398c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 785124,
'Height': 2023,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9514/20459514/interior_rear_seats-1774615944371.jpg',
'Width': 2697},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff097339-7833-5dab-9884-10641896398c/ff097339-7833-5dab-9884-10641896398c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2320651,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9514/20459514/interior_dashboard-1774615384006.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff097339-7833-5dab-9884-10641896398c/ff097339-7833-5dab-9884-10641896398c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1241667,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9514/20459514/instrument_cluster-1774615434945.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff097339-7833-5dab-9884-10641896398c/ff097339-7833-5dab-9884-10641896398c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4127690,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9514/20459514/interior_boot-1774615419939.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff097339-7833-5dab-9884-10641896398c/ff097339-7833-5dab-9884-10641896398c_image_9.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4709425,
'Height': 4284,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9514/20459514/docs_service_history-1774622675580.jpg?ixlib=js-3.8.0&auto=format&s=046e9320d1bf68e7405fb1f0a43dade3',
'Width': 5712}],
'price': 32902,
'price_includes_vat': False,
'registration_date': '2022-06-30',
'seats_number': None,
'seller_name': None,
'title': 'BMW X5 xDrive 30d M Sport MHEV Auto',
'transmission': 'automatic',
'trim': 'xDrive 30d M Sport MHEV Auto',
'vin': 'WBAJU820109M72463',
'year': 2022}
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720459514%27 HTTP/1.1" 200 None
2026-03-29 20:12:35 [motorway.uk] INFO: Saving data for 20459514: {'created_time': 1774815155.910213, 'last_price_update_time': 1774815155.910224, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20459514') HTTP/1.1" 204 0
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1153%252F20501153%252Finstrument_cluster-1774780945025.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1153/20501153/instrument_cluster-1774780945025.jpg not downloaded yet
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0016%252F20300016%252Fexterior_rear_driver-1774783737177.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0016/20300016/exterior_rear_driver-1774783737177.jpg not downloaded yet
2026-03-29 20:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0436%252F8670436%252Finterior_rear_seats-1747674825879.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0436/8670436/interior_rear_seats-1747674825879.jpeg not downloaded yet
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4140%252F20454140%252Finterior_rear_seats-1774705094274.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4140/20454140/interior_rear_seats-1774705094274.jpg not downloaded yet
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586e6c10>
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f271e52e-6d99-53d0-8cc0-da37607c824d/f271e52e-6d99-53d0-8cc0-da37607c824d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4971%252F20404971%252Fexterior_front_passenger-1774535328301.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4971/20404971/exterior_front_passenger-1774535328301.jpg saved to cache
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f271e52e-6d99-53d0-8cc0-da37607c824d
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1153%252F20501153%252Finterior_boot-1774780891038.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1153/20501153/interior_boot-1774780891038.jpg not downloaded yet
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0016%252F20300016%252Fexterior_front_passenger-1774786353062.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0016/20300016/exterior_front_passenger-1774786353062.jpg not downloaded yet
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0436%252F8670436%252F8670436-interior_dashboard-modified-1747824971619.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0436/8670436/8670436-interior_dashboard-modified-1747824971619.jpeg not downloaded yet
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4140%252F20454140%252Finterior_dashboard-1774716193238.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4140/20454140/interior_dashboard-1774716193238.jpg not downloaded yet
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1153%252F20501153%252Fdocs_service_history-1774781008169.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D24e35b1ee26c6a87194657235c60f8d8%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1153/20501153/docs_service_history-1774781008169.jpg?ixlib=js-3.8.0&auto=format&s=24e35b1ee26c6a87194657235c60f8d8 not downloaded yet
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0016%252F20300016%252Fexterior_rear_passenger-1774783738005.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0016/20300016/exterior_rear_passenger-1774783738005.jpg not downloaded yet
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0436%252F8670436%252F8670436-instrument_cluster-modified-1747825134485.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0436/8670436/8670436-instrument_cluster-modified-1747825134485.jpeg not downloaded yet
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4140%252F20454140%252Finstrument_cluster-1774705191185.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4140/20454140/instrument_cluster-1774705191185.jpg not downloaded yet
2026-03-29 20:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4971/20404971/interior_dashboard-1774535686208.jpg> (referer: None)
2026-03-29 20:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4971/20404971/instrument_cluster-1774697784716.jpg> (referer: None)
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0016%252F20300016%252Finterior_front_seats-1774786364149.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0016/20300016/interior_front_seats-1774786364149.jpg not downloaded yet
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0436%252F8670436%252Finterior_boot-1747674862438.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0436/8670436/interior_boot-1747674862438.jpeg not downloaded yet
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4140%252F20454140%252Finterior_boot-1774705096105.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4140/20454140/interior_boot-1774705096105.jpg not downloaded yet
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0016%252F20300016%252Finterior_rear_seats-1774785108424.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0016/20300016/interior_rear_seats-1774785108424.jpg not downloaded yet
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F0436%252F8670436%252F8670436-docs_service_history-modified-1747824327655.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D97efb21b82b5b44d2ade4087aca7e0fe%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/0436/8670436/8670436-docs_service_history-modified-1747824327655.jpeg?ixlib=js-3.8.0&auto=format&s=97efb21b82b5b44d2ade4087aca7e0fe not downloaded yet
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4140%252F20454140%252Fdocs_service_history-1774705343722.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D35b20e8ae8d7c9ebb9b99c98e0d7a15b%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4140/20454140/docs_service_history-1774705343722.jpg?ixlib=js-3.8.0&auto=format&s=35b20e8ae8d7c9ebb9b99c98e0d7a15b not downloaded yet
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0016%252F20300016%252Finterior_dashboard-1774786378701.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0016/20300016/interior_dashboard-1774786378701.jpg not downloaded yet
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0016%252F20300016%252Finstrument_cluster-1774785186330.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0016/20300016/instrument_cluster-1774785186330.jpg not downloaded yet
2026-03-29 20:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1153/20501153/exterior_rear_driver-1774780589557.jpg> (referer: None)
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589e8150>
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f271e52e-6d99-53d0-8cc0-da37607c824d/f271e52e-6d99-53d0-8cc0-da37607c824d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4971%252F20404971%252Finterior_dashboard-1774535686208.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4971/20404971/interior_dashboard-1774535686208.jpg saved to cache
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f271e52e-6d99-53d0-8cc0-da37607c824d
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658705cd0>
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f271e52e-6d99-53d0-8cc0-da37607c824d/f271e52e-6d99-53d0-8cc0-da37607c824d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4971%252F20404971%252Finstrument_cluster-1774697784716.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4971/20404971/instrument_cluster-1774697784716.jpg saved to cache
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f271e52e-6d99-53d0-8cc0-da37607c824d
2026-03-29 20:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1153/20501153/exterior_front_driver-1774780573714.jpg> (referer: None)
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0016%252F20300016%252Finterior_boot-1774785107067.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0016/20300016/interior_boot-1774785107067.jpg not downloaded yet
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F0016%252F20300016%252Fdocs_service_history-1774786333734.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De2e02b1ba74785d4091c409d872a0694%27 HTTP/1.1" 200 None
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/0016/20300016/docs_service_history-1774786333734.jpg?ixlib=js-3.8.0&auto=format&s=e2e02b1ba74785d4091c409d872a0694 not downloaded yet
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659dafa50>
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c20b695-14fb-5743-8584-9ffb5ea12cea/7c20b695-14fb-5743-8584-9ffb5ea12cea_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1153%252F20501153%252Fexterior_rear_driver-1774780589557.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1153/20501153/exterior_rear_driver-1774780589557.jpg saved to cache
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7c20b695-14fb-5743-8584-9ffb5ea12cea
2026-03-29 20:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1153/20501153/exterior_front_passenger-1774780602683.jpg> (referer: None)
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586b8b10>
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c20b695-14fb-5743-8584-9ffb5ea12cea/7c20b695-14fb-5743-8584-9ffb5ea12cea_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1153%252F20501153%252Fexterior_front_driver-1774780573714.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1153/20501153/exterior_front_driver-1774780573714.jpg saved to cache
2026-03-29 20:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c20b695-14fb-5743-8584-9ffb5ea12cea
2026-03-29 20:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1153/20501153/docs_service_history-1774781008169.jpg?ixlib=js-3.8.0&auto=format&s=24e35b1ee26c6a87194657235c60f8d8> (referer: None)
2026-03-29 20:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0016/20300016/exterior_rear_passenger-1774783738005.jpg> (referer: None)
2026-03-29 20:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0016/20300016/instrument_cluster-1774785186330.jpg> (referer: None)
2026-03-29 20:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0016/20300016/exterior_rear_driver-1774783737177.jpg> (referer: None)
2026-03-29 20:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4971/20404971/interior_boot-1774535651254.jpg> (referer: None)
2026-03-29 20:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4971/20404971/interior_front_seats-1774535595043.jpg> (referer: None)
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65872fb90>
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c20b695-14fb-5743-8584-9ffb5ea12cea/7c20b695-14fb-5743-8584-9ffb5ea12cea_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1153%252F20501153%252Fexterior_front_passenger-1774780602683.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1153/20501153/exterior_front_passenger-1774780602683.jpg saved to cache
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7c20b695-14fb-5743-8584-9ffb5ea12cea
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c97f50>
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c20b695-14fb-5743-8584-9ffb5ea12cea/7c20b695-14fb-5743-8584-9ffb5ea12cea_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1153%252F20501153%252Fdocs_service_history-1774781008169.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D24e35b1ee26c6a87194657235c60f8d8') HTTP/1.1" 204 0
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1153/20501153/docs_service_history-1774781008169.jpg?ixlib=js-3.8.0&auto=format&s=24e35b1ee26c6a87194657235c60f8d8 saved to cache
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7c20b695-14fb-5743-8584-9ffb5ea12cea
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d77990>
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2730f448-ff3e-5bc9-a571-3a5672b035db/2730f448-ff3e-5bc9-a571-3a5672b035db_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0016%252F20300016%252Fexterior_rear_passenger-1774783738005.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0016/20300016/exterior_rear_passenger-1774783738005.jpg saved to cache
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2730f448-ff3e-5bc9-a571-3a5672b035db
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d78790>
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2730f448-ff3e-5bc9-a571-3a5672b035db/2730f448-ff3e-5bc9-a571-3a5672b035db_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0016%252F20300016%252Finstrument_cluster-1774785186330.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0016/20300016/instrument_cluster-1774785186330.jpg saved to cache
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2730f448-ff3e-5bc9-a571-3a5672b035db
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582f1d10>
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2730f448-ff3e-5bc9-a571-3a5672b035db/2730f448-ff3e-5bc9-a571-3a5672b035db_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0016%252F20300016%252Fexterior_rear_driver-1774783737177.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0016/20300016/exterior_rear_driver-1774783737177.jpg saved to cache
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2730f448-ff3e-5bc9-a571-3a5672b035db
2026-03-29 20:12:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d7a2d0>
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f271e52e-6d99-53d0-8cc0-da37607c824d/f271e52e-6d99-53d0-8cc0-da37607c824d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4971%252F20404971%252Finterior_boot-1774535651254.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4971/20404971/interior_boot-1774535651254.jpg saved to cache
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f271e52e-6d99-53d0-8cc0-da37607c824d
2026-03-29 20:12:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf69690>
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f271e52e-6d99-53d0-8cc0-da37607c824d/f271e52e-6d99-53d0-8cc0-da37607c824d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4971%252F20404971%252Finterior_front_seats-1774535595043.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4971/20404971/interior_front_seats-1774535595043.jpg saved to cache
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f271e52e-6d99-53d0-8cc0-da37607c824d
2026-03-29 20:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4971/20404971/exterior_front_driver-1774611772197.jpg> (referer: None)
2026-03-29 20:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/0436/8670436/8670436-docs_service_history-modified-1747824327655.jpeg?ixlib=js-3.8.0&auto=format&s=97efb21b82b5b44d2ade4087aca7e0fe> (referer: None)
2026-03-29 20:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4140/20454140/docs_service_history-1774705343722.jpg?ixlib=js-3.8.0&auto=format&s=35b20e8ae8d7c9ebb9b99c98e0d7a15b> (referer: None)
2026-03-29 20:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4971/20404971/interior_rear_seats-1774535609484.jpg> (referer: None)
2026-03-29 20:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0016/20300016/interior_dashboard-1774786378701.jpg> (referer: None)
2026-03-29 20:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1153/20501153/instrument_cluster-1774780945025.jpg> (referer: None)
2026-03-29 20:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/0016/20300016/docs_service_history-1774786333734.jpg?ixlib=js-3.8.0&auto=format&s=e2e02b1ba74785d4091c409d872a0694> (referer: None)
2026-03-29 20:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0016/20300016/interior_boot-1774785107067.jpg> (referer: None)
2026-03-29 20:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4140/20454140/interior_front_seats-1774705067809.jpg> (referer: None)
2026-03-29 20:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0016/20300016/interior_rear_seats-1774785108424.jpg> (referer: None)
2026-03-29 20:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4140/20454140/interior_rear_seats-1774705094274.jpg> (referer: None)
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582e74d0>
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f271e52e-6d99-53d0-8cc0-da37607c824d/f271e52e-6d99-53d0-8cc0-da37607c824d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4971%252F20404971%252Fexterior_front_driver-1774611772197.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4971/20404971/exterior_front_driver-1774611772197.jpg saved to cache
2026-03-29 20:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f271e52e-6d99-53d0-8cc0-da37607c824d
2026-03-29 20:12:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658382710>
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82168178-cc4e-5df8-89e4-4e7ada4b0faa/82168178-cc4e-5df8-89e4-4e7ada4b0faa_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F0436%252F8670436%252F8670436-docs_service_history-modified-1747824327655.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D97efb21b82b5b44d2ade4087aca7e0fe') HTTP/1.1" 204 0
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/0436/8670436/8670436-docs_service_history-modified-1747824327655.jpeg?ixlib=js-3.8.0&auto=format&s=97efb21b82b5b44d2ade4087aca7e0fe saved to cache
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82168178-cc4e-5df8-89e4-4e7ada4b0faa
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586db990>
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20db1439-e706-5d25-a85a-2dd23c709df1/20db1439-e706-5d25-a85a-2dd23c709df1_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4140%252F20454140%252Fdocs_service_history-1774705343722.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D35b20e8ae8d7c9ebb9b99c98e0d7a15b') HTTP/1.1" 204 0
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4140/20454140/docs_service_history-1774705343722.jpg?ixlib=js-3.8.0&auto=format&s=35b20e8ae8d7c9ebb9b99c98e0d7a15b saved to cache
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 20db1439-e706-5d25-a85a-2dd23c709df1
2026-03-29 20:12:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ac1c50>
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f271e52e-6d99-53d0-8cc0-da37607c824d/f271e52e-6d99-53d0-8cc0-da37607c824d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4971%252F20404971%252Finterior_rear_seats-1774535609484.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4971/20404971/interior_rear_seats-1774535609484.jpg saved to cache
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f271e52e-6d99-53d0-8cc0-da37607c824d
2026-03-29 20:12:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f271e52e-6d99-53d0-8cc0-da37607c824d, skipping ID generation
2026-03-29 20:12:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f271e52e-6d99-53d0-8cc0-da37607c824d with scrape type 1
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f271e52e-6d99-53d0-8cc0-da37607c824d sending to next pipeline
2026-03-29 20:12:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f271e52e-6d99-53d0-8cc0-da37607c824d, identifier: 20404971
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599d56d0>
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2730f448-ff3e-5bc9-a571-3a5672b035db/2730f448-ff3e-5bc9-a571-3a5672b035db_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0016%252F20300016%252Finterior_dashboard-1774786378701.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0016/20300016/interior_dashboard-1774786378701.jpg saved to cache
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2730f448-ff3e-5bc9-a571-3a5672b035db
2026-03-29 20:12:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ff4850>
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c20b695-14fb-5743-8584-9ffb5ea12cea/7c20b695-14fb-5743-8584-9ffb5ea12cea_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1153%252F20501153%252Finstrument_cluster-1774780945025.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1153/20501153/instrument_cluster-1774780945025.jpg saved to cache
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7c20b695-14fb-5743-8584-9ffb5ea12cea
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586d9c10>
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2730f448-ff3e-5bc9-a571-3a5672b035db/2730f448-ff3e-5bc9-a571-3a5672b035db_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F0016%252F20300016%252Fdocs_service_history-1774786333734.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De2e02b1ba74785d4091c409d872a0694') HTTP/1.1" 204 0
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/0016/20300016/docs_service_history-1774786333734.jpg?ixlib=js-3.8.0&auto=format&s=e2e02b1ba74785d4091c409d872a0694 saved to cache
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2730f448-ff3e-5bc9-a571-3a5672b035db
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65901c550>
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2730f448-ff3e-5bc9-a571-3a5672b035db/2730f448-ff3e-5bc9-a571-3a5672b035db_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0016%252F20300016%252Finterior_boot-1774785107067.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0016/20300016/interior_boot-1774785107067.jpg saved to cache
2026-03-29 20:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2730f448-ff3e-5bc9-a571-3a5672b035db
2026-03-29 20:12:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589eb550>
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20db1439-e706-5d25-a85a-2dd23c709df1/20db1439-e706-5d25-a85a-2dd23c709df1_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4140%252F20454140%252Finterior_front_seats-1774705067809.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4140/20454140/interior_front_seats-1774705067809.jpg saved to cache
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 20db1439-e706-5d25-a85a-2dd23c709df1
2026-03-29 20:12:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65850f950>
2026-03-29 20:12:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2730f448-ff3e-5bc9-a571-3a5672b035db/2730f448-ff3e-5bc9-a571-3a5672b035db_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0016%252F20300016%252Finterior_rear_seats-1774785108424.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0016/20300016/interior_rear_seats-1774785108424.jpg saved to cache
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2730f448-ff3e-5bc9-a571-3a5672b035db
2026-03-29 20:12:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d78cd0>
2026-03-29 20:12:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20db1439-e706-5d25-a85a-2dd23c709df1/20db1439-e706-5d25-a85a-2dd23c709df1_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4140%252F20454140%252Finterior_rear_seats-1774705094274.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4140/20454140/interior_rear_seats-1774705094274.jpg saved to cache
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 20db1439-e706-5d25-a85a-2dd23c709df1
2026-03-29 20:12:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f271e52e-6d99-53d0-8cc0-da37607c824d with identifier: 20404971
2026-03-29 20:12:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f271e52e-6d99-53d0-8cc0-da37607c824d with identifier: 20404971
2026-03-29 20:12:39 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f271e52e-6d99-53d0-8cc0-da37607c824d with identifier: 20404971 to the API
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/4971/20404971/interior_rear_seats-1774535609484.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'f271e52e-6d99-53d0-8cc0-da37607c824d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'RO70 CFV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20404971',
'listing': 'auction',
'location': 'Oxfordshire Wantage',
'make': 'Audi',
'model': 'A3',
'odometer': 42000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f271e52e-6d99-53d0-8cc0-da37607c824d/f271e52e-6d99-53d0-8cc0-da37607c824d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3196433,
'Height': 3001,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4971/20404971/exterior_front_driver-1774611772197.jpg',
'Width': 4001},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f271e52e-6d99-53d0-8cc0-da37607c824d/f271e52e-6d99-53d0-8cc0-da37607c824d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2038485,
'Height': 2720,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4971/20404971/exterior_rear_driver-1774535310704.jpg',
'Width': 3627},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f271e52e-6d99-53d0-8cc0-da37607c824d/f271e52e-6d99-53d0-8cc0-da37607c824d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2004449,
'Height': 2774,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4971/20404971/exterior_front_passenger-1774535328301.jpg',
'Width': 3699},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f271e52e-6d99-53d0-8cc0-da37607c824d/f271e52e-6d99-53d0-8cc0-da37607c824d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1984857,
'Height': 2852,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4971/20404971/exterior_rear_passenger-1774535325909.jpg',
'Width': 3802},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f271e52e-6d99-53d0-8cc0-da37607c824d/f271e52e-6d99-53d0-8cc0-da37607c824d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2708905,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4971/20404971/interior_front_seats-1774535595043.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f271e52e-6d99-53d0-8cc0-da37607c824d/f271e52e-6d99-53d0-8cc0-da37607c824d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3451494,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4971/20404971/interior_rear_seats-1774535609484.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f271e52e-6d99-53d0-8cc0-da37607c824d/f271e52e-6d99-53d0-8cc0-da37607c824d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1647722,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4971/20404971/interior_dashboard-1774535686208.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f271e52e-6d99-53d0-8cc0-da37607c824d/f271e52e-6d99-53d0-8cc0-da37607c824d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 639002,
'Height': 1708,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4971/20404971/instrument_cluster-1774697784716.jpg',
'Width': 2277},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f271e52e-6d99-53d0-8cc0-da37607c824d/f271e52e-6d99-53d0-8cc0-da37607c824d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3204475,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4971/20404971/interior_boot-1774535651254.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f271e52e-6d99-53d0-8cc0-da37607c824d/f271e52e-6d99-53d0-8cc0-da37607c824d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186825,
'Height': 1595,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4971/20404971/docs_service_history-1774558231021.jpg?ixlib=js-3.8.0&auto=format&s=f693097e66119a4485d4882ca96d949f',
'Width': 1170}],
'price': 16844,
'price_includes_vat': False,
'registration_date': '2020-09-30',
'seats_number': None,
'seller_name': None,
'title': 'Audi A3 S Line 35 TFSI MHEV S-A',
'transmission': 'automatic',
'trim': 'S Line 35 TFSI MHEV S-A',
'vin': 'WAUZZZGY9MA027529',
'year': 2020}
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720404971%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [motorway.uk] INFO: Saving data for 20404971: {'created_time': 1774815159.738641, 'last_price_update_time': 1774815159.738651, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20404971') HTTP/1.1" 204 0
2026-03-29 20:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19280379.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0016/20300016/interior_front_seats-1774786364149.jpg> (referer: None)
2026-03-29 20:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4140/20454140/interior_boot-1774705096105.jpg> (referer: None)
2026-03-29 20:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0436/8670436/interior_boot-1747674862438.jpeg> (referer: None)
2026-03-29 20:12:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec3342ce-3a72-584f-98ea-1e0cbc191684 with identifier: 19280379
2026-03-29 20:12:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec3342ce-3a72-584f-98ea-1e0cbc191684 with scrape type 1
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ec3342ce-3a72-584f-98ea-1e0cbc191684
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0379%252F19280379%252Fexterior_front_driver-1774521674136.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0379/19280379/exterior_front_driver-1774521674136.jpeg not downloaded yet
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0379%252F19280379%252Fexterior_rear_driver-1774546621589.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0379/19280379/exterior_rear_driver-1774546621589.jpeg not downloaded yet
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0379%252F19280379%252Fexterior_front_passenger-1774546549290.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0379/19280379/exterior_front_passenger-1774546549290.jpeg not downloaded yet
2026-03-29 20:12:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658b2fbd0>
2026-03-29 20:12:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2730f448-ff3e-5bc9-a571-3a5672b035db/2730f448-ff3e-5bc9-a571-3a5672b035db_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0016%252F20300016%252Finterior_front_seats-1774786364149.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0016/20300016/interior_front_seats-1774786364149.jpg saved to cache
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2730f448-ff3e-5bc9-a571-3a5672b035db
2026-03-29 20:12:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a11b50>
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20db1439-e706-5d25-a85a-2dd23c709df1/20db1439-e706-5d25-a85a-2dd23c709df1_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4140%252F20454140%252Finterior_boot-1774705096105.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4140/20454140/interior_boot-1774705096105.jpg saved to cache
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 20db1439-e706-5d25-a85a-2dd23c709df1
2026-03-29 20:12:40 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:40 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:40 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x008\x98\xf6\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xd7\xb5\x008\x8e\xe4\x00\x00\x00\x00'
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf533d0>
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82168178-cc4e-5df8-89e4-4e7ada4b0faa/82168178-cc4e-5df8-89e4-4e7ada4b0faa_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0436%252F8670436%252Finterior_boot-1747674862438.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0436/8670436/interior_boot-1747674862438.jpeg saved to cache
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82168178-cc4e-5df8-89e4-4e7ada4b0faa
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0379%252F19280379%252Fexterior_rear_passenger-1774546583775.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0379/19280379/exterior_rear_passenger-1774546583775.jpeg not downloaded yet
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0379%252F19280379%252Finterior_front_seats-1774546657725.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0379/19280379/interior_front_seats-1774546657725.jpeg not downloaded yet
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0379%252F19280379%252Finterior_rear_seats-1774546718543.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0379/19280379/interior_rear_seats-1774546718543.jpeg not downloaded yet
2026-03-29 20:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0436/8670436/interior_rear_seats-1747674825879.jpeg> (referer: None)
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0379%252F19280379%252Finterior_dashboard-1774546755000.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0379/19280379/interior_dashboard-1774546755000.jpeg not downloaded yet
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0379%252F19280379%252F19280379-interior_boot-modified-1774614120528.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0379/19280379/19280379-interior_boot-modified-1774614120528.jpeg not downloaded yet
2026-03-29 20:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0016/20300016/exterior_front_driver-1774783740102.jpg> (referer: None)
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0379%252F19280379%252F19280379-docs_service_history-default-1774692516011.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D629c4c56c5b122fcd293f31bf161d7cf%27 HTTP/1.1" 200 None
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0379/19280379/19280379-docs_service_history-default-1774692516011.jpg?ixlib=js-3.8.0&auto=format&s=629c4c56c5b122fcd293f31bf161d7cf not downloaded yet
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0379%252F19280379%252F19280379-docs_service_history-default-1774692524006.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D55c921812834875f778f839934e3fdc3%27 HTTP/1.1" 200 None
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0379/19280379/19280379-docs_service_history-default-1774692524006.jpg?ixlib=js-3.8.0&auto=format&s=55c921812834875f778f839934e3fdc3 not downloaded yet
2026-03-29 20:12:40 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:40 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:40 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x007\xdf3\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02LZ\x007\xd5!\x00\x00\x00\x00'
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf51450>
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82168178-cc4e-5df8-89e4-4e7ada4b0faa/82168178-cc4e-5df8-89e4-4e7ada4b0faa_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0436%252F8670436%252Finterior_rear_seats-1747674825879.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0436/8670436/interior_rear_seats-1747674825879.jpeg saved to cache
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82168178-cc4e-5df8-89e4-4e7ada4b0faa
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586fb890>
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2730f448-ff3e-5bc9-a571-3a5672b035db/2730f448-ff3e-5bc9-a571-3a5672b035db_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0016%252F20300016%252Fexterior_front_driver-1774783740102.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0016/20300016/exterior_front_driver-1774783740102.jpg saved to cache
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2730f448-ff3e-5bc9-a571-3a5672b035db
2026-03-29 20:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4140/20454140/exterior_rear_passenger-1774704171261.jpg> (referer: None)
2026-03-29 20:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0016/20300016/exterior_front_passenger-1774786353062.jpg> (referer: None)
2026-03-29 20:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4140/20454140/instrument_cluster-1774705191185.jpg> (referer: None)
2026-03-29 20:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4140/20454140/interior_dashboard-1774716193238.jpg> (referer: None)
2026-03-29 20:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0379/19280379/exterior_rear_passenger-1774546583775.jpeg> (referer: None)
2026-03-29 20:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0436/8670436/8670436-interior_dashboard-modified-1747824971619.jpeg> (referer: None)
2026-03-29 20:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1153/20501153/interior_rear_seats-1774780856106.jpg> (referer: None)
2026-03-29 20:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0379/19280379/exterior_front_passenger-1774546549290.jpeg> (referer: None)
2026-03-29 20:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0436/8670436/interior_front_seats-1747674911266.jpeg> (referer: None)
2026-03-29 20:12:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1153/20501153/interior_boot-1774780891038.jpg> (referer: None)
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b546d0>
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20db1439-e706-5d25-a85a-2dd23c709df1/20db1439-e706-5d25-a85a-2dd23c709df1_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4140%252F20454140%252Fexterior_rear_passenger-1774704171261.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4140/20454140/exterior_rear_passenger-1774704171261.jpg saved to cache
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 20db1439-e706-5d25-a85a-2dd23c709df1
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 82168178-cc4e-5df8-89e4-4e7ada4b0faa due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:12:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 7c20b695-14fb-5743-8584-9ffb5ea12cea due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658542250>
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2730f448-ff3e-5bc9-a571-3a5672b035db/2730f448-ff3e-5bc9-a571-3a5672b035db_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0016%252F20300016%252Fexterior_front_passenger-1774786353062.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0016/20300016/exterior_front_passenger-1774786353062.jpg saved to cache
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2730f448-ff3e-5bc9-a571-3a5672b035db
2026-03-29 20:12:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2730f448-ff3e-5bc9-a571-3a5672b035db, skipping ID generation
2026-03-29 20:12:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2730f448-ff3e-5bc9-a571-3a5672b035db with scrape type 1
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2730f448-ff3e-5bc9-a571-3a5672b035db sending to next pipeline
2026-03-29 20:12:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 2730f448-ff3e-5bc9-a571-3a5672b035db, identifier: 20300016
2026-03-29 20:12:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c4f510>
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20db1439-e706-5d25-a85a-2dd23c709df1/20db1439-e706-5d25-a85a-2dd23c709df1_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4140%252F20454140%252Finstrument_cluster-1774705191185.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4140/20454140/instrument_cluster-1774705191185.jpg saved to cache
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 20db1439-e706-5d25-a85a-2dd23c709df1
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658540d50>
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20db1439-e706-5d25-a85a-2dd23c709df1/20db1439-e706-5d25-a85a-2dd23c709df1_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4140%252F20454140%252Finterior_dashboard-1774716193238.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4140/20454140/interior_dashboard-1774716193238.jpg saved to cache
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 20db1439-e706-5d25-a85a-2dd23c709df1
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ca2890>
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec3342ce-3a72-584f-98ea-1e0cbc191684/ec3342ce-3a72-584f-98ea-1e0cbc191684_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0379%252F19280379%252Fexterior_rear_passenger-1774546583775.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0379/19280379/exterior_rear_passenger-1774546583775.jpeg saved to cache
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ec3342ce-3a72-584f-98ea-1e0cbc191684
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfbcd90>
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82168178-cc4e-5df8-89e4-4e7ada4b0faa/82168178-cc4e-5df8-89e4-4e7ada4b0faa_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0436%252F8670436%252F8670436-interior_dashboard-modified-1747824971619.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0436/8670436/8670436-interior_dashboard-modified-1747824971619.jpeg saved to cache
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82168178-cc4e-5df8-89e4-4e7ada4b0faa
2026-03-29 20:12:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f27e10>
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c20b695-14fb-5743-8584-9ffb5ea12cea/7c20b695-14fb-5743-8584-9ffb5ea12cea_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1153%252F20501153%252Finterior_rear_seats-1774780856106.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1153/20501153/interior_rear_seats-1774780856106.jpg saved to cache
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7c20b695-14fb-5743-8584-9ffb5ea12cea
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b556d0>
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec3342ce-3a72-584f-98ea-1e0cbc191684/ec3342ce-3a72-584f-98ea-1e0cbc191684_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0379%252F19280379%252Fexterior_front_passenger-1774546549290.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0379/19280379/exterior_front_passenger-1774546549290.jpeg saved to cache
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ec3342ce-3a72-584f-98ea-1e0cbc191684
2026-03-29 20:12:41 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:41 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:41 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x004]\x13\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xa5\xe6\x004S\x01\x00\x00\x00\x00'
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65857b490>
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82168178-cc4e-5df8-89e4-4e7ada4b0faa/82168178-cc4e-5df8-89e4-4e7ada4b0faa_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0436%252F8670436%252Finterior_front_seats-1747674911266.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0436/8670436/interior_front_seats-1747674911266.jpeg saved to cache
2026-03-29 20:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82168178-cc4e-5df8-89e4-4e7ada4b0faa
2026-03-29 20:12:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfbd510>
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c20b695-14fb-5743-8584-9ffb5ea12cea/7c20b695-14fb-5743-8584-9ffb5ea12cea_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1153%252F20501153%252Finterior_boot-1774780891038.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1153/20501153/interior_boot-1774780891038.jpg saved to cache
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7c20b695-14fb-5743-8584-9ffb5ea12cea
2026-03-29 20:12:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 2730f448-ff3e-5bc9-a571-3a5672b035db with identifier: 20300016
2026-03-29 20:12:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 2730f448-ff3e-5bc9-a571-3a5672b035db with identifier: 20300016
2026-03-29 20:12:42 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 2730f448-ff3e-5bc9-a571-3a5672b035db with identifier: 20300016 to the API
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/0016/20300016/exterior_front_passenger-1774786353062.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '2730f448-ff3e-5bc9-a571-3a5672b035db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EA22 ATK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20300016',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Peugeot',
'model': '2008',
'odometer': 30582,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2730f448-ff3e-5bc9-a571-3a5672b035db/2730f448-ff3e-5bc9-a571-3a5672b035db_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1096203,
'Height': 2824,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0016/20300016/exterior_front_driver-1774783740102.jpg',
'Width': 3765},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2730f448-ff3e-5bc9-a571-3a5672b035db/2730f448-ff3e-5bc9-a571-3a5672b035db_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 932475,
'Height': 2709,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0016/20300016/exterior_rear_driver-1774783737177.jpg',
'Width': 3612},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2730f448-ff3e-5bc9-a571-3a5672b035db/2730f448-ff3e-5bc9-a571-3a5672b035db_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1564007,
'Height': 2751,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0016/20300016/exterior_front_passenger-1774786353062.jpg',
'Width': 3668},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2730f448-ff3e-5bc9-a571-3a5672b035db/2730f448-ff3e-5bc9-a571-3a5672b035db_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 705257,
'Height': 2549,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0016/20300016/exterior_rear_passenger-1774783738005.jpg',
'Width': 3398},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2730f448-ff3e-5bc9-a571-3a5672b035db/2730f448-ff3e-5bc9-a571-3a5672b035db_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1379822,
'Height': 2891,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0016/20300016/interior_front_seats-1774786364149.jpg',
'Width': 3855},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2730f448-ff3e-5bc9-a571-3a5672b035db/2730f448-ff3e-5bc9-a571-3a5672b035db_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1315981,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/0016/20300016/interior_rear_seats-1774785108424.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2730f448-ff3e-5bc9-a571-3a5672b035db/2730f448-ff3e-5bc9-a571-3a5672b035db_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 990444,
'Height': 2891,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0016/20300016/interior_dashboard-1774786378701.jpg',
'Width': 3855},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2730f448-ff3e-5bc9-a571-3a5672b035db/2730f448-ff3e-5bc9-a571-3a5672b035db_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 515097,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/0016/20300016/instrument_cluster-1774785186330.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2730f448-ff3e-5bc9-a571-3a5672b035db/2730f448-ff3e-5bc9-a571-3a5672b035db_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1087236,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/0016/20300016/interior_boot-1774785107067.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2730f448-ff3e-5bc9-a571-3a5672b035db/2730f448-ff3e-5bc9-a571-3a5672b035db_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1209139,
'Height': 3509,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/0016/20300016/docs_service_history-1774786333734.jpg?ixlib=js-3.8.0&auto=format&s=e2e02b1ba74785d4091c409d872a0694',
'Width': 2632}],
'price': 11344,
'price_includes_vat': False,
'registration_date': '2022-04-27',
'seats_number': None,
'seller_name': None,
'title': 'Peugeot 2008 GT PureTech S/S Auto',
'transmission': 'automatic',
'trim': 'GT PureTech S/S Auto',
'vin': 'VR3USHNSSNJ594807',
'year': 2022}
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720300016%27 HTTP/1.1" 200 None
2026-03-29 20:12:42 [motorway.uk] INFO: Saving data for 20300016: {'created_time': 1774815162.688595, 'last_price_update_time': 1774815162.688607, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20300016') HTTP/1.1" 204 0
2026-03-29 20:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0379/19280379/interior_rear_seats-1774546718543.jpeg> (referer: None)
2026-03-29 20:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0379/19280379/19280379-docs_service_history-default-1774692524006.jpg?ixlib=js-3.8.0&auto=format&s=55c921812834875f778f839934e3fdc3> (referer: None)
2026-03-29 20:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0436/8670436/8670436-instrument_cluster-modified-1747825134485.jpeg> (referer: None)
2026-03-29 20:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0379/19280379/19280379-docs_service_history-default-1774692516011.jpg?ixlib=js-3.8.0&auto=format&s=629c4c56c5b122fcd293f31bf161d7cf> (referer: None)
2026-03-29 20:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0379/19280379/interior_dashboard-1774546755000.jpeg> (referer: None)
2026-03-29 20:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0379/19280379/19280379-interior_boot-modified-1774614120528.jpeg> (referer: None)
2026-03-29 20:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0379/19280379/interior_front_seats-1774546657725.jpeg> (referer: None)
2026-03-29 20:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0379/19280379/exterior_front_driver-1774521674136.jpeg> (referer: None)
2026-03-29 20:12:42 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:42 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:42 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00*\xafp\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xd9X\x00*\xa5x\x00\x00\x00\x00'
2026-03-29 20:12:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf60ad0>
2026-03-29 20:12:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec3342ce-3a72-584f-98ea-1e0cbc191684/ec3342ce-3a72-584f-98ea-1e0cbc191684_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0379%252F19280379%252Finterior_rear_seats-1774546718543.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0379/19280379/interior_rear_seats-1774546718543.jpeg saved to cache
2026-03-29 20:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ec3342ce-3a72-584f-98ea-1e0cbc191684
2026-03-29 20:12:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:12:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:43 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf63310>
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec3342ce-3a72-584f-98ea-1e0cbc191684/ec3342ce-3a72-584f-98ea-1e0cbc191684_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0379%252F19280379%252F19280379-docs_service_history-default-1774692524006.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D55c921812834875f778f839934e3fdc3') HTTP/1.1" 204 0
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0379/19280379/19280379-docs_service_history-default-1774692524006.jpg?ixlib=js-3.8.0&auto=format&s=55c921812834875f778f839934e3fdc3 saved to cache
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ec3342ce-3a72-584f-98ea-1e0cbc191684
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e71f10>
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82168178-cc4e-5df8-89e4-4e7ada4b0faa/82168178-cc4e-5df8-89e4-4e7ada4b0faa_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0436%252F8670436%252F8670436-instrument_cluster-modified-1747825134485.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0436/8670436/8670436-instrument_cluster-modified-1747825134485.jpeg saved to cache
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82168178-cc4e-5df8-89e4-4e7ada4b0faa
2026-03-29 20:12:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:12:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:43 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfbf250>
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec3342ce-3a72-584f-98ea-1e0cbc191684/ec3342ce-3a72-584f-98ea-1e0cbc191684_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0379%252F19280379%252F19280379-docs_service_history-default-1774692516011.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D629c4c56c5b122fcd293f31bf161d7cf') HTTP/1.1" 204 0
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0379/19280379/19280379-docs_service_history-default-1774692516011.jpg?ixlib=js-3.8.0&auto=format&s=629c4c56c5b122fcd293f31bf161d7cf saved to cache
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ec3342ce-3a72-584f-98ea-1e0cbc191684
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582da110>
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec3342ce-3a72-584f-98ea-1e0cbc191684/ec3342ce-3a72-584f-98ea-1e0cbc191684_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0379%252F19280379%252Finterior_dashboard-1774546755000.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0379/19280379/interior_dashboard-1774546755000.jpeg saved to cache
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ec3342ce-3a72-584f-98ea-1e0cbc191684
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fef790>
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec3342ce-3a72-584f-98ea-1e0cbc191684/ec3342ce-3a72-584f-98ea-1e0cbc191684_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0379%252F19280379%252F19280379-interior_boot-modified-1774614120528.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0379/19280379/19280379-interior_boot-modified-1774614120528.jpeg saved to cache
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ec3342ce-3a72-584f-98ea-1e0cbc191684
2026-03-29 20:12:43 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:43 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:43 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00*f&\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x8e\xd9\x00*\\.\x00\x00\x00\x00'
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582d4850>
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec3342ce-3a72-584f-98ea-1e0cbc191684/ec3342ce-3a72-584f-98ea-1e0cbc191684_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0379%252F19280379%252Finterior_front_seats-1774546657725.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0379/19280379/interior_front_seats-1774546657725.jpeg saved to cache
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ec3342ce-3a72-584f-98ea-1e0cbc191684
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bee5c90>
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec3342ce-3a72-584f-98ea-1e0cbc191684/ec3342ce-3a72-584f-98ea-1e0cbc191684_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0379%252F19280379%252Fexterior_front_driver-1774521674136.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0379/19280379/exterior_front_driver-1774521674136.jpeg saved to cache
2026-03-29 20:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec3342ce-3a72-584f-98ea-1e0cbc191684
2026-03-29 20:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=432&page=12&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0379/19280379/exterior_rear_driver-1774546621589.jpeg> (referer: None)
2026-03-29 20:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1153/20501153/exterior_rear_passenger-1774780594232.jpg> (referer: None)
2026-03-29 20:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4140/20454140/exterior_front_driver-1774704131114.jpg> (referer: None)
2026-03-29 20:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0436/8670436/exterior_rear_driver-1747674689543.jpeg> (referer: None)
2026-03-29 20:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4140/20454140/exterior_rear_driver-1774704156592.jpg> (referer: None)
2026-03-29 20:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4140/20454140/exterior_front_passenger-1774704192737.jpg> (referer: None)
2026-03-29 20:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0436/8670436/exterior_front_driver-1747674745528.jpeg> (referer: None)
2026-03-29 20:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1153/20501153/interior_front_seats-1774780846707.jpg> (referer: None)
2026-03-29 20:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0436/8670436/exterior_front_passenger-1747674663147.jpeg> (referer: None)
2026-03-29 20:12:43 [motorway.uk] INFO: Found listing with ID: 20168160
2026-03-29 20:12:43 [motorway.uk] INFO: Found listing with ID: 19750033
2026-03-29 20:12:43 [motorway.uk] INFO: Found listing with ID: 19427127
2026-03-29 20:12:43 [motorway.uk] INFO: Found listing with ID: 18209819
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718209819%27 HTTP/1.1" 200 None
2026-03-29 20:12:43 [motorway.uk] INFO: Scrape type for 18209819: 1
2026-03-29 20:12:43 [motorway.uk] INFO: Found listing with ID: 18301360
2026-03-29 20:12:43 [motorway.uk] INFO: Found listing with ID: 20315758
2026-03-29 20:12:43 [motorway.uk] INFO: Found listing with ID: 20303235
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720303235%27 HTTP/1.1" 200 None
2026-03-29 20:12:43 [motorway.uk] INFO: Scrape type for 20303235: 1
2026-03-29 20:12:43 [motorway.uk] INFO: Found listing with ID: 20491229
2026-03-29 20:12:43 [motorway.uk] INFO: Found listing with ID: 13358851
2026-03-29 20:12:43 [motorway.uk] INFO: Found listing with ID: 20494032
2026-03-29 20:12:43 [motorway.uk] INFO: Found listing with ID: 18839642
2026-03-29 20:12:43 [motorway.uk] INFO: Found listing with ID: 20490324
2026-03-29 20:12:43 [motorway.uk] INFO: Found listing with ID: 19350653
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719350653%27 HTTP/1.1" 200 None
2026-03-29 20:12:43 [motorway.uk] INFO: Scrape type for 19350653: 1
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582da110>
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec3342ce-3a72-584f-98ea-1e0cbc191684/ec3342ce-3a72-584f-98ea-1e0cbc191684_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0379%252F19280379%252Fexterior_rear_driver-1774546621589.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0379/19280379/exterior_rear_driver-1774546621589.jpeg saved to cache
2026-03-29 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ec3342ce-3a72-584f-98ea-1e0cbc191684
2026-03-29 20:12:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec3342ce-3a72-584f-98ea-1e0cbc191684, skipping ID generation
2026-03-29 20:12:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec3342ce-3a72-584f-98ea-1e0cbc191684 with scrape type 1
2026-03-29 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec3342ce-3a72-584f-98ea-1e0cbc191684 sending to next pipeline
2026-03-29 20:12:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ec3342ce-3a72-584f-98ea-1e0cbc191684, identifier: 19280379
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b18d50>
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c20b695-14fb-5743-8584-9ffb5ea12cea/7c20b695-14fb-5743-8584-9ffb5ea12cea_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1153%252F20501153%252Fexterior_rear_passenger-1774780594232.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1153/20501153/exterior_rear_passenger-1774780594232.jpg saved to cache
2026-03-29 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7c20b695-14fb-5743-8584-9ffb5ea12cea
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfbe410>
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20db1439-e706-5d25-a85a-2dd23c709df1/20db1439-e706-5d25-a85a-2dd23c709df1_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4140%252F20454140%252Fexterior_front_driver-1774704131114.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4140/20454140/exterior_front_driver-1774704131114.jpg saved to cache
2026-03-29 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 20db1439-e706-5d25-a85a-2dd23c709df1
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582d5550>
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82168178-cc4e-5df8-89e4-4e7ada4b0faa/82168178-cc4e-5df8-89e4-4e7ada4b0faa_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0436%252F8670436%252Fexterior_rear_driver-1747674689543.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0436/8670436/exterior_rear_driver-1747674689543.jpeg saved to cache
2026-03-29 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82168178-cc4e-5df8-89e4-4e7ada4b0faa
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f8ecd0>
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20db1439-e706-5d25-a85a-2dd23c709df1/20db1439-e706-5d25-a85a-2dd23c709df1_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4140%252F20454140%252Fexterior_rear_driver-1774704156592.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4140/20454140/exterior_rear_driver-1774704156592.jpg saved to cache
2026-03-29 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 20db1439-e706-5d25-a85a-2dd23c709df1
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658446a50>
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20db1439-e706-5d25-a85a-2dd23c709df1/20db1439-e706-5d25-a85a-2dd23c709df1_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4140%252F20454140%252Fexterior_front_passenger-1774704192737.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4140/20454140/exterior_front_passenger-1774704192737.jpg saved to cache
2026-03-29 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 20db1439-e706-5d25-a85a-2dd23c709df1
2026-03-29 20:12:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 20db1439-e706-5d25-a85a-2dd23c709df1, skipping ID generation
2026-03-29 20:12:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20db1439-e706-5d25-a85a-2dd23c709df1 with scrape type 1
2026-03-29 20:12:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 20db1439-e706-5d25-a85a-2dd23c709df1 sending to next pipeline
2026-03-29 20:12:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 20db1439-e706-5d25-a85a-2dd23c709df1, identifier: 20454140
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 13711845
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 14441433
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 20499741
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 10678898
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 19016165
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 20458519
2026-03-29 20:12:44 [motorway.uk] INFO: Found listing with ID: 20500024
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720500024%27 HTTP/1.1" 200 None
2026-03-29 20:12:44 [motorway.uk] INFO: Scrape type for 20500024: 1
2026-03-29 20:12:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ec3342ce-3a72-584f-98ea-1e0cbc191684 with identifier: 19280379
2026-03-29 20:12:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ec3342ce-3a72-584f-98ea-1e0cbc191684 with identifier: 19280379
2026-03-29 20:12:44 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ec3342ce-3a72-584f-98ea-1e0cbc191684 with identifier: 19280379 to the API
2026-03-29 20:12:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0379/19280379/exterior_rear_driver-1774546621589.jpeg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.8L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'ec3342ce-3a72-584f-98ea-1e0cbc191684',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LM21 ZYO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19280379',
'listing': 'auction',
'location': 'Greater London Harrow',
'make': 'Toyota',
'model': 'C-HR',
'odometer': 62432,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec3342ce-3a72-584f-98ea-1e0cbc191684/ec3342ce-3a72-584f-98ea-1e0cbc191684_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1549710,
'Height': 2586,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0379/19280379/exterior_front_driver-1774521674136.jpeg',
'Width': 3448},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec3342ce-3a72-584f-98ea-1e0cbc191684/ec3342ce-3a72-584f-98ea-1e0cbc191684_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1066473,
'Height': 2064,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0379/19280379/exterior_rear_driver-1774546621589.jpeg',
'Width': 2752},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec3342ce-3a72-584f-98ea-1e0cbc191684/ec3342ce-3a72-584f-98ea-1e0cbc191684_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1326332,
'Height': 2364,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0379/19280379/exterior_front_passenger-1774546549290.jpeg',
'Width': 3152},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec3342ce-3a72-584f-98ea-1e0cbc191684/ec3342ce-3a72-584f-98ea-1e0cbc191684_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1646145,
'Height': 2639,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0379/19280379/exterior_rear_passenger-1774546583775.jpeg',
'Width': 3518},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec3342ce-3a72-584f-98ea-1e0cbc191684/ec3342ce-3a72-584f-98ea-1e0cbc191684_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2946303,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0379/19280379/interior_front_seats-1774546657725.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec3342ce-3a72-584f-98ea-1e0cbc191684/ec3342ce-3a72-584f-98ea-1e0cbc191684_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2918600,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0379/19280379/interior_rear_seats-1774546718543.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec3342ce-3a72-584f-98ea-1e0cbc191684/ec3342ce-3a72-584f-98ea-1e0cbc191684_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1695783,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0379/19280379/interior_dashboard-1774546755000.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec3342ce-3a72-584f-98ea-1e0cbc191684/ec3342ce-3a72-584f-98ea-1e0cbc191684_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2442121,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0379/19280379/19280379-interior_boot-modified-1774614120528.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec3342ce-3a72-584f-98ea-1e0cbc191684/ec3342ce-3a72-584f-98ea-1e0cbc191684_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1604604,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0379/19280379/19280379-docs_service_history-default-1774692516011.jpg?ixlib=js-3.8.0&auto=format&s=629c4c56c5b122fcd293f31bf161d7cf',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec3342ce-3a72-584f-98ea-1e0cbc191684/ec3342ce-3a72-584f-98ea-1e0cbc191684_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1630118,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0379/19280379/19280379-docs_service_history-default-1774692524006.jpg?ixlib=js-3.8.0&auto=format&s=55c921812834875f778f839934e3fdc3',
'Width': 4032}],
'price': 12012,
'price_includes_vat': False,
'registration_date': '2021-05-24',
'seats_number': None,
'seller_name': None,
'title': 'Toyota C-HR Design HEV CVT',
'transmission': 'automatic',
'trim': 'Design HEV CVT',
'vin': 'NMTK33BX30R101122',
'year': 2021}
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719280379%27 HTTP/1.1" 200 None
2026-03-29 20:12:45 [motorway.uk] INFO: Saving data for 19280379: {'created_time': 1774815165.283332, 'last_price_update_time': 1774815165.283343, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19280379') HTTP/1.1" 204 0
2026-03-29 20:12:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 20db1439-e706-5d25-a85a-2dd23c709df1 with identifier: 20454140
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Orange HTTP/1.1" 200 None
2026-03-29 20:12:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:12:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 20db1439-e706-5d25-a85a-2dd23c709df1 with identifier: 20454140
2026-03-29 20:12:45 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 20db1439-e706-5d25-a85a-2dd23c709df1 with identifier: 20454140 to the API
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4140/20454140/exterior_front_passenger-1774704192737.jpg>
{'auction_title': '',
'category': None,
'color': 'Orange',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '20db1439-e706-5d25-a85a-2dd23c709df1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'VK74 CGU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20454140',
'listing': 'auction',
'location': 'Kent Dover',
'make': 'Hyundai',
'model': 'Kona',
'odometer': 9000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20db1439-e706-5d25-a85a-2dd23c709df1/20db1439-e706-5d25-a85a-2dd23c709df1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1570847,
'Height': 2622,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4140/20454140/exterior_front_driver-1774704131114.jpg',
'Width': 3496},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20db1439-e706-5d25-a85a-2dd23c709df1/20db1439-e706-5d25-a85a-2dd23c709df1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1625442,
'Height': 2550,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4140/20454140/exterior_rear_driver-1774704156592.jpg',
'Width': 3400},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20db1439-e706-5d25-a85a-2dd23c709df1/20db1439-e706-5d25-a85a-2dd23c709df1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1817692,
'Height': 2651,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4140/20454140/exterior_front_passenger-1774704192737.jpg',
'Width': 3534},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20db1439-e706-5d25-a85a-2dd23c709df1/20db1439-e706-5d25-a85a-2dd23c709df1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1404906,
'Height': 2405,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4140/20454140/exterior_rear_passenger-1774704171261.jpg',
'Width': 3206},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20db1439-e706-5d25-a85a-2dd23c709df1/20db1439-e706-5d25-a85a-2dd23c709df1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3287247,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4140/20454140/interior_front_seats-1774705067809.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20db1439-e706-5d25-a85a-2dd23c709df1/20db1439-e706-5d25-a85a-2dd23c709df1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4137088,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4140/20454140/interior_rear_seats-1774705094274.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20db1439-e706-5d25-a85a-2dd23c709df1/20db1439-e706-5d25-a85a-2dd23c709df1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2409712,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4140/20454140/interior_dashboard-1774716193238.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20db1439-e706-5d25-a85a-2dd23c709df1/20db1439-e706-5d25-a85a-2dd23c709df1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2442126,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4140/20454140/instrument_cluster-1774705191185.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20db1439-e706-5d25-a85a-2dd23c709df1/20db1439-e706-5d25-a85a-2dd23c709df1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3718710,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4140/20454140/interior_boot-1774705096105.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20db1439-e706-5d25-a85a-2dd23c709df1/20db1439-e706-5d25-a85a-2dd23c709df1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281508,
'Height': 1578,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4140/20454140/docs_service_history-1774705343722.jpg?ixlib=js-3.8.0&auto=format&s=35b20e8ae8d7c9ebb9b99c98e0d7a15b',
'Width': 2052}],
'price': 22085,
'price_includes_vat': False,
'registration_date': '2024-09-30',
'seats_number': None,
'seller_name': None,
'title': 'Hyundai Kona Ultimate T-GDi HEV S-A',
'transmission': 'automatic',
'trim': 'Ultimate T-GDi HEV S-A',
'vin': 'KMHHE8115SU079005',
'year': 2024}
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720454140%27 HTTP/1.1" 200 None
2026-03-29 20:12:45 [motorway.uk] INFO: Saving data for 20454140: {'created_time': 1774815165.937804, 'last_price_update_time': 1774815165.937817, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20454140') HTTP/1.1" 204 0
2026-03-29 20:12:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659be9050>
2026-03-29 20:12:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82168178-cc4e-5df8-89e4-4e7ada4b0faa/82168178-cc4e-5df8-89e4-4e7ada4b0faa_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0436%252F8670436%252Fexterior_front_driver-1747674745528.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0436/8670436/exterior_front_driver-1747674745528.jpeg saved to cache
2026-03-29 20:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82168178-cc4e-5df8-89e4-4e7ada4b0faa
2026-03-29 20:12:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599de550>
2026-03-29 20:12:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c20b695-14fb-5743-8584-9ffb5ea12cea/7c20b695-14fb-5743-8584-9ffb5ea12cea_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1153%252F20501153%252Finterior_front_seats-1774780846707.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1153/20501153/interior_front_seats-1774780846707.jpg saved to cache
2026-03-29 20:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7c20b695-14fb-5743-8584-9ffb5ea12cea
2026-03-29 20:12:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c20b695-14fb-5743-8584-9ffb5ea12cea, skipping ID generation
2026-03-29 20:12:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c20b695-14fb-5743-8584-9ffb5ea12cea with scrape type 1
2026-03-29 20:12:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c20b695-14fb-5743-8584-9ffb5ea12cea sending to next pipeline
2026-03-29 20:12:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 7c20b695-14fb-5743-8584-9ffb5ea12cea, identifier: 20501153
2026-03-29 20:12:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659aff0d0>
2026-03-29 20:12:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82168178-cc4e-5df8-89e4-4e7ada4b0faa/82168178-cc4e-5df8-89e4-4e7ada4b0faa_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0436%252F8670436%252Fexterior_front_passenger-1747674663147.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0436/8670436/exterior_front_passenger-1747674663147.jpeg saved to cache
2026-03-29 20:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82168178-cc4e-5df8-89e4-4e7ada4b0faa
2026-03-29 20:12:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82168178-cc4e-5df8-89e4-4e7ada4b0faa, skipping ID generation
2026-03-29 20:12:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82168178-cc4e-5df8-89e4-4e7ada4b0faa with scrape type 1
2026-03-29 20:12:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82168178-cc4e-5df8-89e4-4e7ada4b0faa sending to next pipeline
2026-03-29 20:12:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 82168178-cc4e-5df8-89e4-4e7ada4b0faa, identifier: 8670436
2026-03-29 20:12:46 [motorway.uk] INFO: Found listing with ID: 20461118
2026-03-29 20:12:46 [motorway.uk] INFO: Found listing with ID: 11411855
2026-03-29 20:12:46 [motorway.uk] INFO: Found listing with ID: 20459543
2026-03-29 20:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720459543%27 HTTP/1.1" 200 None
2026-03-29 20:12:46 [motorway.uk] INFO: Scrape type for 20459543: 1
2026-03-29 20:12:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7c20b695-14fb-5743-8584-9ffb5ea12cea with identifier: 20501153
2026-03-29 20:12:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7c20b695-14fb-5743-8584-9ffb5ea12cea with identifier: 20501153
2026-03-29 20:12:46 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7c20b695-14fb-5743-8584-9ffb5ea12cea with identifier: 20501153 to the API
2026-03-29 20:12:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/1153/20501153/interior_front_seats-1774780846707.jpg>
{'auction_title': '',
'category': None,
'color': 'Green',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '7c20b695-14fb-5743-8584-9ffb5ea12cea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'T50 PDJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20501153',
'listing': 'auction',
'location': 'Wiltshire Salisbury',
'make': 'Kia',
'model': 'Sportage',
'odometer': 30753,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c20b695-14fb-5743-8584-9ffb5ea12cea/7c20b695-14fb-5743-8584-9ffb5ea12cea_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1152901,
'Height': 2235,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1153/20501153/exterior_front_driver-1774780573714.jpg',
'Width': 2980},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c20b695-14fb-5743-8584-9ffb5ea12cea/7c20b695-14fb-5743-8584-9ffb5ea12cea_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 995380,
'Height': 2184,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1153/20501153/exterior_rear_driver-1774780589557.jpg',
'Width': 2912},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c20b695-14fb-5743-8584-9ffb5ea12cea/7c20b695-14fb-5743-8584-9ffb5ea12cea_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1486575,
'Height': 2564,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1153/20501153/exterior_front_passenger-1774780602683.jpg',
'Width': 3419},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c20b695-14fb-5743-8584-9ffb5ea12cea/7c20b695-14fb-5743-8584-9ffb5ea12cea_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1177588,
'Height': 2419,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1153/20501153/exterior_rear_passenger-1774780594232.jpg',
'Width': 3225},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c20b695-14fb-5743-8584-9ffb5ea12cea/7c20b695-14fb-5743-8584-9ffb5ea12cea_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3036948,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1153/20501153/interior_front_seats-1774780846707.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c20b695-14fb-5743-8584-9ffb5ea12cea/7c20b695-14fb-5743-8584-9ffb5ea12cea_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3275323,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1153/20501153/interior_rear_seats-1774780856106.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c20b695-14fb-5743-8584-9ffb5ea12cea/7c20b695-14fb-5743-8584-9ffb5ea12cea_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2589841,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1153/20501153/instrument_cluster-1774780945025.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c20b695-14fb-5743-8584-9ffb5ea12cea/7c20b695-14fb-5743-8584-9ffb5ea12cea_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3896863,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1153/20501153/interior_boot-1774780891038.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c20b695-14fb-5743-8584-9ffb5ea12cea/7c20b695-14fb-5743-8584-9ffb5ea12cea_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 570377,
'Height': 1888,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1153/20501153/docs_service_history-1774781008169.jpg?ixlib=js-3.8.0&auto=format&s=24e35b1ee26c6a87194657235c60f8d8',
'Width': 3485}],
'price': 24514,
'price_includes_vat': False,
'registration_date': '2023-10-31',
'seats_number': None,
'seller_name': None,
'title': 'Kia Sportage GT-LINE S ISG HEV A',
'transmission': 'automatic',
'trim': 'GT-LINE S ISG HEV A',
'vin': 'U5YPX81GMRL121733',
'year': 2023}
2026-03-29 20:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720501153%27 HTTP/1.1" 200 None
2026-03-29 20:12:47 [motorway.uk] INFO: Saving data for 20501153: {'created_time': 1774815167.797917, 'last_price_update_time': 1774815167.797928, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20501153') HTTP/1.1" 204 0
2026-03-29 20:12:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 82168178-cc4e-5df8-89e4-4e7ada4b0faa with identifier: 8670436
2026-03-29 20:12:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 82168178-cc4e-5df8-89e4-4e7ada4b0faa with identifier: 8670436
2026-03-29 20:12:47 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 82168178-cc4e-5df8-89e4-4e7ada4b0faa with identifier: 8670436 to the API
2026-03-29 20:12:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0436/8670436/exterior_front_passenger-1747674663147.jpeg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '82168178-cc4e-5df8-89e4-4e7ada4b0faa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AE68 GHU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/8670436',
'listing': 'auction',
'location': 'Buckinghamshire Chesham',
'make': 'Volvo',
'model': 'XC60',
'odometer': 96900,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82168178-cc4e-5df8-89e4-4e7ada4b0faa/82168178-cc4e-5df8-89e4-4e7ada4b0faa_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1655112,
'Height': 2476,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0436/8670436/exterior_front_driver-1747674745528.jpeg',
'Width': 3301},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82168178-cc4e-5df8-89e4-4e7ada4b0faa/82168178-cc4e-5df8-89e4-4e7ada4b0faa_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1435386,
'Height': 2316,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0436/8670436/exterior_rear_driver-1747674689543.jpeg',
'Width': 3088},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82168178-cc4e-5df8-89e4-4e7ada4b0faa/82168178-cc4e-5df8-89e4-4e7ada4b0faa_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1667278,
'Height': 2468,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0436/8670436/exterior_front_passenger-1747674663147.jpeg',
'Width': 3290},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82168178-cc4e-5df8-89e4-4e7ada4b0faa/82168178-cc4e-5df8-89e4-4e7ada4b0faa_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3605241,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0436/8670436/interior_front_seats-1747674911266.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82168178-cc4e-5df8-89e4-4e7ada4b0faa/82168178-cc4e-5df8-89e4-4e7ada4b0faa_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3812237,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0436/8670436/interior_rear_seats-1747674825879.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82168178-cc4e-5df8-89e4-4e7ada4b0faa/82168178-cc4e-5df8-89e4-4e7ada4b0faa_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3106051,
'Height': 2956,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0436/8670436/8670436-interior_dashboard-modified-1747824971619.jpeg',
'Width': 3941},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82168178-cc4e-5df8-89e4-4e7ada4b0faa/82168178-cc4e-5df8-89e4-4e7ada4b0faa_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2567840,
'Height': 2946,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0436/8670436/8670436-instrument_cluster-modified-1747825134485.jpeg',
'Width': 3929},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82168178-cc4e-5df8-89e4-4e7ada4b0faa/82168178-cc4e-5df8-89e4-4e7ada4b0faa_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3895467,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0436/8670436/interior_boot-1747674862438.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82168178-cc4e-5df8-89e4-4e7ada4b0faa/82168178-cc4e-5df8-89e4-4e7ada4b0faa_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 525364,
'Height': 1674,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/0436/8670436/8670436-docs_service_history-modified-1747824327655.jpeg?ixlib=js-3.8.0&auto=format&s=97efb21b82b5b44d2ade4087aca7e0fe',
'Width': 2232}],
'price': 11554,
'price_includes_vat': False,
'registration_date': '2018-09-15',
'seats_number': None,
'seller_name': None,
'title': 'Volvo XC60 Momentum D4 AWD',
'transmission': 'manual',
'trim': 'Momentum D4 AWD',
'vin': 'YV1UZA8V4K1245840',
'year': 2018}
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278670436%27 HTTP/1.1" 200 None
2026-03-29 20:12:48 [motorway.uk] INFO: Saving data for 8670436: {'created_time': 1774815168.252184, 'last_price_update_time': 1774815168.252196, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='8670436') HTTP/1.1" 204 0
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 18543563
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 20269831
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 20341046
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 20265542
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 10211430
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 20484735
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 20488534
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 1773065
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 14164507
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714164507%27 HTTP/1.1" 200 None
2026-03-29 20:12:48 [motorway.uk] INFO: Scrape type for 14164507: 1
2026-03-29 20:12:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 19886114
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 20414483
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 19235402
2026-03-29 20:12:48 [motorway.uk] INFO: Found listing with ID: 20488258
2026-03-29 20:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/3712/19163712/docs_service_history-1771692239254.jpeg?ixlib=js-3.8.0&auto=format&s=b546688fb4388b098a0e6869cbd57cb1> (referer: None)
2026-03-29 20:12:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3826/20483826/damage_dents-1774688759551.jpg> (referer: None)
2026-03-29 20:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3712/19163712/interior_dashboard-1771260699600.jpeg> (referer: None)
2026-03-29 20:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3712/19163712/exterior_rear_passenger-1771260676470.jpeg> (referer: None)
2026-03-29 20:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3712/19163712/instrument_cluster-1771260670300.jpeg> (referer: None)
2026-03-29 20:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3712/19163712/interior_boot-1771260685785.jpeg> (referer: None)
2026-03-29 20:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5274/20395274/docs_service_history-1774703558765.jpg?ixlib=js-3.8.0&auto=format&s=022096cc57ed0585a6be7a1e6b41f6f0> (referer: None)
2026-03-29 20:12:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:12:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfcba10>
2026-03-29 20:12:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9cd61ed-b382-563e-9bf8-47c0c2b42e62/f9cd61ed-b382-563e-9bf8-47c0c2b42e62_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F3712%252F19163712%252Fdocs_service_history-1771692239254.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db546688fb4388b098a0e6869cbd57cb1') HTTP/1.1" 204 0
2026-03-29 20:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/3712/19163712/docs_service_history-1771692239254.jpeg?ixlib=js-3.8.0&auto=format&s=b546688fb4388b098a0e6869cbd57cb1 saved to cache
2026-03-29 20:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f9cd61ed-b382-563e-9bf8-47c0c2b42e62
2026-03-29 20:12:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65842e850>
2026-03-29 20:12:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_037941b9-b90d-505f-8816-7a50f76d1edf/037941b9-b90d-505f-8816-7a50f76d1edf_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3826%252F20483826%252Fdamage_dents-1774688759551.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3826/20483826/damage_dents-1774688759551.jpg saved to cache
2026-03-29 20:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 037941b9-b90d-505f-8816-7a50f76d1edf
2026-03-29 20:12:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586cdb50>
2026-03-29 20:12:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9cd61ed-b382-563e-9bf8-47c0c2b42e62/f9cd61ed-b382-563e-9bf8-47c0c2b42e62_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3712%252F19163712%252Finterior_dashboard-1771260699600.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3712/19163712/interior_dashboard-1771260699600.jpeg saved to cache
2026-03-29 20:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f9cd61ed-b382-563e-9bf8-47c0c2b42e62
2026-03-29 20:12:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b18610>
2026-03-29 20:12:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9cd61ed-b382-563e-9bf8-47c0c2b42e62/f9cd61ed-b382-563e-9bf8-47c0c2b42e62_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3712%252F19163712%252Fexterior_rear_passenger-1771260676470.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3712/19163712/exterior_rear_passenger-1771260676470.jpeg saved to cache
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f9cd61ed-b382-563e-9bf8-47c0c2b42e62
2026-03-29 20:12:49 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:49 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:49 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00$\x92a\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xbb9\x00$\x88O\x00\x00\x00\x00'
2026-03-29 20:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bccbd0>
2026-03-29 20:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9cd61ed-b382-563e-9bf8-47c0c2b42e62/f9cd61ed-b382-563e-9bf8-47c0c2b42e62_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3712%252F19163712%252Finstrument_cluster-1771260670300.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3712/19163712/instrument_cluster-1771260670300.jpeg saved to cache
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f9cd61ed-b382-563e-9bf8-47c0c2b42e62
2026-03-29 20:12:49 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:49 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:49 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00<\xd1K\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xb4\xc5\x00<\xc79\x00\x00\x00\x00'
2026-03-29 20:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a79990>
2026-03-29 20:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9cd61ed-b382-563e-9bf8-47c0c2b42e62/f9cd61ed-b382-563e-9bf8-47c0c2b42e62_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3712%252F19163712%252Finterior_boot-1771260685785.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3712/19163712/interior_boot-1771260685785.jpeg saved to cache
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f9cd61ed-b382-563e-9bf8-47c0c2b42e62
2026-03-29 20:12:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586cce50>
2026-03-29 20:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb80d0c4-ede0-56f1-9074-5ee67e1fb450/eb80d0c4-ede0-56f1-9074-5ee67e1fb450_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5274%252F20395274%252Fdocs_service_history-1774703558765.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D022096cc57ed0585a6be7a1e6b41f6f0') HTTP/1.1" 204 0
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5274/20395274/docs_service_history-1774703558765.jpg?ixlib=js-3.8.0&auto=format&s=022096cc57ed0585a6be7a1e6b41f6f0 saved to cache
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eb80d0c4-ede0-56f1-9074-5ee67e1fb450
2026-03-29 20:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3826/20483826/damage_scratches-1774688834005.jpg> (referer: None)
2026-03-29 20:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b34dd0>
2026-03-29 20:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_037941b9-b90d-505f-8816-7a50f76d1edf/037941b9-b90d-505f-8816-7a50f76d1edf_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3826%252F20483826%252Fdamage_scratches-1774688834005.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3826/20483826/damage_scratches-1774688834005.jpg saved to cache
2026-03-29 20:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 037941b9-b90d-505f-8816-7a50f76d1edf
2026-03-29 20:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5274/20395274/interior_boot-1774688683857.jpg> (referer: None)
2026-03-29 20:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3712/19163712/exterior_rear_driver-1771260682586.jpeg> (referer: None)
2026-03-29 20:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/7743070.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659cdab50>
2026-03-29 20:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb80d0c4-ede0-56f1-9074-5ee67e1fb450/eb80d0c4-ede0-56f1-9074-5ee67e1fb450_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5274%252F20395274%252Finterior_boot-1774688683857.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5274/20395274/interior_boot-1774688683857.jpg saved to cache
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb80d0c4-ede0-56f1-9074-5ee67e1fb450
2026-03-29 20:12:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659af8750>
2026-03-29 20:12:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9cd61ed-b382-563e-9bf8-47c0c2b42e62/f9cd61ed-b382-563e-9bf8-47c0c2b42e62_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3712%252F19163712%252Fexterior_rear_driver-1771260682586.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3712/19163712/exterior_rear_driver-1771260682586.jpeg saved to cache
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f9cd61ed-b382-563e-9bf8-47c0c2b42e62
2026-03-29 20:12:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90fd1429-cca2-5c29-a15e-abc369cb1086 with identifier: 7743070
2026-03-29 20:12:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90fd1429-cca2-5c29-a15e-abc369cb1086 with scrape type 1
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 90fd1429-cca2-5c29-a15e-abc369cb1086
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3070%252F7743070%252F7743070-exterior_front_driver-default-1774617249947.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3070/7743070/7743070-exterior_front_driver-default-1774617249947.jpg not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3070%252F7743070%252F7743070-exterior_rear_driver-default-1774617252007.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3070/7743070/7743070-exterior_rear_driver-default-1774617252007.jpg not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3070%252F7743070%252F7743070-exterior_front_passenger-default-1774617254689.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3070/7743070/7743070-exterior_front_passenger-default-1774617254689.jpg not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3070%252F7743070%252F7743070-exterior_rear_passenger-default-1774617254339.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3070/7743070/7743070-exterior_rear_passenger-default-1774617254339.jpg not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3070%252F7743070%252F7743070-interior_front_seats-default-1774617264573.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3070/7743070/7743070-interior_front_seats-default-1774617264573.jpg not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3070%252F7743070%252F7743070-interior_rear_seats-default-1774617266139.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3070/7743070/7743070-interior_rear_seats-default-1774617266139.jpg not downloaded yet
2026-03-29 20:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3712/19163712/exterior_front_driver-1771349037240.jpeg> (referer: None)
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3070%252F7743070%252F7743070-interior_dashboard-default-1774617278671.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3070/7743070/7743070-interior_dashboard-default-1774617278671.jpg not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3070%252F7743070%252F7743070-interior_boot-default-1774617318590.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3070/7743070/7743070-interior_boot-default-1774617318590.jpg not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3070%252F7743070%252F7743070-docs_service_history-modified-1695804064799.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D38306946414326c652f420c06b663ee9%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3070/7743070/7743070-docs_service_history-modified-1695804064799.jpeg?ixlib=js-3.8.0&auto=format&s=38306946414326c652f420c06b663ee9 not downloaded yet
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252F3070%252F7743070%252Fdocs_service_history-1698222538843.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddc34dc7f3dce941e92e3bee1a44db569%27 HTTP/1.1" 200 None
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/3070/7743070/docs_service_history-1698222538843.jpg?ixlib=js-3.8.0&auto=format&s=dc34dc7f3dce941e92e3bee1a44db569 not downloaded yet
2026-03-29 20:12:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ac0ad0>
2026-03-29 20:12:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9cd61ed-b382-563e-9bf8-47c0c2b42e62/f9cd61ed-b382-563e-9bf8-47c0c2b42e62_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3712%252F19163712%252Fexterior_front_driver-1771349037240.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3712/19163712/exterior_front_driver-1771349037240.jpeg saved to cache
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f9cd61ed-b382-563e-9bf8-47c0c2b42e62
2026-03-29 20:12:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f9cd61ed-b382-563e-9bf8-47c0c2b42e62, skipping ID generation
2026-03-29 20:12:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9cd61ed-b382-563e-9bf8-47c0c2b42e62 with scrape type 1
2026-03-29 20:12:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f9cd61ed-b382-563e-9bf8-47c0c2b42e62 sending to next pipeline
2026-03-29 20:12:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f9cd61ed-b382-563e-9bf8-47c0c2b42e62, identifier: 19163712
2026-03-29 20:12:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5274/20395274/interior_dashboard-1774706169451.jpg> (referer: None)
2026-03-29 20:12:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f9cd61ed-b382-563e-9bf8-47c0c2b42e62 with identifier: 19163712
2026-03-29 20:12:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f9cd61ed-b382-563e-9bf8-47c0c2b42e62 with identifier: 19163712
2026-03-29 20:12:51 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f9cd61ed-b382-563e-9bf8-47c0c2b42e62 with identifier: 19163712 to the API
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3712/19163712/exterior_front_driver-1771349037240.jpeg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'f9cd61ed-b382-563e-9bf8-47c0c2b42e62',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'N4 LRT',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19163712',
'listing': 'auction',
'location': 'East Riding of Yorkshire Driffield',
'make': 'Porsche',
'model': 'Macan',
'odometer': 44700,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9cd61ed-b382-563e-9bf8-47c0c2b42e62/f9cd61ed-b382-563e-9bf8-47c0c2b42e62_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2929069,
'Height': 2912,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3712/19163712/exterior_front_driver-1771349037240.jpeg',
'Width': 3882},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9cd61ed-b382-563e-9bf8-47c0c2b42e62/f9cd61ed-b382-563e-9bf8-47c0c2b42e62_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2747860,
'Height': 2726,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3712/19163712/exterior_rear_driver-1771260682586.jpeg',
'Width': 3634},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9cd61ed-b382-563e-9bf8-47c0c2b42e62/f9cd61ed-b382-563e-9bf8-47c0c2b42e62_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1338510,
'Height': 2120,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3712/19163712/exterior_front_passenger-1771260669791.jpeg',
'Width': 2826},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9cd61ed-b382-563e-9bf8-47c0c2b42e62/f9cd61ed-b382-563e-9bf8-47c0c2b42e62_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1998340,
'Height': 2354,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3712/19163712/exterior_rear_passenger-1771260676470.jpeg',
'Width': 3139},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9cd61ed-b382-563e-9bf8-47c0c2b42e62/f9cd61ed-b382-563e-9bf8-47c0c2b42e62_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3815933,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3712/19163712/interior_front_seats-1771260672038.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9cd61ed-b382-563e-9bf8-47c0c2b42e62/f9cd61ed-b382-563e-9bf8-47c0c2b42e62_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3280627,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3712/19163712/interior_rear_seats-1771253306495.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9cd61ed-b382-563e-9bf8-47c0c2b42e62/f9cd61ed-b382-563e-9bf8-47c0c2b42e62_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1870893,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3712/19163712/interior_dashboard-1771260699600.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9cd61ed-b382-563e-9bf8-47c0c2b42e62/f9cd61ed-b382-563e-9bf8-47c0c2b42e62_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2510234,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3712/19163712/instrument_cluster-1771260670300.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9cd61ed-b382-563e-9bf8-47c0c2b42e62/f9cd61ed-b382-563e-9bf8-47c0c2b42e62_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4163088,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3712/19163712/interior_boot-1771260685785.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9cd61ed-b382-563e-9bf8-47c0c2b42e62/f9cd61ed-b382-563e-9bf8-47c0c2b42e62_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1491893,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/3712/19163712/docs_service_history-1771692239254.jpeg?ixlib=js-3.8.0&auto=format&s=b546688fb4388b098a0e6869cbd57cb1',
'Width': 4032}],
'price': 33447,
'price_includes_vat': False,
'registration_date': '2019-12-19',
'seats_number': None,
'seller_name': None,
'title': 'Porsche Macan S S-A',
'transmission': 'automatic',
'trim': 'S S-A',
'vin': 'WP1ZZZ95ZLLB36203',
'year': 2019}
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719163712%27 HTTP/1.1" 200 None
2026-03-29 20:12:51 [motorway.uk] INFO: Saving data for 19163712: {'created_time': 1774815171.377054, 'last_price_update_time': 1774815171.377069, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19163712') HTTP/1.1" 204 0
2026-03-29 20:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=468&page=13&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3826/20483826/interior_dashboard-1774698053241.jpg> (referer: None)
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658383810>
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb80d0c4-ede0-56f1-9074-5ee67e1fb450/eb80d0c4-ede0-56f1-9074-5ee67e1fb450_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5274%252F20395274%252Finterior_dashboard-1774706169451.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5274/20395274/interior_dashboard-1774706169451.jpg saved to cache
2026-03-29 20:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb80d0c4-ede0-56f1-9074-5ee67e1fb450
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 20462264
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 20078752
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 20484739
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 20424839
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720424839%27 HTTP/1.1" 200 None
2026-03-29 20:12:51 [motorway.uk] INFO: Scrape type for 20424839: 1
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599bb110>
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_037941b9-b90d-505f-8816-7a50f76d1edf/037941b9-b90d-505f-8816-7a50f76d1edf_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3826%252F20483826%252Finterior_dashboard-1774698053241.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3826/20483826/interior_dashboard-1774698053241.jpg saved to cache
2026-03-29 20:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 037941b9-b90d-505f-8816-7a50f76d1edf
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 16384485
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716384485%27 HTTP/1.1" 200 None
2026-03-29 20:12:51 [motorway.uk] INFO: Scrape type for 16384485: 1
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 19642157
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719642157%27 HTTP/1.1" 200 None
2026-03-29 20:12:51 [motorway.uk] INFO: Scrape type for 19642157: 1
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 18664090
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 19912374
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719912374%27 HTTP/1.1" 200 None
2026-03-29 20:12:51 [motorway.uk] INFO: Scrape type for 19912374: 1
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 20481823
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720481823%27 HTTP/1.1" 200 None
2026-03-29 20:12:51 [motorway.uk] INFO: Scrape type for 20481823: 1
2026-03-29 20:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3826/20483826/interior_boot-1774689323050.jpg> (referer: None)
2026-03-29 20:12:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 10709908
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 20486849
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 20467542
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720467542%27 HTTP/1.1" 200 None
2026-03-29 20:12:51 [motorway.uk] INFO: Scrape type for 20467542: 1
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 17665821
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717665821%27 HTTP/1.1" 200 None
2026-03-29 20:12:51 [motorway.uk] INFO: Scrape type for 17665821: 1
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 2147652
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%272147652%27 HTTP/1.1" 200 None
2026-03-29 20:12:51 [motorway.uk] INFO: Scrape type for 2147652: 1
2026-03-29 20:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18209819.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5274/20395274/interior_rear_seats-1774688507957.jpg> (referer: None)
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 20382820
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 20413228
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720413228%27 HTTP/1.1" 200 None
2026-03-29 20:12:51 [motorway.uk] INFO: Scrape type for 20413228: 1
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 20369309
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 20039478
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720039478%27 HTTP/1.1" 200 None
2026-03-29 20:12:51 [motorway.uk] INFO: Scrape type for 20039478: 1
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 18265628
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 20220021
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 20487110
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 18634459
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 11969339
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 20487185
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 18469041
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 20456356
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 18709305
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 20490237
2026-03-29 20:12:51 [motorway.uk] INFO: Found listing with ID: 19442969
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719442969%27 HTTP/1.1" 200 None
2026-03-29 20:12:52 [motorway.uk] INFO: Scrape type for 19442969: 1
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659bdbe50>
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_037941b9-b90d-505f-8816-7a50f76d1edf/037941b9-b90d-505f-8816-7a50f76d1edf_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3826%252F20483826%252Finterior_boot-1774689323050.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3826/20483826/interior_boot-1774689323050.jpg saved to cache
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 037941b9-b90d-505f-8816-7a50f76d1edf
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 20171226
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 18254903
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 9247330
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 20221098
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 20269740
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 20454557
2026-03-29 20:12:52 [motorway.uk] INFO: Found listing with ID: 18587365
2026-03-29 20:12:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3826/20483826/interior_rear_seats-1774689312053.jpg> (referer: None)
2026-03-29 20:12:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cca5df33-6a60-53e3-961b-d951d985732a with identifier: 18209819
2026-03-29 20:12:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cca5df33-6a60-53e3-961b-d951d985732a with scrape type 1
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cca5df33-6a60-53e3-961b-d951d985732a
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9819%252F18209819%252Fexterior_front_driver-1774702466630.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9819/18209819/exterior_front_driver-1774702466630.jpg not downloaded yet
2026-03-29 20:12:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ec3650>
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb80d0c4-ede0-56f1-9074-5ee67e1fb450/eb80d0c4-ede0-56f1-9074-5ee67e1fb450_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5274%252F20395274%252Finterior_rear_seats-1774688507957.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5274/20395274/interior_rear_seats-1774688507957.jpg saved to cache
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb80d0c4-ede0-56f1-9074-5ee67e1fb450
2026-03-29 20:12:52 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (17943260) larger than download warn size (10485760) in request <GET https://motorway-service-history-photos.imgix.net/3070/7743070/docs_service_history-1698222538843.jpg?ixlib=js-3.8.0&auto=format&s=dc34dc7f3dce941e92e3bee1a44db569>.
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9819%252F18209819%252Fexterior_rear_driver-1774702429605.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9819/18209819/exterior_rear_driver-1774702429605.jpg not downloaded yet
2026-03-29 20:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3826/20483826/interior_front_seats-1774689335866.jpg> (referer: None)
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9819%252F18209819%252Fexterior_front_passenger-1774702423489.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9819/18209819/exterior_front_passenger-1774702423489.jpg not downloaded yet
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65841c190>
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_037941b9-b90d-505f-8816-7a50f76d1edf/037941b9-b90d-505f-8816-7a50f76d1edf_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3826%252F20483826%252Finterior_rear_seats-1774689312053.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3826/20483826/interior_rear_seats-1774689312053.jpg saved to cache
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 037941b9-b90d-505f-8816-7a50f76d1edf
2026-03-29 20:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3070/7743070/7743070-interior_front_seats-default-1774617264573.jpg> (referer: None)
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9819%252F18209819%252Fexterior_rear_passenger-1774702431339.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9819/18209819/exterior_rear_passenger-1774702431339.jpg not downloaded yet
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9819%252F18209819%252Finterior_front_seats-1774702972601.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9819/18209819/interior_front_seats-1774702972601.jpg not downloaded yet
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659bebb50>
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_037941b9-b90d-505f-8816-7a50f76d1edf/037941b9-b90d-505f-8816-7a50f76d1edf_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3826%252F20483826%252Finterior_front_seats-1774689335866.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3826/20483826/interior_front_seats-1774689335866.jpg saved to cache
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 037941b9-b90d-505f-8816-7a50f76d1edf
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9819%252F18209819%252Finterior_rear_seats-1774702984849.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9819/18209819/interior_rear_seats-1774702984849.jpg not downloaded yet
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9819%252F18209819%252Finterior_dashboard-1774702990052.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9819/18209819/interior_dashboard-1774702990052.jpg not downloaded yet
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cbbc10>
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90fd1429-cca2-5c29-a15e-abc369cb1086/90fd1429-cca2-5c29-a15e-abc369cb1086_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3070%252F7743070%252F7743070-interior_front_seats-default-1774617264573.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3070/7743070/7743070-interior_front_seats-default-1774617264573.jpg saved to cache
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 90fd1429-cca2-5c29-a15e-abc369cb1086
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9819%252F18209819%252Finstrument_cluster-1774702984863.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9819/18209819/instrument_cluster-1774702984863.jpg not downloaded yet
2026-03-29 20:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5274/20395274/interior_front_seats-1774688459387.jpg> (referer: None)
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9819%252F18209819%252Finterior_boot-1774702980580.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9819/18209819/interior_boot-1774702980580.jpg not downloaded yet
2026-03-29 20:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3070/7743070/7743070-interior_boot-default-1774617318590.jpg> (referer: None)
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9819%252F18209819%252Fdocs_service_history-1774703178234.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Deb44e6fb0a3df0c8531e126cfad4275d%27 HTTP/1.1" 200 None
2026-03-29 20:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9819/18209819/docs_service_history-1774703178234.jpg?ixlib=js-3.8.0&auto=format&s=eb44e6fb0a3df0c8531e126cfad4275d not downloaded yet
2026-03-29 20:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9819/18209819/exterior_front_driver-1774702466630.jpg> (referer: None)
2026-03-29 20:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/3070/7743070/7743070-docs_service_history-modified-1695804064799.jpeg?ixlib=js-3.8.0&auto=format&s=38306946414326c652f420c06b663ee9> (referer: None)
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586f7cd0>
2026-03-29 20:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb80d0c4-ede0-56f1-9074-5ee67e1fb450/eb80d0c4-ede0-56f1-9074-5ee67e1fb450_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5274%252F20395274%252Finterior_front_seats-1774688459387.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5274/20395274/interior_front_seats-1774688459387.jpg saved to cache
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb80d0c4-ede0-56f1-9074-5ee67e1fb450
2026-03-29 20:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19350653.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfbd2d0>
2026-03-29 20:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90fd1429-cca2-5c29-a15e-abc369cb1086/90fd1429-cca2-5c29-a15e-abc369cb1086_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3070%252F7743070%252F7743070-interior_boot-default-1774617318590.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3070/7743070/7743070-interior_boot-default-1774617318590.jpg saved to cache
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 90fd1429-cca2-5c29-a15e-abc369cb1086
2026-03-29 20:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586b8ed0>
2026-03-29 20:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cca5df33-6a60-53e3-961b-d951d985732a/cca5df33-6a60-53e3-961b-d951d985732a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9819%252F18209819%252Fexterior_front_driver-1774702466630.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9819/18209819/exterior_front_driver-1774702466630.jpg saved to cache
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cca5df33-6a60-53e3-961b-d951d985732a
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x1c\x80'
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'HUAWEI\x00'
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: BitsPerSample (258) - type: short (3) Tag Location: 58 - Data Location: 177 - value: b'\x00\x08\x00\x08\x00\x08'
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'2023:09:11 13:12:42\x00'
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 82 - Data Location: 203 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 94 - Data Location: 211 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x15`'
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 118 - Data Location: 219 - value: b'CLT-L09\x00'
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 130 - Data Location: 227 - value: b'CLT-L09 12.0.0.225(C782E4R1P1)\x00'
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x01\x02'
2026-03-29 20:12:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fed510>
2026-03-29 20:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90fd1429-cca2-5c29-a15e-abc369cb1086/90fd1429-cca2-5c29-a15e-abc369cb1086_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3070%252F7743070%252F7743070-docs_service_history-modified-1695804064799.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D38306946414326c652f420c06b663ee9') HTTP/1.1" 204 0
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3070/7743070/7743070-docs_service_history-modified-1695804064799.jpeg?ixlib=js-3.8.0&auto=format&s=38306946414326c652f420c06b663ee9 saved to cache
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 90fd1429-cca2-5c29-a15e-abc369cb1086
2026-03-29 20:12:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e605385-79fa-5e27-a9ea-1b06982d245c with identifier: 19350653
2026-03-29 20:12:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e605385-79fa-5e27-a9ea-1b06982d245c with scrape type 1
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1e605385-79fa-5e27-a9ea-1b06982d245c
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0653%252F19350653%252Fexterior_front_driver-1774707977414.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0653/19350653/exterior_front_driver-1774707977414.jpeg not downloaded yet
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0653%252F19350653%252Fexterior_rear_driver-1774708045589.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0653/19350653/exterior_rear_driver-1774708045589.jpeg not downloaded yet
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0653%252F19350653%252Fexterior_front_passenger-1774708003439.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0653/19350653/exterior_front_passenger-1774708003439.jpeg not downloaded yet
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0653%252F19350653%252Fexterior_rear_passenger-1774708025733.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0653/19350653/exterior_rear_passenger-1774708025733.jpeg not downloaded yet
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0653%252F19350653%252Finterior_front_seats-1774708050975.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0653/19350653/interior_front_seats-1774708050975.jpeg not downloaded yet
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0653%252F19350653%252Finterior_rear_seats-1774709613117.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0653/19350653/interior_rear_seats-1774709613117.jpeg not downloaded yet
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0653%252F19350653%252Finterior_dashboard-1774708175965.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0653/19350653/interior_dashboard-1774708175965.jpeg not downloaded yet
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0653%252F19350653%252Finstrument_cluster-1774708232674.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0653/19350653/instrument_cluster-1774708232674.jpeg not downloaded yet
2026-03-29 20:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14164507.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0653%252F19350653%252Finterior_boot-1774709647610.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0653/19350653/interior_boot-1774709647610.jpeg not downloaded yet
2026-03-29 20:12:53 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-service-history-photos.imgix.net/3070/7743070/docs_service_history-1698222538843.jpg?ixlib=js-3.8.0&auto=format&s=dc34dc7f3dce941e92e3bee1a44db569>.
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0653%252F19350653%252Fdocs_service_history-1774720924842.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dab814f090f2a553785ce5bc7271d314a%27 HTTP/1.1" 200 None
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0653/19350653/docs_service_history-1774720924842.jpeg?ixlib=js-3.8.0&auto=format&s=ab814f090f2a553785ce5bc7271d314a not downloaded yet
2026-03-29 20:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9819/18209819/instrument_cluster-1774702984863.jpg> (referer: None)
2026-03-29 20:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9819/18209819/interior_rear_seats-1774702984849.jpg> (referer: None)
2026-03-29 20:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9819/18209819/interior_front_seats-1774702972601.jpg> (referer: None)
2026-03-29 20:12:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27b841c3-4fd9-5d3a-992e-37b64d41ba8a with identifier: 14164507
2026-03-29 20:12:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27b841c3-4fd9-5d3a-992e-37b64d41ba8a with scrape type 1
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 27b841c3-4fd9-5d3a-992e-37b64d41ba8a
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4507%252F14164507%252Fexterior_front_driver-1772531807314.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4507/14164507/exterior_front_driver-1772531807314.jpg already downloaded
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4507%252F14164507%252Fexterior_rear_driver-1772531858117.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4507/14164507/exterior_rear_driver-1772531858117.jpg already downloaded
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4507%252F14164507%252Fexterior_front_passenger-1772531894970.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4507/14164507/exterior_front_passenger-1772531894970.jpg already downloaded
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4507%252F14164507%252Fexterior_rear_passenger-1772531873546.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4507/14164507/exterior_rear_passenger-1772531873546.jpg already downloaded
2026-03-29 20:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4507%252F14164507%252Finterior_front_seats-1772533518642.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4507/14164507/interior_front_seats-1772533518642.jpg already downloaded
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4507%252F14164507%252Finterior_rear_seats-1772532530695.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4507/14164507/interior_rear_seats-1772532530695.jpg already downloaded
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4507%252F14164507%252Finterior_dashboard-1772532589258.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4507/14164507/interior_dashboard-1772532589258.jpg already downloaded
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4507%252F14164507%252Finstrument_cluster-1772532466932.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4507/14164507/instrument_cluster-1772532466932.jpg already downloaded
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4507%252F14164507%252Finterior_boot-1772532595470.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4507/14164507/interior_boot-1772532595470.jpg already downloaded
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F4507%252F14164507%252Fdocs_service_history-1772533612469.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcf98070c327a7b90ce880bc9508e1f6e%27 HTTP/1.1" 200 None
2026-03-29 20:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/4507/14164507/docs_service_history-1772533612469.jpg?ixlib=js-3.8.0&auto=format&s=cf98070c327a7b90ce880bc9508e1f6e already downloaded
2026-03-29 20:12:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 27b841c3-4fd9-5d3a-992e-37b64d41ba8a, identifier: 14164507
2026-03-29 20:12:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 27b841c3-4fd9-5d3a-992e-37b64d41ba8a with identifier: 14164507
2026-03-29 20:12:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 27b841c3-4fd9-5d3a-992e-37b64d41ba8a with identifier: 14164507
2026-03-29 20:12:54 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 27b841c3-4fd9-5d3a-992e-37b64d41ba8a with identifier: 14164507 to the API
2026-03-29 20:12:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:12:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14164507.json>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '27b841c3-4fd9-5d3a-992e-37b64d41ba8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'X2 DMG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/14164507',
'listing': 'auction',
'location': 'North Yorkshire Darlington',
'make': 'Audi',
'model': 'A8',
'odometer': 55400,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/4507/14164507/exterior_front_driver-1772531807314.jpg',
'https://motorway-photos-redacted.imgix.net/4507/14164507/exterior_rear_driver-1772531858117.jpg',
'https://motorway-photos-redacted.imgix.net/4507/14164507/exterior_front_passenger-1772531894970.jpg',
'https://motorway-photos-redacted.imgix.net/4507/14164507/exterior_rear_passenger-1772531873546.jpg',
'https://motorway-photos.imgix.net/4507/14164507/interior_front_seats-1772533518642.jpg',
'https://motorway-photos.imgix.net/4507/14164507/interior_rear_seats-1772532530695.jpg',
'https://motorway-photos-redacted.imgix.net/4507/14164507/interior_dashboard-1772532589258.jpg',
'https://motorway-photos-redacted.imgix.net/4507/14164507/instrument_cluster-1772532466932.jpg',
'https://motorway-photos.imgix.net/4507/14164507/interior_boot-1772532595470.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/4507/14164507/docs_service_history-1772533612469.jpg?ixlib=js-3.8.0&auto=format&s=cf98070c327a7b90ce880bc9508e1f6e'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9df1639c-7433-54f0-a642-a13804e571cc/9df1639c-7433-54f0-a642-a13804e571cc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1477045,
'Height': 2986,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4507/14164507/exterior_front_driver-1772531807314.jpg',
'Width': 3981},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9df1639c-7433-54f0-a642-a13804e571cc/9df1639c-7433-54f0-a642-a13804e571cc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2806763,
'Height': 3020,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4507/14164507/exterior_rear_driver-1772531858117.jpg',
'Width': 4027},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9df1639c-7433-54f0-a642-a13804e571cc/9df1639c-7433-54f0-a642-a13804e571cc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2040350,
'Height': 2568,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4507/14164507/exterior_front_passenger-1772531894970.jpg',
'Width': 3424},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9df1639c-7433-54f0-a642-a13804e571cc/9df1639c-7433-54f0-a642-a13804e571cc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2343620,
'Height': 2859,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4507/14164507/exterior_rear_passenger-1772531873546.jpg',
'Width': 3812},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9df1639c-7433-54f0-a642-a13804e571cc/9df1639c-7433-54f0-a642-a13804e571cc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3923216,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4507/14164507/interior_front_seats-1772533518642.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9df1639c-7433-54f0-a642-a13804e571cc/9df1639c-7433-54f0-a642-a13804e571cc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3648646,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4507/14164507/interior_rear_seats-1772532530695.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9df1639c-7433-54f0-a642-a13804e571cc/9df1639c-7433-54f0-a642-a13804e571cc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1738273,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4507/14164507/interior_dashboard-1772532589258.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9df1639c-7433-54f0-a642-a13804e571cc/9df1639c-7433-54f0-a642-a13804e571cc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1188360,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4507/14164507/instrument_cluster-1772532466932.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9df1639c-7433-54f0-a642-a13804e571cc/9df1639c-7433-54f0-a642-a13804e571cc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3664034,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4507/14164507/interior_boot-1772532595470.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9df1639c-7433-54f0-a642-a13804e571cc/9df1639c-7433-54f0-a642-a13804e571cc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 781708,
'Height': 2796,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/4507/14164507/docs_service_history-1772533612469.jpg?ixlib=js-3.8.0&auto=format&s=cf98070c327a7b90ce880bc9508e1f6e',
'Width': 1290}],
'price': 22500,
'price_includes_vat': False,
'registration_date': '2019-12-19',
'seats_number': None,
'seller_name': None,
'title': 'Audi A8 S Line 50 TDI Quattro Auto',
'transmission': 'automatic',
'trim': 'S Line 50 TDI Quattro Auto',
'vin': 'WAUZZZF83KN016887',
'year': 2019}
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714164507%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [motorway.uk] INFO: Saving data for 14164507: {'created_time': 1774815175.293556, 'last_price_update_time': 1774815175.293567, 'auction_closing_time': 1774884600.0}
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='14164507') HTTP/1.1" 204 0
2026-03-29 20:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20459543.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0653/19350653/docs_service_history-1774720924842.jpeg?ixlib=js-3.8.0&auto=format&s=ab814f090f2a553785ce5bc7271d314a> (referer: None)
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a23dd0>
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cca5df33-6a60-53e3-961b-d951d985732a/cca5df33-6a60-53e3-961b-d951d985732a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9819%252F18209819%252Finstrument_cluster-1774702984863.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9819/18209819/instrument_cluster-1774702984863.jpg saved to cache
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cca5df33-6a60-53e3-961b-d951d985732a
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65857ae10>
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cca5df33-6a60-53e3-961b-d951d985732a/cca5df33-6a60-53e3-961b-d951d985732a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9819%252F18209819%252Finterior_rear_seats-1774702984849.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9819/18209819/interior_rear_seats-1774702984849.jpg saved to cache
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cca5df33-6a60-53e3-961b-d951d985732a
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6585790d0>
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cca5df33-6a60-53e3-961b-d951d985732a/cca5df33-6a60-53e3-961b-d951d985732a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9819%252F18209819%252Finterior_front_seats-1774702972601.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9819/18209819/interior_front_seats-1774702972601.jpg saved to cache
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cca5df33-6a60-53e3-961b-d951d985732a
2026-03-29 20:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20303235.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19912374.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf with identifier: 20459543
2026-03-29 20:12:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf with scrape type 1
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9543%252F20459543%252Fexterior_front_driver-1774691813699.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9543/20459543/exterior_front_driver-1774691813699.jpg not downloaded yet
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586f2110>
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e605385-79fa-5e27-a9ea-1b06982d245c/1e605385-79fa-5e27-a9ea-1b06982d245c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0653%252F19350653%252Fdocs_service_history-1774720924842.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dab814f090f2a553785ce5bc7271d314a') HTTP/1.1" 204 0
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0653/19350653/docs_service_history-1774720924842.jpeg?ixlib=js-3.8.0&auto=format&s=ab814f090f2a553785ce5bc7271d314a saved to cache
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1e605385-79fa-5e27-a9ea-1b06982d245c
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9543%252F20459543%252Fexterior_rear_driver-1774691841146.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9543/20459543/exterior_rear_driver-1774691841146.jpg not downloaded yet
2026-03-29 20:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9819/18209819/interior_dashboard-1774702990052.jpg> (referer: None)
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9543%252F20459543%252Fexterior_front_passenger-1774691888562.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9543/20459543/exterior_front_passenger-1774691888562.jpg not downloaded yet
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9543%252F20459543%252Fexterior_rear_passenger-1774691861345.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9543/20459543/exterior_rear_passenger-1774691861345.jpg not downloaded yet
2026-03-29 20:12:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10e3a9b8-acc5-5715-bc74-bf5729b13faf with identifier: 20303235
2026-03-29 20:12:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10e3a9b8-acc5-5715-bc74-bf5729b13faf with scrape type 1
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 10e3a9b8-acc5-5715-bc74-bf5729b13faf
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3235%252F20303235%252Fexterior_front_driver-1774696554495.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3235/20303235/exterior_front_driver-1774696554495.jpg not downloaded yet
2026-03-29 20:12:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 671a5767-dd47-5515-92bc-3cdc280ca216 with identifier: 19912374
2026-03-29 20:12:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 671a5767-dd47-5515-92bc-3cdc280ca216 with scrape type 1
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 671a5767-dd47-5515-92bc-3cdc280ca216
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2374%252F19912374%252Fexterior_front_driver-1774709045750.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2374/19912374/exterior_front_driver-1774709045750.jpg not downloaded yet
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9543%252F20459543%252Finterior_front_seats-1774692460819.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9543/20459543/interior_front_seats-1774692460819.jpg not downloaded yet
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3235%252F20303235%252Fexterior_rear_driver-1774696561759.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3235/20303235/exterior_rear_driver-1774696561759.jpg not downloaded yet
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2374%252F19912374%252Fexterior_rear_driver-1774705766296.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2374/19912374/exterior_rear_driver-1774705766296.jpg not downloaded yet
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9543%252F20459543%252Finterior_rear_seats-1774692515319.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9543/20459543/interior_rear_seats-1774692515319.jpg not downloaded yet
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3235%252F20303235%252Fexterior_front_passenger-1774696547417.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3235/20303235/exterior_front_passenger-1774696547417.jpg not downloaded yet
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2374%252F19912374%252Fexterior_front_passenger-1774709057885.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2374/19912374/exterior_front_passenger-1774709057885.jpg not downloaded yet
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659bda2d0>
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cca5df33-6a60-53e3-961b-d951d985732a/cca5df33-6a60-53e3-961b-d951d985732a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9819%252F18209819%252Finterior_dashboard-1774702990052.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9819/18209819/interior_dashboard-1774702990052.jpg saved to cache
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cca5df33-6a60-53e3-961b-d951d985732a
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9543%252F20459543%252Finterior_dashboard-1774692579324.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9543/20459543/interior_dashboard-1774692579324.jpg not downloaded yet
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3235%252F20303235%252Fexterior_rear_passenger-1774696551402.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3235/20303235/exterior_rear_passenger-1774696551402.jpg not downloaded yet
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2374%252F19912374%252Fexterior_rear_passenger-1774705769478.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2374/19912374/exterior_rear_passenger-1774705769478.jpg not downloaded yet
2026-03-29 20:12:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/11675984.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9819/18209819/interior_boot-1774702980580.jpg> (referer: None)
2026-03-29 20:12:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9819/18209819/exterior_rear_passenger-1774702431339.jpg> (referer: None)
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9543%252F20459543%252Finstrument_cluster-1774692512435.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9543/20459543/instrument_cluster-1774692512435.jpg not downloaded yet
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3235%252F20303235%252Finterior_front_seats-1774697805911.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3235/20303235/interior_front_seats-1774697805911.jpg not downloaded yet
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2374%252F19912374%252Finterior_front_seats-1774706717408.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2374/19912374/interior_front_seats-1774706717408.jpg not downloaded yet
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9543%252F20459543%252Finterior_boot-1774692642364.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9543/20459543/interior_boot-1774692642364.jpg not downloaded yet
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3235%252F20303235%252Finterior_rear_seats-1774697809343.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3235/20303235/interior_rear_seats-1774697809343.jpg not downloaded yet
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2374%252F19912374%252Finterior_rear_seats-1774706543264.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2374/19912374/interior_rear_seats-1774706543264.jpg not downloaded yet
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9543%252F20459543%252Fdocs_service_history-1774709871705.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D13394364eb795dd7028a8034623e682e%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9543/20459543/docs_service_history-1774709871705.jpg?ixlib=js-3.8.0&auto=format&s=13394364eb795dd7028a8034623e682e not downloaded yet
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3235%252F20303235%252F20303235-interior_dashboard-modified-1774700665044.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3235/20303235/20303235-interior_dashboard-modified-1774700665044.jpeg not downloaded yet
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2374%252F19912374%252Finterior_dashboard-1774706555803.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2374/19912374/interior_dashboard-1774706555803.jpg not downloaded yet
2026-03-29 20:12:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a272b773-4897-52f0-8f24-0b30e85a5174 with identifier: 11675984
2026-03-29 20:12:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a272b773-4897-52f0-8f24-0b30e85a5174 with scrape type 1
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a272b773-4897-52f0-8f24-0b30e85a5174
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5984%252F11675984%252Fexterior_front_driver-1774709086387.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5984/11675984/exterior_front_driver-1774709086387.jpg not downloaded yet
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf98dd0>
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cca5df33-6a60-53e3-961b-d951d985732a/cca5df33-6a60-53e3-961b-d951d985732a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9819%252F18209819%252Finterior_boot-1774702980580.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9819/18209819/interior_boot-1774702980580.jpg saved to cache
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cca5df33-6a60-53e3-961b-d951d985732a
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658403d50>
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cca5df33-6a60-53e3-961b-d951d985732a/cca5df33-6a60-53e3-961b-d951d985732a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9819%252F18209819%252Fexterior_rear_passenger-1774702431339.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9819/18209819/exterior_rear_passenger-1774702431339.jpg saved to cache
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cca5df33-6a60-53e3-961b-d951d985732a
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3235%252F20303235%252Finstrument_cluster-1774697494945.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3235/20303235/instrument_cluster-1774697494945.jpg not downloaded yet
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2374%252F19912374%252Finstrument_cluster-1774708721440.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2374/19912374/instrument_cluster-1774708721440.jpg not downloaded yet
2026-03-29 20:12:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0653/19350653/instrument_cluster-1774708232674.jpeg> (referer: None)
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5984%252F11675984%252Fexterior_rear_driver-1774709104494.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5984/11675984/exterior_rear_driver-1774709104494.jpg not downloaded yet
2026-03-29 20:12:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20500024.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3235%252F20303235%252Finterior_boot-1774697720462.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3235/20303235/interior_boot-1774697720462.jpg not downloaded yet
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2374%252F19912374%252Finterior_boot-1774706544212.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2374/19912374/interior_boot-1774706544212.jpg not downloaded yet
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5984%252F11675984%252Fexterior_front_passenger-1774709125496.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5984/11675984/exterior_front_passenger-1774709125496.jpg not downloaded yet
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3235%252F20303235%252Fdocs_service_history-1774698538718.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9204963b6d7fb2d1681676499cf4d7a4%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3235/20303235/docs_service_history-1774698538718.jpg?ixlib=js-3.8.0&auto=format&s=9204963b6d7fb2d1681676499cf4d7a4 not downloaded yet
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2374%252F19912374%252Fdocs_service_history-1774707262737.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D86d7c57c00432b3abb0d9d79f935b79b%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2374/19912374/docs_service_history-1774707262737.jpg?ixlib=js-3.8.0&auto=format&s=86d7c57c00432b3abb0d9d79f935b79b not downloaded yet
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5984%252F11675984%252Fexterior_rear_passenger-1774709115901.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5984/11675984/exterior_rear_passenger-1774709115901.jpg not downloaded yet
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5984%252F11675984%252Finterior_front_seats-1774709372945.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5984/11675984/interior_front_seats-1774709372945.jpg not downloaded yet
2026-03-29 20:12:56 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:56 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:56 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x1b\xb1\xc0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\x82\x0c\x00\x1b\xa7\xd0\x00\x00\x00\x00'
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a5fd10>
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e605385-79fa-5e27-a9ea-1b06982d245c/1e605385-79fa-5e27-a9ea-1b06982d245c_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0653%252F19350653%252Finstrument_cluster-1774708232674.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0653/19350653/instrument_cluster-1774708232674.jpeg saved to cache
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1e605385-79fa-5e27-a9ea-1b06982d245c
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5984%252F11675984%252Finterior_rear_seats-1774709380744.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5984/11675984/interior_rear_seats-1774709380744.jpg not downloaded yet
2026-03-29 20:12:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0 with identifier: 20500024
2026-03-29 20:12:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0 with scrape type 1
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0024%252F20500024%252Fexterior_front_driver-1774783571204.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0024/20500024/exterior_front_driver-1774783571204.jpg not downloaded yet
2026-03-29 20:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9819/18209819/docs_service_history-1774703178234.jpg?ixlib=js-3.8.0&auto=format&s=eb44e6fb0a3df0c8531e126cfad4275d> (referer: None)
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5984%252F11675984%252Finterior_dashboard-1774710766050.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5984/11675984/interior_dashboard-1774710766050.jpg not downloaded yet
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0024%252F20500024%252Fexterior_rear_driver-1774783575801.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0024/20500024/exterior_rear_driver-1774783575801.jpg not downloaded yet
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5984%252F11675984%252Finterior_boot-1774709441217.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5984/11675984/interior_boot-1774709441217.jpg not downloaded yet
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0024%252F20500024%252Fexterior_front_passenger-1774783580502.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0024/20500024/exterior_front_passenger-1774783580502.jpg not downloaded yet
2026-03-29 20:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0653/19350653/interior_boot-1774709647610.jpeg> (referer: None)
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5984%252F11675984%252Fdocs_service_history-1774709471442.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1b4d0026d1aa3c85bb3283e382a87a05%27 HTTP/1.1" 200 None
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5984/11675984/docs_service_history-1774709471442.jpg?ixlib=js-3.8.0&auto=format&s=1b4d0026d1aa3c85bb3283e382a87a05 not downloaded yet
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0024%252F20500024%252Fexterior_rear_passenger-1774783562964.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0024/20500024/exterior_rear_passenger-1774783562964.jpg not downloaded yet
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5984%252F11675984%252Fdocs_service_history-1774709476607.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df9cd1651cc3e5750c49d9814a90072c2%27 HTTP/1.1" 200 None
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5984/11675984/docs_service_history-1774709476607.jpg?ixlib=js-3.8.0&auto=format&s=f9cd1651cc3e5750c49d9814a90072c2 not downloaded yet
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0024%252F20500024%252Finterior_front_seats-1774783868847.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0024/20500024/interior_front_seats-1774783868847.jpg not downloaded yet
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65c420a50>
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cca5df33-6a60-53e3-961b-d951d985732a/cca5df33-6a60-53e3-961b-d951d985732a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9819%252F18209819%252Fdocs_service_history-1774703178234.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Deb44e6fb0a3df0c8531e126cfad4275d') HTTP/1.1" 204 0
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9819/18209819/docs_service_history-1774703178234.jpg?ixlib=js-3.8.0&auto=format&s=eb44e6fb0a3df0c8531e126cfad4275d saved to cache
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cca5df33-6a60-53e3-961b-d951d985732a
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0024%252F20500024%252Finterior_rear_seats-1774783858522.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0024/20500024/interior_rear_seats-1774783858522.jpg not downloaded yet
2026-03-29 20:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2374/19912374/instrument_cluster-1774708721440.jpg> (referer: None)
2026-03-29 20:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0653/19350653/interior_dashboard-1774708175965.jpeg> (referer: None)
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0024%252F20500024%252Finterior_dashboard-1774783875434.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0024/20500024/interior_dashboard-1774783875434.jpg not downloaded yet
2026-03-29 20:12:57 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:57 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:57 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00*,\x88\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\x1f,\x00*"\x98\x00\x00\x00\x00'
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65836cb50>
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e605385-79fa-5e27-a9ea-1b06982d245c/1e605385-79fa-5e27-a9ea-1b06982d245c_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0653%252F19350653%252Finterior_boot-1774709647610.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0653/19350653/interior_boot-1774709647610.jpeg saved to cache
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1e605385-79fa-5e27-a9ea-1b06982d245c
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0024%252F20500024%252Finterior_boot-1774783853421.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0024/20500024/interior_boot-1774783853421.jpg not downloaded yet
2026-03-29 20:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0653/19350653/exterior_front_passenger-1774708003439.jpeg> (referer: None)
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cacb50>
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_671a5767-dd47-5515-92bc-3cdc280ca216/671a5767-dd47-5515-92bc-3cdc280ca216_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2374%252F19912374%252Finstrument_cluster-1774708721440.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2374/19912374/instrument_cluster-1774708721440.jpg saved to cache
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 671a5767-dd47-5515-92bc-3cdc280ca216
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598dfb50>
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e605385-79fa-5e27-a9ea-1b06982d245c/1e605385-79fa-5e27-a9ea-1b06982d245c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0653%252F19350653%252Finterior_dashboard-1774708175965.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0653/19350653/interior_dashboard-1774708175965.jpeg saved to cache
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1e605385-79fa-5e27-a9ea-1b06982d245c
2026-03-29 20:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/3070/7743070/docs_service_history-1698222538843.jpg?ixlib=js-3.8.0&auto=format&s=dc34dc7f3dce941e92e3bee1a44db569> (referer: None)
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0024%252F20500024%252Fdocs_service_history-1774784907937.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbff4074b8123f558babd06a12ad93678%27 HTTP/1.1" 200 None
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0024/20500024/docs_service_history-1774784907937.jpg?ixlib=js-3.8.0&auto=format&s=bff4074b8123f558babd06a12ad93678 not downloaded yet
2026-03-29 20:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3235/20303235/instrument_cluster-1774697494945.jpg> (referer: None)
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0024%252F20500024%252Fdocs_service_history-1774784922718.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5c3e7141de0bcbb5861850f00edb656f%27 HTTP/1.1" 200 None
2026-03-29 20:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0024/20500024/docs_service_history-1774784922718.jpg?ixlib=js-3.8.0&auto=format&s=5c3e7141de0bcbb5861850f00edb656f not downloaded yet
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d74e10>
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e605385-79fa-5e27-a9ea-1b06982d245c/1e605385-79fa-5e27-a9ea-1b06982d245c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0653%252F19350653%252Fexterior_front_passenger-1774708003439.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0653/19350653/exterior_front_passenger-1774708003439.jpeg saved to cache
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1e605385-79fa-5e27-a9ea-1b06982d245c
2026-03-29 20:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0653/19350653/exterior_rear_passenger-1774708025733.jpeg> (referer: None)
2026-03-29 20:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9543/20459543/exterior_rear_driver-1774691841146.jpg> (referer: None)
2026-03-29 20:12:58 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x1c\x80'
2026-03-29 20:12:58 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'HUAWEI\x00'
2026-03-29 20:12:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x00'
2026-03-29 20:12:58 [PIL.TiffImagePlugin] DEBUG: tag: BitsPerSample (258) - type: short (3) Tag Location: 58 - Data Location: 177 - value: b'\x00\x08\x00\x08\x00\x08'
2026-03-29 20:12:58 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'2023:10:25 09:28:41\x00'
2026-03-29 20:12:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 82 - Data Location: 203 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 94 - Data Location: 211 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:12:58 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x15`'
2026-03-29 20:12:58 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 118 - Data Location: 219 - value: b'CLT-L09\x00'
2026-03-29 20:12:58 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 130 - Data Location: 227 - value: b'CLT-L09 12.0.0.225(C782E4R1P1)\x00'
2026-03-29 20:12:58 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:12:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x01\x02'
2026-03-29 20:12:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:12:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d77bd0>
2026-03-29 20:12:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90fd1429-cca2-5c29-a15e-abc369cb1086/90fd1429-cca2-5c29-a15e-abc369cb1086_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252F3070%252F7743070%252Fdocs_service_history-1698222538843.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddc34dc7f3dce941e92e3bee1a44db569') HTTP/1.1" 204 0
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/3070/7743070/docs_service_history-1698222538843.jpg?ixlib=js-3.8.0&auto=format&s=dc34dc7f3dce941e92e3bee1a44db569 saved to cache
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 90fd1429-cca2-5c29-a15e-abc369cb1086
2026-03-29 20:12:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d77810>
2026-03-29 20:12:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10e3a9b8-acc5-5715-bc74-bf5729b13faf/10e3a9b8-acc5-5715-bc74-bf5729b13faf_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3235%252F20303235%252Finstrument_cluster-1774697494945.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3235/20303235/instrument_cluster-1774697494945.jpg saved to cache
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 10e3a9b8-acc5-5715-bc74-bf5729b13faf
2026-03-29 20:12:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a0ef50>
2026-03-29 20:12:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e605385-79fa-5e27-a9ea-1b06982d245c/1e605385-79fa-5e27-a9ea-1b06982d245c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0653%252F19350653%252Fexterior_rear_passenger-1774708025733.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0653/19350653/exterior_rear_passenger-1774708025733.jpeg saved to cache
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1e605385-79fa-5e27-a9ea-1b06982d245c
2026-03-29 20:12:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e36b90>
2026-03-29 20:12:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf/a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9543%252F20459543%252Fexterior_rear_driver-1774691841146.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9543/20459543/exterior_rear_driver-1774691841146.jpg saved to cache
2026-03-29 20:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf
2026-03-29 20:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0653/19350653/interior_rear_seats-1774709613117.jpeg> (referer: None)
2026-03-29 20:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2374/19912374/interior_dashboard-1774706555803.jpg> (referer: None)
2026-03-29 20:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0653/19350653/interior_front_seats-1774708050975.jpeg> (referer: None)
2026-03-29 20:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0024/20500024/exterior_front_driver-1774783571204.jpg> (referer: None)
2026-03-29 20:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5984/11675984/exterior_front_driver-1774709086387.jpg> (referer: None)
2026-03-29 20:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3235/20303235/20303235-interior_dashboard-modified-1774700665044.jpeg> (referer: None)
2026-03-29 20:12:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19442969.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:12:58 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:58 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:58 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00*\xd4x\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02+}\x00*\xca\x88\x00\x00\x00\x00'
2026-03-29 20:12:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a0d150>
2026-03-29 20:12:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e605385-79fa-5e27-a9ea-1b06982d245c/1e605385-79fa-5e27-a9ea-1b06982d245c_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0653%252F19350653%252Finterior_rear_seats-1774709613117.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0653/19350653/interior_rear_seats-1774709613117.jpeg saved to cache
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1e605385-79fa-5e27-a9ea-1b06982d245c
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf11710>
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_671a5767-dd47-5515-92bc-3cdc280ca216/671a5767-dd47-5515-92bc-3cdc280ca216_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2374%252F19912374%252Finterior_dashboard-1774706555803.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2374/19912374/interior_dashboard-1774706555803.jpg saved to cache
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 671a5767-dd47-5515-92bc-3cdc280ca216
2026-03-29 20:12:59 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:12:59 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:12:59 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00-\xe8\x8f\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\xfb\xdc\x00-\xde\x9f\x00\x00\x00\x00'
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d75610>
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e605385-79fa-5e27-a9ea-1b06982d245c/1e605385-79fa-5e27-a9ea-1b06982d245c_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0653%252F19350653%252Finterior_front_seats-1774708050975.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0653/19350653/interior_front_seats-1774708050975.jpeg saved to cache
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1e605385-79fa-5e27-a9ea-1b06982d245c
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b5ad90>
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0/c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0024%252F20500024%252Fexterior_front_driver-1774783571204.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0024/20500024/exterior_front_driver-1774783571204.jpg saved to cache
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b0f3d0>
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a272b773-4897-52f0-8f24-0b30e85a5174/a272b773-4897-52f0-8f24-0b30e85a5174_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5984%252F11675984%252Fexterior_front_driver-1774709086387.jpg') HTTP/1.1" 204 0
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5984/11675984/exterior_front_driver-1774709086387.jpg saved to cache
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a272b773-4897-52f0-8f24-0b30e85a5174
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65884b650>
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:12:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10e3a9b8-acc5-5715-bc74-bf5729b13faf/10e3a9b8-acc5-5715-bc74-bf5729b13faf_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3235%252F20303235%252F20303235-interior_dashboard-modified-1774700665044.jpeg') HTTP/1.1" 204 0
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3235/20303235/20303235-interior_dashboard-modified-1774700665044.jpeg saved to cache
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 10e3a9b8-acc5-5715-bc74-bf5729b13faf
2026-03-29 20:12:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: add0d574-9e06-526b-bf85-98b70d4b6228 with identifier: 19442969
2026-03-29 20:12:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item add0d574-9e06-526b-bf85-98b70d4b6228 with scrape type 1
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item add0d574-9e06-526b-bf85-98b70d4b6228
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2969%252F19442969%252Fexterior_front_driver-1774705169073.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2969/19442969/exterior_front_driver-1774705169073.jpeg not downloaded yet
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2969%252F19442969%252Fexterior_rear_driver-1774705216435.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2969/19442969/exterior_rear_driver-1774705216435.jpeg not downloaded yet
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2969%252F19442969%252Fexterior_front_passenger-1774705184106.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2969/19442969/exterior_front_passenger-1774705184106.jpeg not downloaded yet
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2969%252F19442969%252Fexterior_rear_passenger-1774705197622.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2969/19442969/exterior_rear_passenger-1774705197622.jpeg not downloaded yet
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2969%252F19442969%252Finterior_front_seats-1774705229868.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2969/19442969/interior_front_seats-1774705229868.jpeg not downloaded yet
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2969%252F19442969%252Finterior_rear_seats-1774705354852.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2969/19442969/interior_rear_seats-1774705354852.jpeg not downloaded yet
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2969%252F19442969%252Finterior_dashboard-1774705439824.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2969/19442969/interior_dashboard-1774705439824.jpeg not downloaded yet
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2969%252F19442969%252Finterior_boot-1774705408329.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2969/19442969/interior_boot-1774705408329.jpeg not downloaded yet
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2969%252F19442969%252Fdocs_service_history-1774706077576.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6cbc4033a14d028b6a3ffeab3f32d354%27 HTTP/1.1" 200 None
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2969/19442969/docs_service_history-1774706077576.jpeg?ixlib=js-3.8.0&auto=format&s=6cbc4033a14d028b6a3ffeab3f32d354 not downloaded yet
2026-03-29 20:13:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0024/20500024/exterior_rear_passenger-1774783562964.jpg> (referer: None)
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2969%252F19442969%252Fdocs_service_history-1774706099517.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbf1f89b13273e017243bacb42cae2e38%27 HTTP/1.1" 200 None
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2969/19442969/docs_service_history-1774706099517.jpeg?ixlib=js-3.8.0&auto=format&s=bf1f89b13273e017243bacb42cae2e38 not downloaded yet
2026-03-29 20:13:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5984/11675984/docs_service_history-1774709471442.jpg?ixlib=js-3.8.0&auto=format&s=1b4d0026d1aa3c85bb3283e382a87a05> (referer: None)
2026-03-29 20:13:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0024/20500024/exterior_front_passenger-1774783580502.jpg> (referer: None)
2026-03-29 20:13:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5984/11675984/docs_service_history-1774709476607.jpg?ixlib=js-3.8.0&auto=format&s=f9cd1651cc3e5750c49d9814a90072c2> (referer: None)
2026-03-29 20:13:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0024/20500024/docs_service_history-1774784922718.jpg?ixlib=js-3.8.0&auto=format&s=5c3e7141de0bcbb5861850f00edb656f> (referer: None)
2026-03-29 20:13:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0024/20500024/docs_service_history-1774784907937.jpg?ixlib=js-3.8.0&auto=format&s=bff4074b8123f558babd06a12ad93678> (referer: None)
2026-03-29 20:13:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0024/20500024/interior_rear_seats-1774783858522.jpg> (referer: None)
2026-03-29 20:13:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0024/20500024/interior_dashboard-1774783875434.jpg> (referer: None)
2026-03-29 20:13:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0024/20500024/interior_front_seats-1774783868847.jpg> (referer: None)
2026-03-29 20:13:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0024/20500024/interior_boot-1774783853421.jpg> (referer: None)
2026-03-29 20:13:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5984/11675984/interior_dashboard-1774710766050.jpg> (referer: None)
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659075250>
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0/c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0024%252F20500024%252Fexterior_rear_passenger-1774783562964.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0024/20500024/exterior_rear_passenger-1774783562964.jpg saved to cache
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6590751d0>
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a272b773-4897-52f0-8f24-0b30e85a5174/a272b773-4897-52f0-8f24-0b30e85a5174_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5984%252F11675984%252Fdocs_service_history-1774709471442.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1b4d0026d1aa3c85bb3283e382a87a05') HTTP/1.1" 204 0
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5984/11675984/docs_service_history-1774709471442.jpg?ixlib=js-3.8.0&auto=format&s=1b4d0026d1aa3c85bb3283e382a87a05 saved to cache
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a272b773-4897-52f0-8f24-0b30e85a5174
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f1eed0>
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0/c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0024%252F20500024%252Fexterior_front_passenger-1774783580502.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0024/20500024/exterior_front_passenger-1774783580502.jpg saved to cache
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ac3650>
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a272b773-4897-52f0-8f24-0b30e85a5174/a272b773-4897-52f0-8f24-0b30e85a5174_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5984%252F11675984%252Fdocs_service_history-1774709476607.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df9cd1651cc3e5750c49d9814a90072c2') HTTP/1.1" 204 0
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5984/11675984/docs_service_history-1774709476607.jpg?ixlib=js-3.8.0&auto=format&s=f9cd1651cc3e5750c49d9814a90072c2 saved to cache
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a272b773-4897-52f0-8f24-0b30e85a5174
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65853e4d0>
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0/c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0024%252F20500024%252Fdocs_service_history-1774784922718.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5c3e7141de0bcbb5861850f00edb656f') HTTP/1.1" 204 0
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0024/20500024/docs_service_history-1774784922718.jpg?ixlib=js-3.8.0&auto=format&s=5c3e7141de0bcbb5861850f00edb656f saved to cache
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bf8890>
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0/c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0024%252F20500024%252Fdocs_service_history-1774784907937.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbff4074b8123f558babd06a12ad93678') HTTP/1.1" 204 0
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0024/20500024/docs_service_history-1774784907937.jpg?ixlib=js-3.8.0&auto=format&s=bff4074b8123f558babd06a12ad93678 saved to cache
2026-03-29 20:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f1ff10>
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0/c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0024%252F20500024%252Finterior_rear_seats-1774783858522.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0024/20500024/interior_rear_seats-1774783858522.jpg saved to cache
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65853ef90>
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0/c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0024%252F20500024%252Finterior_dashboard-1774783875434.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0024/20500024/interior_dashboard-1774783875434.jpg saved to cache
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f1f210>
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0/c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0024%252F20500024%252Finterior_front_seats-1774783868847.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0024/20500024/interior_front_seats-1774783868847.jpg saved to cache
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bf9b90>
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0/c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0024%252F20500024%252Finterior_boot-1774783853421.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0024/20500024/interior_boot-1774783853421.jpg saved to cache
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f1c090>
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a272b773-4897-52f0-8f24-0b30e85a5174/a272b773-4897-52f0-8f24-0b30e85a5174_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5984%252F11675984%252Finterior_dashboard-1774710766050.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5984/11675984/interior_dashboard-1774710766050.jpg saved to cache
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a272b773-4897-52f0-8f24-0b30e85a5174
2026-03-29 20:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2969/19442969/exterior_front_driver-1774705169073.jpeg> (referer: None)
2026-03-29 20:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0024/20500024/exterior_rear_driver-1774783575801.jpg> (referer: None)
2026-03-29 20:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2969/19442969/docs_service_history-1774706099517.jpeg?ixlib=js-3.8.0&auto=format&s=bf1f89b13273e017243bacb42cae2e38> (referer: None)
2026-03-29 20:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5984/11675984/interior_rear_seats-1774709380744.jpg> (referer: None)
2026-03-29 20:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5984/11675984/interior_boot-1774709441217.jpg> (referer: None)
2026-03-29 20:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2969/19442969/docs_service_history-1774706077576.jpeg?ixlib=js-3.8.0&auto=format&s=6cbc4033a14d028b6a3ffeab3f32d354> (referer: None)
2026-03-29 20:13:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2969/19442969/interior_boot-1774705408329.jpeg> (referer: None)
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f13b10>
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add0d574-9e06-526b-bf85-98b70d4b6228/add0d574-9e06-526b-bf85-98b70d4b6228_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2969%252F19442969%252Fexterior_front_driver-1774705169073.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2969/19442969/exterior_front_driver-1774705169073.jpeg saved to cache
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item add0d574-9e06-526b-bf85-98b70d4b6228
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f11b50>
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0/c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0024%252F20500024%252Fexterior_rear_driver-1774783575801.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0024/20500024/exterior_rear_driver-1774783575801.jpg saved to cache
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0
2026-03-29 20:13:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0, skipping ID generation
2026-03-29 20:13:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0 with scrape type 1
2026-03-29 20:13:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0 sending to next pipeline
2026-03-29 20:13:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0, identifier: 20500024
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6588b1fd0>
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add0d574-9e06-526b-bf85-98b70d4b6228/add0d574-9e06-526b-bf85-98b70d4b6228_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2969%252F19442969%252Fdocs_service_history-1774706099517.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbf1f89b13273e017243bacb42cae2e38') HTTP/1.1" 204 0
2026-03-29 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2969/19442969/docs_service_history-1774706099517.jpeg?ixlib=js-3.8.0&auto=format&s=bf1f89b13273e017243bacb42cae2e38 saved to cache
2026-03-29 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item add0d574-9e06-526b-bf85-98b70d4b6228
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a82450>
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a272b773-4897-52f0-8f24-0b30e85a5174/a272b773-4897-52f0-8f24-0b30e85a5174_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5984%252F11675984%252Finterior_rear_seats-1774709380744.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5984/11675984/interior_rear_seats-1774709380744.jpg saved to cache
2026-03-29 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a272b773-4897-52f0-8f24-0b30e85a5174
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65886af90>
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a272b773-4897-52f0-8f24-0b30e85a5174/a272b773-4897-52f0-8f24-0b30e85a5174_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5984%252F11675984%252Finterior_boot-1774709441217.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5984/11675984/interior_boot-1774709441217.jpg saved to cache
2026-03-29 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a272b773-4897-52f0-8f24-0b30e85a5174
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e2e0d0>
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add0d574-9e06-526b-bf85-98b70d4b6228/add0d574-9e06-526b-bf85-98b70d4b6228_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2969%252F19442969%252Fdocs_service_history-1774706077576.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6cbc4033a14d028b6a3ffeab3f32d354') HTTP/1.1" 204 0
2026-03-29 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2969/19442969/docs_service_history-1774706077576.jpeg?ixlib=js-3.8.0&auto=format&s=6cbc4033a14d028b6a3ffeab3f32d354 saved to cache
2026-03-29 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item add0d574-9e06-526b-bf85-98b70d4b6228
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:13:02 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00S\xd5\x13\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03\xf33\x00S\xcb#\x00\x00\x00\x00'
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65830d390>
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add0d574-9e06-526b-bf85-98b70d4b6228/add0d574-9e06-526b-bf85-98b70d4b6228_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2969%252F19442969%252Finterior_boot-1774705408329.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2969/19442969/interior_boot-1774705408329.jpeg saved to cache
2026-03-29 20:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item add0d574-9e06-526b-bf85-98b70d4b6228
2026-03-29 20:13:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0 with identifier: 20500024
2026-03-29 20:13:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0 with identifier: 20500024
2026-03-29 20:13:03 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0 with identifier: 20500024 to the API
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0024/20500024/exterior_rear_driver-1774783575801.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NK67 CWV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20500024',
'listing': 'auction',
'location': 'North Lincolnshire Brigg',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 34000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0/c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1357454,
'Height': 2390,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0024/20500024/exterior_front_driver-1774783571204.jpg',
'Width': 3186},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0/c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1751788,
'Height': 2789,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0024/20500024/exterior_rear_driver-1774783575801.jpg',
'Width': 3719},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0/c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1608451,
'Height': 2374,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0024/20500024/exterior_front_passenger-1774783580502.jpg',
'Width': 3165},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0/c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1309870,
'Height': 2274,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0024/20500024/exterior_rear_passenger-1774783562964.jpg',
'Width': 3032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0/c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2757096,
'Height': 2887,
'OriginUrl': 'https://motorway-photos.imgix.net/0024/20500024/interior_front_seats-1774783868847.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0/c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2582254,
'Height': 2887,
'OriginUrl': 'https://motorway-photos.imgix.net/0024/20500024/interior_rear_seats-1774783858522.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0/c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2680370,
'Height': 2887,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0024/20500024/interior_dashboard-1774783875434.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0/c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2932837,
'Height': 2887,
'OriginUrl': 'https://motorway-photos.imgix.net/0024/20500024/interior_boot-1774783853421.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0/c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2201457,
'Height': 2887,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0024/20500024/docs_service_history-1774784907937.jpg?ixlib=js-3.8.0&auto=format&s=bff4074b8123f558babd06a12ad93678',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0/c820c2f6-6b8b-5030-9ef0-1eb3e7cc0df0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1945791,
'Height': 2887,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0024/20500024/docs_service_history-1774784922718.jpg?ixlib=js-3.8.0&auto=format&s=5c3e7141de0bcbb5861850f00edb656f',
'Width': 3840}],
'price': 11732,
'price_includes_vat': False,
'registration_date': '2017-10-11',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Caddy Maxi C20 Life TDI',
'transmission': 'manual',
'trim': 'Maxi C20 Life TDI',
'vin': 'WV2ZZZ2KZJX029989',
'year': 2017}
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720500024%27 HTTP/1.1" 200 None
2026-03-29 20:13:03 [motorway.uk] INFO: Saving data for 20500024: {'created_time': 1774815183.307995, 'last_price_update_time': 1774815183.308008, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20500024') HTTP/1.1" 204 0
2026-03-29 20:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2969/19442969/exterior_rear_passenger-1774705197622.jpeg> (referer: None)
2026-03-29 20:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5984/11675984/exterior_rear_passenger-1774709115901.jpg> (referer: None)
2026-03-29 20:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2969/19442969/exterior_rear_driver-1774705216435.jpeg> (referer: None)
2026-03-29 20:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2969/19442969/exterior_front_passenger-1774705184106.jpeg> (referer: None)
2026-03-29 20:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5984/11675984/exterior_front_passenger-1774709125496.jpg> (referer: None)
2026-03-29 20:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2374/19912374/docs_service_history-1774707262737.jpg?ixlib=js-3.8.0&auto=format&s=86d7c57c00432b3abb0d9d79f935b79b> (referer: None)
2026-03-29 20:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3235/20303235/docs_service_history-1774698538718.jpg?ixlib=js-3.8.0&auto=format&s=9204963b6d7fb2d1681676499cf4d7a4> (referer: None)
2026-03-29 20:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2969/19442969/interior_front_seats-1774705229868.jpeg> (referer: None)
2026-03-29 20:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5984/11675984/interior_front_seats-1774709372945.jpg> (referer: None)
2026-03-29 20:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2969/19442969/interior_dashboard-1774705439824.jpeg> (referer: None)
2026-03-29 20:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2969/19442969/interior_rear_seats-1774705354852.jpeg> (referer: None)
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c179d0>
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add0d574-9e06-526b-bf85-98b70d4b6228/add0d574-9e06-526b-bf85-98b70d4b6228_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2969%252F19442969%252Fexterior_rear_passenger-1774705197622.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2969/19442969/exterior_rear_passenger-1774705197622.jpeg saved to cache
2026-03-29 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item add0d574-9e06-526b-bf85-98b70d4b6228
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583e5a50>
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a272b773-4897-52f0-8f24-0b30e85a5174/a272b773-4897-52f0-8f24-0b30e85a5174_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5984%252F11675984%252Fexterior_rear_passenger-1774709115901.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5984/11675984/exterior_rear_passenger-1774709115901.jpg saved to cache
2026-03-29 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a272b773-4897-52f0-8f24-0b30e85a5174
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65884b310>
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add0d574-9e06-526b-bf85-98b70d4b6228/add0d574-9e06-526b-bf85-98b70d4b6228_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2969%252F19442969%252Fexterior_rear_driver-1774705216435.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2969/19442969/exterior_rear_driver-1774705216435.jpeg saved to cache
2026-03-29 20:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item add0d574-9e06-526b-bf85-98b70d4b6228
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659bc8090>
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add0d574-9e06-526b-bf85-98b70d4b6228/add0d574-9e06-526b-bf85-98b70d4b6228_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2969%252F19442969%252Fexterior_front_passenger-1774705184106.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2969/19442969/exterior_front_passenger-1774705184106.jpeg saved to cache
2026-03-29 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item add0d574-9e06-526b-bf85-98b70d4b6228
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583e4f50>
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a272b773-4897-52f0-8f24-0b30e85a5174/a272b773-4897-52f0-8f24-0b30e85a5174_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5984%252F11675984%252Fexterior_front_passenger-1774709125496.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5984/11675984/exterior_front_passenger-1774709125496.jpg saved to cache
2026-03-29 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a272b773-4897-52f0-8f24-0b30e85a5174
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586aecd0>
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_671a5767-dd47-5515-92bc-3cdc280ca216/671a5767-dd47-5515-92bc-3cdc280ca216_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2374%252F19912374%252Fdocs_service_history-1774707262737.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D86d7c57c00432b3abb0d9d79f935b79b') HTTP/1.1" 204 0
2026-03-29 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2374/19912374/docs_service_history-1774707262737.jpg?ixlib=js-3.8.0&auto=format&s=86d7c57c00432b3abb0d9d79f935b79b saved to cache
2026-03-29 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 671a5767-dd47-5515-92bc-3cdc280ca216
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b0d010>
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10e3a9b8-acc5-5715-bc74-bf5729b13faf/10e3a9b8-acc5-5715-bc74-bf5729b13faf_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3235%252F20303235%252Fdocs_service_history-1774698538718.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9204963b6d7fb2d1681676499cf4d7a4') HTTP/1.1" 204 0
2026-03-29 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3235/20303235/docs_service_history-1774698538718.jpg?ixlib=js-3.8.0&auto=format&s=9204963b6d7fb2d1681676499cf4d7a4 saved to cache
2026-03-29 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 10e3a9b8-acc5-5715-bc74-bf5729b13faf
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00=ea\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xed\xbc\x00=[q\x00\x00\x00\x00'
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65884a090>
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add0d574-9e06-526b-bf85-98b70d4b6228/add0d574-9e06-526b-bf85-98b70d4b6228_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2969%252F19442969%252Finterior_front_seats-1774705229868.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2969/19442969/interior_front_seats-1774705229868.jpeg saved to cache
2026-03-29 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item add0d574-9e06-526b-bf85-98b70d4b6228
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b0d410>
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a272b773-4897-52f0-8f24-0b30e85a5174/a272b773-4897-52f0-8f24-0b30e85a5174_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5984%252F11675984%252Finterior_front_seats-1774709372945.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5984/11675984/interior_front_seats-1774709372945.jpg saved to cache
2026-03-29 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a272b773-4897-52f0-8f24-0b30e85a5174
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x004\xf7\x10\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03\x087\x004\xed \x00\x00\x00\x00'
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65884b210>
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add0d574-9e06-526b-bf85-98b70d4b6228/add0d574-9e06-526b-bf85-98b70d4b6228_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2969%252F19442969%252Finterior_dashboard-1774705439824.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2969/19442969/interior_dashboard-1774705439824.jpeg saved to cache
2026-03-29 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item add0d574-9e06-526b-bf85-98b70d4b6228
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:13:04 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00@\x80G\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xae/\x00@vW\x00\x00\x00\x00'
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d31b50>
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_add0d574-9e06-526b-bf85-98b70d4b6228/add0d574-9e06-526b-bf85-98b70d4b6228_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2969%252F19442969%252Finterior_rear_seats-1774705354852.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2969/19442969/interior_rear_seats-1774705354852.jpeg saved to cache
2026-03-29 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item add0d574-9e06-526b-bf85-98b70d4b6228
2026-03-29 20:13:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: add0d574-9e06-526b-bf85-98b70d4b6228, skipping ID generation
2026-03-29 20:13:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item add0d574-9e06-526b-bf85-98b70d4b6228 with scrape type 1
2026-03-29 20:13:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item add0d574-9e06-526b-bf85-98b70d4b6228 sending to next pipeline
2026-03-29 20:13:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: add0d574-9e06-526b-bf85-98b70d4b6228, identifier: 19442969
2026-03-29 20:13:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: add0d574-9e06-526b-bf85-98b70d4b6228 with identifier: 19442969
2026-03-29 20:13:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: add0d574-9e06-526b-bf85-98b70d4b6228 with identifier: 19442969
2026-03-29 20:13:05 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: add0d574-9e06-526b-bf85-98b70d4b6228 with identifier: 19442969 to the API
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/2969/19442969/interior_rear_seats-1774705354852.jpeg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'add0d574-9e06-526b-bf85-98b70d4b6228',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GP16 AUK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19442969',
'listing': 'auction',
'location': 'West Sussex Worthing',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 63734,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 32,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add0d574-9e06-526b-bf85-98b70d4b6228/add0d574-9e06-526b-bf85-98b70d4b6228_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1314496,
'Height': 2172,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2969/19442969/exterior_front_driver-1774705169073.jpeg',
'Width': 2896},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add0d574-9e06-526b-bf85-98b70d4b6228/add0d574-9e06-526b-bf85-98b70d4b6228_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1796843,
'Height': 2707,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2969/19442969/exterior_rear_driver-1774705216435.jpeg',
'Width': 3609},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add0d574-9e06-526b-bf85-98b70d4b6228/add0d574-9e06-526b-bf85-98b70d4b6228_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2006376,
'Height': 2993,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2969/19442969/exterior_front_passenger-1774705184106.jpeg',
'Width': 3990},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add0d574-9e06-526b-bf85-98b70d4b6228/add0d574-9e06-526b-bf85-98b70d4b6228_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1362099,
'Height': 2582,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2969/19442969/exterior_rear_passenger-1774705197622.jpeg',
'Width': 3442},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add0d574-9e06-526b-bf85-98b70d4b6228/add0d574-9e06-526b-bf85-98b70d4b6228_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4215581,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2969/19442969/interior_front_seats-1774705229868.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add0d574-9e06-526b-bf85-98b70d4b6228/add0d574-9e06-526b-bf85-98b70d4b6228_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4402806,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2969/19442969/interior_rear_seats-1774705354852.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add0d574-9e06-526b-bf85-98b70d4b6228/add0d574-9e06-526b-bf85-98b70d4b6228_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3669831,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2969/19442969/interior_dashboard-1774705439824.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add0d574-9e06-526b-bf85-98b70d4b6228/add0d574-9e06-526b-bf85-98b70d4b6228_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 5752902,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2969/19442969/interior_boot-1774705408329.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add0d574-9e06-526b-bf85-98b70d4b6228/add0d574-9e06-526b-bf85-98b70d4b6228_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3596434,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2969/19442969/docs_service_history-1774706077576.jpeg?ixlib=js-3.8.0&auto=format&s=6cbc4033a14d028b6a3ffeab3f32d354',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_add0d574-9e06-526b-bf85-98b70d4b6228/add0d574-9e06-526b-bf85-98b70d4b6228_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1672718,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2969/19442969/docs_service_history-1774706099517.jpeg?ixlib=js-3.8.0&auto=format&s=bf1f89b13273e017243bacb42cae2e38',
'Width': 4032}],
'price': 6686,
'price_includes_vat': False,
'registration_date': '2016-07-11',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Polo Match TSI S-A',
'transmission': 'automatic',
'trim': 'Match TSI S-A',
'vin': 'WVWZZZ6RZGU069810',
'year': 2016}
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719442969%27 HTTP/1.1" 200 None
2026-03-29 20:13:05 [motorway.uk] INFO: Saving data for 19442969: {'created_time': 1774815185.486226, 'last_price_update_time': 1774815185.486238, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19442969') HTTP/1.1" 204 0
2026-03-29 20:13:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2374/19912374/interior_boot-1774706544212.jpg> (referer: None)
2026-03-29 20:13:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5984/11675984/exterior_rear_driver-1774709104494.jpg> (referer: None)
2026-03-29 20:13:05 [scrapy.extensions.logstats] INFO: Crawled 119 pages (at 43 pages/min), scraped 53 items (at 20 items/min)
2026-03-29 20:13:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 252MiB
2026-03-29 20:13:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2374/19912374/interior_rear_seats-1774706543264.jpg> (referer: None)
2026-03-29 20:13:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9543/20459543/docs_service_history-1774709871705.jpg?ixlib=js-3.8.0&auto=format&s=13394364eb795dd7028a8034623e682e> (referer: None)
2026-03-29 20:13:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3235/20303235/interior_rear_seats-1774697809343.jpg> (referer: None)
2026-03-29 20:13:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3235/20303235/interior_boot-1774697720462.jpg> (referer: None)
2026-03-29 20:13:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9543/20459543/interior_boot-1774692642364.jpg> (referer: None)
2026-03-29 20:13:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2374/19912374/exterior_front_passenger-1774709057885.jpg> (referer: None)
2026-03-29 20:13:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a70910>
2026-03-29 20:13:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_671a5767-dd47-5515-92bc-3cdc280ca216/671a5767-dd47-5515-92bc-3cdc280ca216_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2374%252F19912374%252Finterior_boot-1774706544212.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2374/19912374/interior_boot-1774706544212.jpg saved to cache
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 671a5767-dd47-5515-92bc-3cdc280ca216
2026-03-29 20:13:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e25f50>
2026-03-29 20:13:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a272b773-4897-52f0-8f24-0b30e85a5174/a272b773-4897-52f0-8f24-0b30e85a5174_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5984%252F11675984%252Fexterior_rear_driver-1774709104494.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5984/11675984/exterior_rear_driver-1774709104494.jpg saved to cache
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a272b773-4897-52f0-8f24-0b30e85a5174
2026-03-29 20:13:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a272b773-4897-52f0-8f24-0b30e85a5174, skipping ID generation
2026-03-29 20:13:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a272b773-4897-52f0-8f24-0b30e85a5174 with scrape type 1
2026-03-29 20:13:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a272b773-4897-52f0-8f24-0b30e85a5174 sending to next pipeline
2026-03-29 20:13:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a272b773-4897-52f0-8f24-0b30e85a5174, identifier: 11675984
2026-03-29 20:13:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a272b773-4897-52f0-8f24-0b30e85a5174 with identifier: 11675984
2026-03-29 20:13:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a272b773-4897-52f0-8f24-0b30e85a5174 with identifier: 11675984
2026-03-29 20:13:06 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a272b773-4897-52f0-8f24-0b30e85a5174 with identifier: 11675984 to the API
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5984/11675984/exterior_rear_driver-1774709104494.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.7L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'a272b773-4897-52f0-8f24-0b30e85a5174',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LS18 MDZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/11675984',
'listing': 'auction',
'location': 'Hertfordshire St Albans',
'make': 'Kia',
'model': 'Sportage',
'odometer': 82038,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a272b773-4897-52f0-8f24-0b30e85a5174/a272b773-4897-52f0-8f24-0b30e85a5174_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2121835,
'Height': 2888,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5984/11675984/exterior_front_driver-1774709086387.jpg',
'Width': 3850},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a272b773-4897-52f0-8f24-0b30e85a5174/a272b773-4897-52f0-8f24-0b30e85a5174_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1730748,
'Height': 2699,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5984/11675984/exterior_rear_driver-1774709104494.jpg',
'Width': 3599},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a272b773-4897-52f0-8f24-0b30e85a5174/a272b773-4897-52f0-8f24-0b30e85a5174_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2053092,
'Height': 2831,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5984/11675984/exterior_front_passenger-1774709125496.jpg',
'Width': 3774},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a272b773-4897-52f0-8f24-0b30e85a5174/a272b773-4897-52f0-8f24-0b30e85a5174_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1723111,
'Height': 2607,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5984/11675984/exterior_rear_passenger-1774709115901.jpg',
'Width': 3476},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a272b773-4897-52f0-8f24-0b30e85a5174/a272b773-4897-52f0-8f24-0b30e85a5174_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3424905,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5984/11675984/interior_front_seats-1774709372945.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a272b773-4897-52f0-8f24-0b30e85a5174/a272b773-4897-52f0-8f24-0b30e85a5174_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3023371,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5984/11675984/interior_rear_seats-1774709380744.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a272b773-4897-52f0-8f24-0b30e85a5174/a272b773-4897-52f0-8f24-0b30e85a5174_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2571764,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5984/11675984/interior_dashboard-1774710766050.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a272b773-4897-52f0-8f24-0b30e85a5174/a272b773-4897-52f0-8f24-0b30e85a5174_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3624807,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5984/11675984/interior_boot-1774709441217.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a272b773-4897-52f0-8f24-0b30e85a5174/a272b773-4897-52f0-8f24-0b30e85a5174_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1520943,
'Height': 5712,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5984/11675984/docs_service_history-1774709471442.jpg?ixlib=js-3.8.0&auto=format&s=1b4d0026d1aa3c85bb3283e382a87a05',
'Width': 4284},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a272b773-4897-52f0-8f24-0b30e85a5174/a272b773-4897-52f0-8f24-0b30e85a5174_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1815211,
'Height': 5712,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5984/11675984/docs_service_history-1774709476607.jpg?ixlib=js-3.8.0&auto=format&s=f9cd1651cc3e5750c49d9814a90072c2',
'Width': 4284}],
'price': 7028,
'price_includes_vat': False,
'registration_date': '2018-03-29',
'seats_number': None,
'seller_name': None,
'title': 'Kia Sportage GT-LINE CRDI ISG',
'transmission': 'manual',
'trim': 'GT-LINE CRDI ISG',
'vin': 'U5YPK815LJL458950',
'year': 2018}
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711675984%27 HTTP/1.1" 200 None
2026-03-29 20:13:06 [motorway.uk] INFO: Saving data for 11675984: {'created_time': 1774815186.45777, 'last_price_update_time': 1774815186.45778, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='11675984') HTTP/1.1" 204 0
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e07d50>
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_671a5767-dd47-5515-92bc-3cdc280ca216/671a5767-dd47-5515-92bc-3cdc280ca216_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2374%252F19912374%252Finterior_rear_seats-1774706543264.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2374/19912374/interior_rear_seats-1774706543264.jpg saved to cache
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 671a5767-dd47-5515-92bc-3cdc280ca216
2026-03-29 20:13:06 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:13:06 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:13:06 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00%\x82\xfa\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xee\xfa\x00%h\xfa\x00\x00\x00\x00'
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599d56d0>
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf/a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf_image_9.mpo HTTP/1.1" 201 0
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9543%252F20459543%252Fdocs_service_history-1774709871705.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D13394364eb795dd7028a8034623e682e') HTTP/1.1" 204 0
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9543/20459543/docs_service_history-1774709871705.jpg?ixlib=js-3.8.0&auto=format&s=13394364eb795dd7028a8034623e682e saved to cache
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e2af90>
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10e3a9b8-acc5-5715-bc74-bf5729b13faf/10e3a9b8-acc5-5715-bc74-bf5729b13faf_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3235%252F20303235%252Finterior_rear_seats-1774697809343.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3235/20303235/interior_rear_seats-1774697809343.jpg saved to cache
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 10e3a9b8-acc5-5715-bc74-bf5729b13faf
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a90b10>
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10e3a9b8-acc5-5715-bc74-bf5729b13faf/10e3a9b8-acc5-5715-bc74-bf5729b13faf_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3235%252F20303235%252Finterior_boot-1774697720462.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3235/20303235/interior_boot-1774697720462.jpg saved to cache
2026-03-29 20:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 10e3a9b8-acc5-5715-bc74-bf5729b13faf
2026-03-29 20:13:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:13:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a39990>
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf/a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9543%252F20459543%252Finterior_boot-1774692642364.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9543/20459543/interior_boot-1774692642364.jpg saved to cache
2026-03-29 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a39fd0>
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_671a5767-dd47-5515-92bc-3cdc280ca216/671a5767-dd47-5515-92bc-3cdc280ca216_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2374%252F19912374%252Fexterior_front_passenger-1774709057885.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2374/19912374/exterior_front_passenger-1774709057885.jpg saved to cache
2026-03-29 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 671a5767-dd47-5515-92bc-3cdc280ca216
2026-03-29 20:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2374/19912374/exterior_rear_passenger-1774705769478.jpg> (referer: None)
2026-03-29 20:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2374/19912374/exterior_rear_driver-1774705766296.jpg> (referer: None)
2026-03-29 20:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3235/20303235/exterior_front_passenger-1774696547417.jpg> (referer: None)
2026-03-29 20:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3235/20303235/exterior_rear_passenger-1774696551402.jpg> (referer: None)
2026-03-29 20:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2374/19912374/interior_front_seats-1774706717408.jpg> (referer: None)
2026-03-29 20:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3235/20303235/interior_front_seats-1774697805911.jpg> (referer: None)
2026-03-29 20:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9543/20459543/instrument_cluster-1774692512435.jpg> (referer: None)
2026-03-29 20:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9543/20459543/interior_rear_seats-1774692515319.jpg> (referer: None)
2026-03-29 20:13:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9543/20459543/interior_dashboard-1774692579324.jpg> (referer: None)
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e11fd0>
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_671a5767-dd47-5515-92bc-3cdc280ca216/671a5767-dd47-5515-92bc-3cdc280ca216_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2374%252F19912374%252Fexterior_rear_passenger-1774705769478.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2374/19912374/exterior_rear_passenger-1774705769478.jpg saved to cache
2026-03-29 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 671a5767-dd47-5515-92bc-3cdc280ca216
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a24c90>
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_671a5767-dd47-5515-92bc-3cdc280ca216/671a5767-dd47-5515-92bc-3cdc280ca216_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2374%252F19912374%252Fexterior_rear_driver-1774705766296.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2374/19912374/exterior_rear_driver-1774705766296.jpg saved to cache
2026-03-29 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 671a5767-dd47-5515-92bc-3cdc280ca216
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659aa6310>
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10e3a9b8-acc5-5715-bc74-bf5729b13faf/10e3a9b8-acc5-5715-bc74-bf5729b13faf_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3235%252F20303235%252Fexterior_front_passenger-1774696547417.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3235/20303235/exterior_front_passenger-1774696547417.jpg saved to cache
2026-03-29 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 10e3a9b8-acc5-5715-bc74-bf5729b13faf
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658815c50>
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10e3a9b8-acc5-5715-bc74-bf5729b13faf/10e3a9b8-acc5-5715-bc74-bf5729b13faf_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3235%252F20303235%252Fexterior_rear_passenger-1774696551402.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3235/20303235/exterior_rear_passenger-1774696551402.jpg saved to cache
2026-03-29 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 10e3a9b8-acc5-5715-bc74-bf5729b13faf
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6588b16d0>
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_671a5767-dd47-5515-92bc-3cdc280ca216/671a5767-dd47-5515-92bc-3cdc280ca216_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2374%252F19912374%252Finterior_front_seats-1774706717408.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2374/19912374/interior_front_seats-1774706717408.jpg saved to cache
2026-03-29 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 671a5767-dd47-5515-92bc-3cdc280ca216
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65876c550>
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10e3a9b8-acc5-5715-bc74-bf5729b13faf/10e3a9b8-acc5-5715-bc74-bf5729b13faf_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3235%252F20303235%252Finterior_front_seats-1774697805911.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3235/20303235/interior_front_seats-1774697805911.jpg saved to cache
2026-03-29 20:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 10e3a9b8-acc5-5715-bc74-bf5729b13faf
2026-03-29 20:13:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:13:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ce2810>
2026-03-29 20:13:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf/a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9543%252F20459543%252Finstrument_cluster-1774692512435.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9543/20459543/instrument_cluster-1774692512435.jpg saved to cache
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf
2026-03-29 20:13:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:13:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ce3250>
2026-03-29 20:13:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf/a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9543%252F20459543%252Finterior_rear_seats-1774692515319.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9543/20459543/interior_rear_seats-1774692515319.jpg saved to cache
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf
2026-03-29 20:13:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:13:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6588b2d90>
2026-03-29 20:13:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf/a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9543%252F20459543%252Finterior_dashboard-1774692579324.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9543/20459543/interior_dashboard-1774692579324.jpg saved to cache
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf
2026-03-29 20:13:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3235/20303235/exterior_front_driver-1774696554495.jpg> (referer: None)
2026-03-29 20:13:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2374/19912374/exterior_front_driver-1774709045750.jpg> (referer: None)
2026-03-29 20:13:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9543/20459543/exterior_front_driver-1774691813699.jpg> (referer: None)
2026-03-29 20:13:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9819/18209819/exterior_front_passenger-1774702423489.jpg> (referer: None)
2026-03-29 20:13:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3235/20303235/exterior_rear_driver-1774696561759.jpg> (referer: None)
2026-03-29 20:13:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9543/20459543/exterior_rear_passenger-1774691861345.jpg> (referer: None)
2026-03-29 20:13:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0653/19350653/exterior_rear_driver-1774708045589.jpeg> (referer: None)
2026-03-29 20:13:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9543/20459543/exterior_front_passenger-1774691888562.jpg> (referer: None)
2026-03-29 20:13:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0653/19350653/exterior_front_driver-1774707977414.jpeg> (referer: None)
2026-03-29 20:13:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598f1250>
2026-03-29 20:13:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10e3a9b8-acc5-5715-bc74-bf5729b13faf/10e3a9b8-acc5-5715-bc74-bf5729b13faf_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3235%252F20303235%252Fexterior_front_driver-1774696554495.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3235/20303235/exterior_front_driver-1774696554495.jpg saved to cache
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 10e3a9b8-acc5-5715-bc74-bf5729b13faf
2026-03-29 20:13:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f07e90>
2026-03-29 20:13:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_671a5767-dd47-5515-92bc-3cdc280ca216/671a5767-dd47-5515-92bc-3cdc280ca216_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2374%252F19912374%252Fexterior_front_driver-1774709045750.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2374/19912374/exterior_front_driver-1774709045750.jpg saved to cache
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 671a5767-dd47-5515-92bc-3cdc280ca216
2026-03-29 20:13:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 671a5767-dd47-5515-92bc-3cdc280ca216, skipping ID generation
2026-03-29 20:13:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 671a5767-dd47-5515-92bc-3cdc280ca216 with scrape type 1
2026-03-29 20:13:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 671a5767-dd47-5515-92bc-3cdc280ca216 sending to next pipeline
2026-03-29 20:13:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 671a5767-dd47-5515-92bc-3cdc280ca216, identifier: 19912374
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599d5310>
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf/a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9543%252F20459543%252Fexterior_front_driver-1774691813699.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9543/20459543/exterior_front_driver-1774691813699.jpg saved to cache
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a901d0>
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cca5df33-6a60-53e3-961b-d951d985732a/cca5df33-6a60-53e3-961b-d951d985732a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9819%252F18209819%252Fexterior_front_passenger-1774702423489.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9819/18209819/exterior_front_passenger-1774702423489.jpg saved to cache
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cca5df33-6a60-53e3-961b-d951d985732a
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65869b6d0>
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10e3a9b8-acc5-5715-bc74-bf5729b13faf/10e3a9b8-acc5-5715-bc74-bf5729b13faf_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3235%252F20303235%252Fexterior_rear_driver-1774696561759.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3235/20303235/exterior_rear_driver-1774696561759.jpg saved to cache
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 10e3a9b8-acc5-5715-bc74-bf5729b13faf
2026-03-29 20:13:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10e3a9b8-acc5-5715-bc74-bf5729b13faf, skipping ID generation
2026-03-29 20:13:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10e3a9b8-acc5-5715-bc74-bf5729b13faf with scrape type 1
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 10e3a9b8-acc5-5715-bc74-bf5729b13faf sending to next pipeline
2026-03-29 20:13:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 10e3a9b8-acc5-5715-bc74-bf5729b13faf, identifier: 20303235
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658439350>
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf/a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9543%252F20459543%252Fexterior_rear_passenger-1774691861345.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9543/20459543/exterior_rear_passenger-1774691861345.jpg saved to cache
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e2a090>
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e605385-79fa-5e27-a9ea-1b06982d245c/1e605385-79fa-5e27-a9ea-1b06982d245c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0653%252F19350653%252Fexterior_rear_driver-1774708045589.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0653/19350653/exterior_rear_driver-1774708045589.jpeg saved to cache
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1e605385-79fa-5e27-a9ea-1b06982d245c
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ce0d90>
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf/a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9543%252F20459543%252Fexterior_front_passenger-1774691888562.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9543/20459543/exterior_front_passenger-1774691888562.jpg saved to cache
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b63910>
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e605385-79fa-5e27-a9ea-1b06982d245c/1e605385-79fa-5e27-a9ea-1b06982d245c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0653%252F19350653%252Fexterior_front_driver-1774707977414.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0653/19350653/exterior_front_driver-1774707977414.jpeg saved to cache
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e605385-79fa-5e27-a9ea-1b06982d245c
2026-03-29 20:13:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e605385-79fa-5e27-a9ea-1b06982d245c, skipping ID generation
2026-03-29 20:13:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e605385-79fa-5e27-a9ea-1b06982d245c with scrape type 1
2026-03-29 20:13:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e605385-79fa-5e27-a9ea-1b06982d245c sending to next pipeline
2026-03-29 20:13:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 1e605385-79fa-5e27-a9ea-1b06982d245c, identifier: 19350653
2026-03-29 20:13:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 671a5767-dd47-5515-92bc-3cdc280ca216 with identifier: 19912374
2026-03-29 20:13:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 671a5767-dd47-5515-92bc-3cdc280ca216 with identifier: 19912374
2026-03-29 20:13:10 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 671a5767-dd47-5515-92bc-3cdc280ca216 with identifier: 19912374 to the API
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/2374/19912374/exterior_front_driver-1774709045750.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '671a5767-dd47-5515-92bc-3cdc280ca216',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GL71 UOW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19912374',
'listing': 'auction',
'location': 'Neath Port Talbot Neath',
'make': 'Peugeot',
'model': 'Expert',
'odometer': 32745,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_671a5767-dd47-5515-92bc-3cdc280ca216/671a5767-dd47-5515-92bc-3cdc280ca216_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1840616,
'Height': 2372,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2374/19912374/exterior_front_driver-1774709045750.jpg',
'Width': 3163},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_671a5767-dd47-5515-92bc-3cdc280ca216/671a5767-dd47-5515-92bc-3cdc280ca216_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 842302,
'Height': 1950,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2374/19912374/exterior_rear_driver-1774705766296.jpg',
'Width': 2600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_671a5767-dd47-5515-92bc-3cdc280ca216/671a5767-dd47-5515-92bc-3cdc280ca216_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1311552,
'Height': 2124,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2374/19912374/exterior_front_passenger-1774709057885.jpg',
'Width': 2832},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_671a5767-dd47-5515-92bc-3cdc280ca216/671a5767-dd47-5515-92bc-3cdc280ca216_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 829469,
'Height': 1868,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2374/19912374/exterior_rear_passenger-1774705769478.jpg',
'Width': 2491},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_671a5767-dd47-5515-92bc-3cdc280ca216/671a5767-dd47-5515-92bc-3cdc280ca216_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2582146,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/2374/19912374/interior_front_seats-1774706717408.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_671a5767-dd47-5515-92bc-3cdc280ca216/671a5767-dd47-5515-92bc-3cdc280ca216_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2385884,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/2374/19912374/interior_rear_seats-1774706543264.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_671a5767-dd47-5515-92bc-3cdc280ca216/671a5767-dd47-5515-92bc-3cdc280ca216_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1606200,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2374/19912374/interior_dashboard-1774706555803.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_671a5767-dd47-5515-92bc-3cdc280ca216/671a5767-dd47-5515-92bc-3cdc280ca216_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 866447,
'Height': 1977,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2374/19912374/instrument_cluster-1774708721440.jpg',
'Width': 2636},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_671a5767-dd47-5515-92bc-3cdc280ca216/671a5767-dd47-5515-92bc-3cdc280ca216_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2659073,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/2374/19912374/interior_boot-1774706544212.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_671a5767-dd47-5515-92bc-3cdc280ca216/671a5767-dd47-5515-92bc-3cdc280ca216_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2147612,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2374/19912374/docs_service_history-1774707262737.jpg?ixlib=js-3.8.0&auto=format&s=86d7c57c00432b3abb0d9d79f935b79b',
'Width': 2880}],
'price': 14850,
'price_includes_vat': False,
'registration_date': '2021-12-30',
'seats_number': None,
'seller_name': None,
'title': 'Peugeot Expert Prof Premium L1 B-HDI',
'transmission': 'manual',
'trim': 'Prof Premium L1 B-HDI',
'vin': 'VF3VFEHTMM7863629',
'year': 2021}
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719912374%27 HTTP/1.1" 200 None
2026-03-29 20:13:10 [motorway.uk] INFO: Saving data for 19912374: {'created_time': 1774815190.360009, 'last_price_update_time': 1774815190.36002, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19912374') HTTP/1.1" 204 0
2026-03-29 20:13:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 10e3a9b8-acc5-5715-bc74-bf5729b13faf with identifier: 20303235
2026-03-29 20:13:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 10e3a9b8-acc5-5715-bc74-bf5729b13faf with identifier: 20303235
2026-03-29 20:13:10 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 10e3a9b8-acc5-5715-bc74-bf5729b13faf with identifier: 20303235 to the API
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3235/20303235/exterior_rear_driver-1774696561759.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '10e3a9b8-acc5-5715-bc74-bf5729b13faf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'KL05 HOG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20303235',
'listing': 'auction',
'location': 'North Yorkshire Thirsk',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 38802,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10e3a9b8-acc5-5715-bc74-bf5729b13faf/10e3a9b8-acc5-5715-bc74-bf5729b13faf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 899074,
'Height': 1866,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3235/20303235/exterior_front_driver-1774696554495.jpg',
'Width': 2488},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10e3a9b8-acc5-5715-bc74-bf5729b13faf/10e3a9b8-acc5-5715-bc74-bf5729b13faf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1611340,
'Height': 2608,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3235/20303235/exterior_rear_driver-1774696561759.jpg',
'Width': 3477},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10e3a9b8-acc5-5715-bc74-bf5729b13faf/10e3a9b8-acc5-5715-bc74-bf5729b13faf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 957838,
'Height': 2243,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3235/20303235/exterior_front_passenger-1774696547417.jpg',
'Width': 2990},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10e3a9b8-acc5-5715-bc74-bf5729b13faf/10e3a9b8-acc5-5715-bc74-bf5729b13faf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 919602,
'Height': 2171,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3235/20303235/exterior_rear_passenger-1774696551402.jpg',
'Width': 2895},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10e3a9b8-acc5-5715-bc74-bf5729b13faf/10e3a9b8-acc5-5715-bc74-bf5729b13faf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2129692,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/3235/20303235/interior_front_seats-1774697805911.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10e3a9b8-acc5-5715-bc74-bf5729b13faf/10e3a9b8-acc5-5715-bc74-bf5729b13faf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2545410,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/3235/20303235/interior_rear_seats-1774697809343.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10e3a9b8-acc5-5715-bc74-bf5729b13faf/10e3a9b8-acc5-5715-bc74-bf5729b13faf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2234842,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3235/20303235/20303235-interior_dashboard-modified-1774700665044.jpeg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10e3a9b8-acc5-5715-bc74-bf5729b13faf/10e3a9b8-acc5-5715-bc74-bf5729b13faf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1133190,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3235/20303235/instrument_cluster-1774697494945.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10e3a9b8-acc5-5715-bc74-bf5729b13faf/10e3a9b8-acc5-5715-bc74-bf5729b13faf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3015488,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/3235/20303235/interior_boot-1774697720462.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10e3a9b8-acc5-5715-bc74-bf5729b13faf/10e3a9b8-acc5-5715-bc74-bf5729b13faf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2161523,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3235/20303235/docs_service_history-1774698538718.jpg?ixlib=js-3.8.0&auto=format&s=9204963b6d7fb2d1681676499cf4d7a4',
'Width': 2880}],
'price': 17362,
'price_includes_vat': False,
'registration_date': '2020-12-22',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Range Rover Evoque R-DYNAMIC S A',
'transmission': 'automatic',
'trim': 'Evoque R-DYNAMIC S A',
'vin': 'SALZA2AX6LH115258',
'year': 2020}
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720303235%27 HTTP/1.1" 200 None
2026-03-29 20:13:10 [motorway.uk] INFO: Saving data for 20303235: {'created_time': 1774815190.751485, 'last_price_update_time': 1774815190.751502, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20303235') HTTP/1.1" 204 0
2026-03-29 20:13:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 1e605385-79fa-5e27-a9ea-1b06982d245c with identifier: 19350653
2026-03-29 20:13:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 1e605385-79fa-5e27-a9ea-1b06982d245c with identifier: 19350653
2026-03-29 20:13:10 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 1e605385-79fa-5e27-a9ea-1b06982d245c with identifier: 19350653 to the API
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0653/19350653/exterior_front_driver-1774707977414.jpeg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '1e605385-79fa-5e27-a9ea-1b06982d245c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YR19 KRW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19350653',
'listing': 'auction',
'location': 'Surrey Guildford',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 42000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e605385-79fa-5e27-a9ea-1b06982d245c/1e605385-79fa-5e27-a9ea-1b06982d245c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2486544,
'Height': 2697,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0653/19350653/exterior_front_driver-1774707977414.jpeg',
'Width': 3596},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e605385-79fa-5e27-a9ea-1b06982d245c/1e605385-79fa-5e27-a9ea-1b06982d245c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1859929,
'Height': 2579,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0653/19350653/exterior_rear_driver-1774708045589.jpeg',
'Width': 3439},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e605385-79fa-5e27-a9ea-1b06982d245c/1e605385-79fa-5e27-a9ea-1b06982d245c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2105187,
'Height': 2655,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0653/19350653/exterior_front_passenger-1774708003439.jpeg',
'Width': 3540},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e605385-79fa-5e27-a9ea-1b06982d245c/1e605385-79fa-5e27-a9ea-1b06982d245c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2442036,
'Height': 2761,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0653/19350653/exterior_rear_passenger-1774708025733.jpeg',
'Width': 3681},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e605385-79fa-5e27-a9ea-1b06982d245c/1e605385-79fa-5e27-a9ea-1b06982d245c_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3073131,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0653/19350653/interior_front_seats-1774708050975.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e605385-79fa-5e27-a9ea-1b06982d245c/1e605385-79fa-5e27-a9ea-1b06982d245c_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2949109,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0653/19350653/interior_rear_seats-1774709613117.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e605385-79fa-5e27-a9ea-1b06982d245c/1e605385-79fa-5e27-a9ea-1b06982d245c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1908604,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0653/19350653/interior_dashboard-1774708175965.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e605385-79fa-5e27-a9ea-1b06982d245c/1e605385-79fa-5e27-a9ea-1b06982d245c_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 1913804,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0653/19350653/instrument_cluster-1774708232674.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e605385-79fa-5e27-a9ea-1b06982d245c/1e605385-79fa-5e27-a9ea-1b06982d245c_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2837428,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0653/19350653/interior_boot-1774709647610.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e605385-79fa-5e27-a9ea-1b06982d245c/1e605385-79fa-5e27-a9ea-1b06982d245c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 166868,
'Height': 1218,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0653/19350653/docs_service_history-1774720924842.jpeg?ixlib=js-3.8.0&auto=format&s=ab814f090f2a553785ce5bc7271d314a',
'Width': 1600}],
'price': 11614,
'price_includes_vat': False,
'registration_date': '2019-07-31',
'seats_number': None,
'seller_name': None,
'title': 'Hyundai Tucson SE NAV T-GDi 2WD S-A',
'transmission': 'automatic',
'trim': 'SE NAV T-GDi 2WD S-A',
'vin': 'TMAJ3812VLJ907009',
'year': 2019}
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719350653%27 HTTP/1.1" 200 None
2026-03-29 20:13:11 [motorway.uk] INFO: Saving data for 19350653: {'created_time': 1774815191.111084, 'last_price_update_time': 1774815191.111097, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19350653') HTTP/1.1" 204 0
2026-03-29 20:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9543/20459543/interior_front_seats-1774692460819.jpg> (referer: None)
2026-03-29 20:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=504&page=14&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9819/18209819/exterior_rear_driver-1774702429605.jpg> (referer: None)
2026-03-29 20:13:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:13:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658439450>
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf/a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9543%252F20459543%252Finterior_front_seats-1774692460819.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9543/20459543/interior_front_seats-1774692460819.jpg saved to cache
2026-03-29 20:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf
2026-03-29 20:13:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf, skipping ID generation
2026-03-29 20:13:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf with scrape type 1
2026-03-29 20:13:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf sending to next pipeline
2026-03-29 20:13:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf, identifier: 20459543
2026-03-29 20:13:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf with identifier: 20459543
2026-03-29 20:13:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf with identifier: 20459543
2026-03-29 20:13:11 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf with identifier: 20459543 to the API
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/9543/20459543/interior_front_seats-1774692460819.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LC72 ZZP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20459543',
'listing': 'auction',
'location': 'Suffolk Diss',
'make': 'Mercedes',
'model': 'AMG',
'odometer': 21000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf/a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2838358,
'Height': 2997,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9543/20459543/exterior_front_driver-1774691813699.jpg',
'Width': 3996},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf/a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2547254,
'Height': 2829,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9543/20459543/exterior_rear_driver-1774691841146.jpg',
'Width': 3772},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf/a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2179313,
'Height': 2799,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9543/20459543/exterior_front_passenger-1774691888562.jpg',
'Width': 3732},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf/a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1687516,
'Height': 2396,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9543/20459543/exterior_rear_passenger-1774691861345.jpg',
'Width': 3195},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf/a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3666663,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9543/20459543/interior_front_seats-1774692460819.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf/a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3315060,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9543/20459543/interior_rear_seats-1774692515319.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf/a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3646103,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9543/20459543/interior_dashboard-1774692579324.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf/a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3089193,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9543/20459543/instrument_cluster-1774692512435.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf/a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4412480,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9543/20459543/interior_boot-1774692642364.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf/a427e6cb-3cd7-5b71-98ed-49c0b59a4cdf_image_9.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2585076,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9543/20459543/docs_service_history-1774709871705.jpg?ixlib=js-3.8.0&auto=format&s=13394364eb795dd7028a8034623e682e',
'Width': 4032}],
'price': 41509,
'price_includes_vat': False,
'registration_date': '2022-10-19',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes AMG GLC 43 Premium + 4MATIC A',
'transmission': 'automatic',
'trim': 'GLC 43 Premium + 4MATIC A',
'vin': 'W1N0J6EB6PG130241',
'year': 2022}
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720459543%27 HTTP/1.1" 200 None
2026-03-29 20:13:11 [motorway.uk] INFO: Saving data for 20459543: {'created_time': 1774815191.831725, 'last_price_update_time': 1774815191.831736, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20459543') HTTP/1.1" 204 0
2026-03-29 20:13:11 [motorway.uk] INFO: Found listing with ID: 20480434
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720480434%27 HTTP/1.1" 200 None
2026-03-29 20:13:11 [motorway.uk] INFO: Scrape type for 20480434: 1
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f86150>
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cca5df33-6a60-53e3-961b-d951d985732a/cca5df33-6a60-53e3-961b-d951d985732a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9819%252F18209819%252Fexterior_rear_driver-1774702429605.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9819/18209819/exterior_rear_driver-1774702429605.jpg saved to cache
2026-03-29 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cca5df33-6a60-53e3-961b-d951d985732a
2026-03-29 20:13:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cca5df33-6a60-53e3-961b-d951d985732a, skipping ID generation
2026-03-29 20:13:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cca5df33-6a60-53e3-961b-d951d985732a with scrape type 1
2026-03-29 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cca5df33-6a60-53e3-961b-d951d985732a sending to next pipeline
2026-03-29 20:13:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: cca5df33-6a60-53e3-961b-d951d985732a, identifier: 18209819
2026-03-29 20:13:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: cca5df33-6a60-53e3-961b-d951d985732a with identifier: 18209819
2026-03-29 20:13:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: cca5df33-6a60-53e3-961b-d951d985732a with identifier: 18209819
2026-03-29 20:13:12 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: cca5df33-6a60-53e3-961b-d951d985732a with identifier: 18209819 to the API
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9819/18209819/exterior_rear_driver-1774702429605.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'cca5df33-6a60-53e3-961b-d951d985732a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'WD69 UGK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18209819',
'listing': 'auction',
'location': 'East Sussex Bexhill-on-Sea',
'make': 'Peugeot',
'model': '3008',
'odometer': 51743,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cca5df33-6a60-53e3-961b-d951d985732a/cca5df33-6a60-53e3-961b-d951d985732a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1655659,
'Height': 2639,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9819/18209819/exterior_front_driver-1774702466630.jpg',
'Width': 3519},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cca5df33-6a60-53e3-961b-d951d985732a/cca5df33-6a60-53e3-961b-d951d985732a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1584368,
'Height': 2526,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9819/18209819/exterior_rear_driver-1774702429605.jpg',
'Width': 3368},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cca5df33-6a60-53e3-961b-d951d985732a/cca5df33-6a60-53e3-961b-d951d985732a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1581324,
'Height': 2656,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9819/18209819/exterior_front_passenger-1774702423489.jpg',
'Width': 3541},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cca5df33-6a60-53e3-961b-d951d985732a/cca5df33-6a60-53e3-961b-d951d985732a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1660182,
'Height': 2630,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9819/18209819/exterior_rear_passenger-1774702431339.jpg',
'Width': 3506},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cca5df33-6a60-53e3-961b-d951d985732a/cca5df33-6a60-53e3-961b-d951d985732a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2038874,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9819/18209819/interior_front_seats-1774702972601.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cca5df33-6a60-53e3-961b-d951d985732a/cca5df33-6a60-53e3-961b-d951d985732a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1977534,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9819/18209819/interior_rear_seats-1774702984849.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cca5df33-6a60-53e3-961b-d951d985732a/cca5df33-6a60-53e3-961b-d951d985732a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1670947,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9819/18209819/interior_dashboard-1774702990052.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cca5df33-6a60-53e3-961b-d951d985732a/cca5df33-6a60-53e3-961b-d951d985732a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1655549,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9819/18209819/instrument_cluster-1774702984863.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cca5df33-6a60-53e3-961b-d951d985732a/cca5df33-6a60-53e3-961b-d951d985732a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2322319,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9819/18209819/interior_boot-1774702980580.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cca5df33-6a60-53e3-961b-d951d985732a/cca5df33-6a60-53e3-961b-d951d985732a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2566595,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9819/18209819/docs_service_history-1774703178234.jpg?ixlib=js-3.8.0&auto=format&s=eb44e6fb0a3df0c8531e126cfad4275d',
'Width': 3840}],
'price': 11566,
'price_includes_vat': False,
'registration_date': '2020-01-31',
'seats_number': None,
'seller_name': None,
'title': 'Peugeot 3008 GT S/S PHEV 4X4 Auto',
'transmission': 'automatic',
'trim': 'GT S/S PHEV 4X4 Auto',
'vin': 'VF3M45GBUKS492395',
'year': 2020}
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718209819%27 HTTP/1.1" 200 None
2026-03-29 20:13:12 [motorway.uk] INFO: Saving data for 18209819: {'created_time': 1774815192.550804, 'last_price_update_time': 1774815192.550817, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18209819') HTTP/1.1" 204 0
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 20396926
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720396926%27 HTTP/1.1" 200 None
2026-03-29 20:13:12 [motorway.uk] INFO: Scrape type for 20396926: 1
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 10578729
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 20367865
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 20457058
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 19559218
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 19677086
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 20487346
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 20477373
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 17851318
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 20277040
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 20456360
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 18732558
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 5611886
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 20341222
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 14816704
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714816704%27 HTTP/1.1" 200 None
2026-03-29 20:13:12 [motorway.uk] INFO: Scrape type for 14816704: 1
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 17084288
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717084288%27 HTTP/1.1" 200 None
2026-03-29 20:13:12 [motorway.uk] INFO: Scrape type for 17084288: 1
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 20485139
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720485139%27 HTTP/1.1" 200 None
2026-03-29 20:13:12 [motorway.uk] INFO: Scrape type for 20485139: 1
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 20087813
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 16608213
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 20487775
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 19936274
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719936274%27 HTTP/1.1" 200 None
2026-03-29 20:13:12 [motorway.uk] INFO: Scrape type for 19936274: 1
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 19950167
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 15737342
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715737342%27 HTTP/1.1" 200 None
2026-03-29 20:13:12 [motorway.uk] INFO: Scrape type for 15737342: 1
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 20202633
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720202633%27 HTTP/1.1" 200 None
2026-03-29 20:13:12 [motorway.uk] INFO: Scrape type for 20202633: 1
2026-03-29 20:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3070/7743070/7743070-exterior_front_passenger-default-1774617254689.jpg> (referer: None)
2026-03-29 20:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3070/7743070/7743070-exterior_rear_passenger-default-1774617254339.jpg> (referer: None)
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 19867021
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 20331785
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 20471533
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 19734644
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 16989772
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 20488442
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488442%27 HTTP/1.1" 200 None
2026-03-29 20:13:12 [motorway.uk] INFO: Scrape type for 20488442: 1
2026-03-29 20:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3070/7743070/7743070-exterior_front_driver-default-1774617249947.jpg> (referer: None)
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 20387458
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720387458%27 HTTP/1.1" 200 None
2026-03-29 20:13:12 [motorway.uk] INFO: Scrape type for 20387458: 1
2026-03-29 20:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3070/7743070/7743070-exterior_rear_driver-default-1774617252007.jpg> (referer: None)
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 20469643
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720469643%27 HTTP/1.1" 200 None
2026-03-29 20:13:12 [motorway.uk] INFO: Scrape type for 20469643: 1
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 20272813
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720272813%27 HTTP/1.1" 200 None
2026-03-29 20:13:12 [motorway.uk] INFO: Scrape type for 20272813: 1
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 7883635
2026-03-29 20:13:12 [motorway.uk] INFO: Found listing with ID: 20386196
2026-03-29 20:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3070/7743070/7743070-interior_dashboard-default-1774617278671.jpg> (referer: None)
2026-03-29 20:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3070/7743070/7743070-interior_rear_seats-default-1774617266139.jpg> (referer: None)
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ac2f90>
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90fd1429-cca2-5c29-a15e-abc369cb1086/90fd1429-cca2-5c29-a15e-abc369cb1086_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3070%252F7743070%252F7743070-exterior_front_passenger-default-1774617254689.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3070/7743070/7743070-exterior_front_passenger-default-1774617254689.jpg saved to cache
2026-03-29 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 90fd1429-cca2-5c29-a15e-abc369cb1086
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658766fd0>
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90fd1429-cca2-5c29-a15e-abc369cb1086/90fd1429-cca2-5c29-a15e-abc369cb1086_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3070%252F7743070%252F7743070-exterior_rear_passenger-default-1774617254339.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3070/7743070/7743070-exterior_rear_passenger-default-1774617254339.jpg saved to cache
2026-03-29 20:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 90fd1429-cca2-5c29-a15e-abc369cb1086
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f9c8d0>
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90fd1429-cca2-5c29-a15e-abc369cb1086/90fd1429-cca2-5c29-a15e-abc369cb1086_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3070%252F7743070%252F7743070-exterior_front_driver-default-1774617249947.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3070/7743070/7743070-exterior_front_driver-default-1774617249947.jpg saved to cache
2026-03-29 20:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 90fd1429-cca2-5c29-a15e-abc369cb1086
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a83210>
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90fd1429-cca2-5c29-a15e-abc369cb1086/90fd1429-cca2-5c29-a15e-abc369cb1086_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3070%252F7743070%252F7743070-exterior_rear_driver-default-1774617252007.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3070/7743070/7743070-exterior_rear_driver-default-1774617252007.jpg saved to cache
2026-03-29 20:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 90fd1429-cca2-5c29-a15e-abc369cb1086
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d365d0>
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90fd1429-cca2-5c29-a15e-abc369cb1086/90fd1429-cca2-5c29-a15e-abc369cb1086_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3070%252F7743070%252F7743070-interior_dashboard-default-1774617278671.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3070/7743070/7743070-interior_dashboard-default-1774617278671.jpg saved to cache
2026-03-29 20:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 90fd1429-cca2-5c29-a15e-abc369cb1086
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599c9a10>
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90fd1429-cca2-5c29-a15e-abc369cb1086/90fd1429-cca2-5c29-a15e-abc369cb1086_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3070%252F7743070%252F7743070-interior_rear_seats-default-1774617266139.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3070/7743070/7743070-interior_rear_seats-default-1774617266139.jpg saved to cache
2026-03-29 20:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 90fd1429-cca2-5c29-a15e-abc369cb1086
2026-03-29 20:13:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 90fd1429-cca2-5c29-a15e-abc369cb1086, skipping ID generation
2026-03-29 20:13:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90fd1429-cca2-5c29-a15e-abc369cb1086 with scrape type 1
2026-03-29 20:13:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 90fd1429-cca2-5c29-a15e-abc369cb1086 sending to next pipeline
2026-03-29 20:13:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 90fd1429-cca2-5c29-a15e-abc369cb1086, identifier: 7743070
2026-03-29 20:13:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 90fd1429-cca2-5c29-a15e-abc369cb1086 with identifier: 7743070
2026-03-29 20:13:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 90fd1429-cca2-5c29-a15e-abc369cb1086 with identifier: 7743070
2026-03-29 20:13:13 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 90fd1429-cca2-5c29-a15e-abc369cb1086 with identifier: 7743070 to the API
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/3070/7743070/7743070-interior_rear_seats-default-1774617266139.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '90fd1429-cca2-5c29-a15e-abc369cb1086',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'MA67 AYS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/7743070',
'listing': 'auction',
'location': 'York York',
'make': 'Hyundai',
'model': 'I20',
'odometer': 10150,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90fd1429-cca2-5c29-a15e-abc369cb1086/90fd1429-cca2-5c29-a15e-abc369cb1086_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1450213,
'Height': 2639,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3070/7743070/7743070-exterior_front_driver-default-1774617249947.jpg',
'Width': 3519},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90fd1429-cca2-5c29-a15e-abc369cb1086/90fd1429-cca2-5c29-a15e-abc369cb1086_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1655838,
'Height': 2626,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3070/7743070/7743070-exterior_rear_driver-default-1774617252007.jpg',
'Width': 3501},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90fd1429-cca2-5c29-a15e-abc369cb1086/90fd1429-cca2-5c29-a15e-abc369cb1086_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1394118,
'Height': 2583,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3070/7743070/7743070-exterior_front_passenger-default-1774617254689.jpg',
'Width': 3444},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90fd1429-cca2-5c29-a15e-abc369cb1086/90fd1429-cca2-5c29-a15e-abc369cb1086_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1404166,
'Height': 2417,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3070/7743070/7743070-exterior_rear_passenger-default-1774617254339.jpg',
'Width': 3222},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90fd1429-cca2-5c29-a15e-abc369cb1086/90fd1429-cca2-5c29-a15e-abc369cb1086_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2645118,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3070/7743070/7743070-interior_front_seats-default-1774617264573.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90fd1429-cca2-5c29-a15e-abc369cb1086/90fd1429-cca2-5c29-a15e-abc369cb1086_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2886621,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3070/7743070/7743070-interior_rear_seats-default-1774617266139.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90fd1429-cca2-5c29-a15e-abc369cb1086/90fd1429-cca2-5c29-a15e-abc369cb1086_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2256997,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3070/7743070/7743070-interior_dashboard-default-1774617278671.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90fd1429-cca2-5c29-a15e-abc369cb1086/90fd1429-cca2-5c29-a15e-abc369cb1086_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2797480,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3070/7743070/7743070-interior_boot-default-1774617318590.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90fd1429-cca2-5c29-a15e-abc369cb1086/90fd1429-cca2-5c29-a15e-abc369cb1086_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3527266,
'Height': 5838,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/3070/7743070/7743070-docs_service_history-modified-1695804064799.jpeg?ixlib=js-3.8.0&auto=format&s=38306946414326c652f420c06b663ee9',
'Width': 4379},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90fd1429-cca2-5c29-a15e-abc369cb1086/90fd1429-cca2-5c29-a15e-abc369cb1086_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 17943260,
'Height': 7296,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/3070/7743070/docs_service_history-1698222538843.jpg?ixlib=js-3.8.0&auto=format&s=dc34dc7f3dce941e92e3bee1a44db569',
'Width': 5472}],
'price': 9912,
'price_includes_vat': False,
'registration_date': '2017-09-18',
'seats_number': None,
'seller_name': None,
'title': 'Hyundai I20 SE MPI Auto',
'transmission': 'automatic',
'trim': 'SE MPI Auto',
'vin': 'NLHB351CMJZ355612',
'year': 2017}
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277743070%27 HTTP/1.1" 200 None
2026-03-29 20:13:13 [motorway.uk] INFO: Saving data for 7743070: {'created_time': 1774815193.963501, 'last_price_update_time': 1774815193.963513, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='7743070') HTTP/1.1" 204 0
2026-03-29 20:13:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5274/20395274/exterior_front_passenger-1774706265925.jpg> (referer: None)
2026-03-29 20:13:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a7a390>
2026-03-29 20:13:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb80d0c4-ede0-56f1-9074-5ee67e1fb450/eb80d0c4-ede0-56f1-9074-5ee67e1fb450_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5274%252F20395274%252Fexterior_front_passenger-1774706265925.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5274/20395274/exterior_front_passenger-1774706265925.jpg saved to cache
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb80d0c4-ede0-56f1-9074-5ee67e1fb450
2026-03-29 20:13:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/2147652.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20481823.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20467542.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20413228.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17665821.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbfb079f-e6e2-5ec3-9eb0-33d6e7898aee with identifier: 2147652
2026-03-29 20:13:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbfb079f-e6e2-5ec3-9eb0-33d6e7898aee with scrape type 1
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dbfb079f-e6e2-5ec3-9eb0-33d6e7898aee
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7652%252F2147652%252Fexterior_front_driver-1774691686704.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7652/2147652/exterior_front_driver-1774691686704.jpg not downloaded yet
2026-03-29 20:13:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fe495e8-e1e4-5b89-88dd-8ac22340c69f with identifier: 20481823
2026-03-29 20:13:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fe495e8-e1e4-5b89-88dd-8ac22340c69f with scrape type 1
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1fe495e8-e1e4-5b89-88dd-8ac22340c69f
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1823%252F20481823%252Fexterior_front_driver-1774703774392.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1823/20481823/exterior_front_driver-1774703774392.jpg not downloaded yet
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7652%252F2147652%252Fexterior_rear_driver-1774689480899.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7652/2147652/exterior_rear_driver-1774689480899.jpg not downloaded yet
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1823%252F20481823%252Fexterior_rear_driver-1774703791685.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1823/20481823/exterior_rear_driver-1774703791685.jpg not downloaded yet
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7652%252F2147652%252Fexterior_front_passenger-1774691700288.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7652/2147652/exterior_front_passenger-1774691700288.jpg not downloaded yet
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1823%252F20481823%252Fexterior_front_passenger-1774703836405.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1823/20481823/exterior_front_passenger-1774703836405.jpg not downloaded yet
2026-03-29 20:13:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c622dd7-a835-53eb-9da6-b4662e0a9cbc with identifier: 20467542
2026-03-29 20:13:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c622dd7-a835-53eb-9da6-b4662e0a9cbc with scrape type 1
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1c622dd7-a835-53eb-9da6-b4662e0a9cbc
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7542%252F20467542%252Fexterior_front_driver-1774694315155.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7542/20467542/exterior_front_driver-1774694315155.jpeg not downloaded yet
2026-03-29 20:13:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f41ed2a-e43f-537f-b39c-8f3715ede267 with identifier: 20413228
2026-03-29 20:13:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f41ed2a-e43f-537f-b39c-8f3715ede267 with scrape type 1
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2f41ed2a-e43f-537f-b39c-8f3715ede267
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3228%252F20413228%252Fexterior_front_driver-1774703359581.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3228/20413228/exterior_front_driver-1774703359581.jpg not downloaded yet
2026-03-29 20:13:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 877cfb0f-156f-506e-a883-ce6ef2e9acd7 with identifier: 17665821
2026-03-29 20:13:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 877cfb0f-156f-506e-a883-ce6ef2e9acd7 with scrape type 1
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 877cfb0f-156f-506e-a883-ce6ef2e9acd7
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5821%252F17665821%252Fexterior_front_driver-1774700504928.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5821/17665821/exterior_front_driver-1774700504928.jpeg not downloaded yet
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7652%252F2147652%252Fexterior_rear_passenger-1774691713234.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7652/2147652/exterior_rear_passenger-1774691713234.jpg not downloaded yet
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1823%252F20481823%252Fexterior_rear_passenger-1774703805439.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1823/20481823/exterior_rear_passenger-1774703805439.jpg not downloaded yet
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7542%252F20467542%252Fexterior_rear_driver-1774694298876.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7542/20467542/exterior_rear_driver-1774694298876.jpeg not downloaded yet
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3228%252F20413228%252Fexterior_rear_driver-1774703367860.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3228/20413228/exterior_rear_driver-1774703367860.jpg not downloaded yet
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5821%252F17665821%252Fexterior_rear_driver-1774700551496.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5821/17665821/exterior_rear_driver-1774700551496.jpeg not downloaded yet
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7652%252F2147652%252Finterior_front_seats-1774691779446.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7652/2147652/interior_front_seats-1774691779446.jpg not downloaded yet
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1823%252F20481823%252Finterior_front_seats-1774704324793.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1823/20481823/interior_front_seats-1774704324793.jpg not downloaded yet
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7542%252F20467542%252Fexterior_front_passenger-1774694316009.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7542/20467542/exterior_front_passenger-1774694316009.jpeg not downloaded yet
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3228%252F20413228%252Fexterior_front_passenger-1774703385206.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3228/20413228/exterior_front_passenger-1774703385206.jpg not downloaded yet
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5821%252F17665821%252Fexterior_front_passenger-1774700521353.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5821/17665821/exterior_front_passenger-1774700521353.jpeg not downloaded yet
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7652%252F2147652%252Finterior_rear_seats-1774690229077.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7652/2147652/interior_rear_seats-1774690229077.jpg not downloaded yet
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1823%252F20481823%252Finterior_rear_seats-1774704394637.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1823/20481823/interior_rear_seats-1774704394637.jpg not downloaded yet
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7542%252F20467542%252Fexterior_rear_passenger-1774694317819.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7542/20467542/exterior_rear_passenger-1774694317819.jpeg not downloaded yet
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3228%252F20413228%252Fexterior_rear_passenger-1774703363641.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3228/20413228/exterior_rear_passenger-1774703363641.jpg not downloaded yet
2026-03-29 20:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5821%252F17665821%252Fexterior_rear_passenger-1774700535794.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5821/17665821/exterior_rear_passenger-1774700535794.jpeg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7652%252F2147652%252Finterior_dashboard-1774691725033.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7652/2147652/interior_dashboard-1774691725033.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1823%252F20481823%252Finterior_dashboard-1774704431270.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1823/20481823/interior_dashboard-1774704431270.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7542%252F20467542%252Finterior_front_seats-1774693906103.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7542/20467542/interior_front_seats-1774693906103.jpeg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3228%252F20413228%252Finterior_front_seats-1774704073075.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3228/20413228/interior_front_seats-1774704073075.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5821%252F17665821%252Finterior_front_seats-1774700824157.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5821/17665821/interior_front_seats-1774700824157.jpeg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7652%252F2147652%252Finterior_boot-1774691506480.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7652/2147652/interior_boot-1774691506480.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1823%252F20481823%252Finstrument_cluster-1774704413083.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1823/20481823/instrument_cluster-1774704413083.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7542%252F20467542%252F20467542-interior_rear_seats-modified-1774695008058.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7542/20467542/20467542-interior_rear_seats-modified-1774695008058.jpeg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3228%252F20413228%252Finterior_dashboard-1774705470576.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3228/20413228/interior_dashboard-1774705470576.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5821%252F17665821%252Finterior_rear_seats-1774700666604.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5821/17665821/interior_rear_seats-1774700666604.jpeg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7652%252F2147652%252Fdocs_service_history-1774690604867.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9e1dfc0f3eb2b5079375fea3eb7d3390%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7652/2147652/docs_service_history-1774690604867.jpg?ixlib=js-3.8.0&auto=format&s=9e1dfc0f3eb2b5079375fea3eb7d3390 not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1823%252F20481823%252Finterior_boot-1774704451140.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1823/20481823/interior_boot-1774704451140.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7542%252F20467542%252F20467542-interior_dashboard-modified-1774695019878.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7542/20467542/20467542-interior_dashboard-modified-1774695019878.jpeg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3228%252F20413228%252Finstrument_cluster-1774704129726.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3228/20413228/instrument_cluster-1774704129726.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5821%252F17665821%252Finterior_dashboard-1774700740642.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5821/17665821/interior_dashboard-1774700740642.jpeg not downloaded yet
2026-03-29 20:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16384485.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7652%252F2147652%252Fwheels_front_driver-1774689780162.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7652/2147652/wheels_front_driver-1774689780162.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1823%252F20481823%252Fdocs_service_history-1774704670369.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2c1272af93a78e56b238f563b52b0457%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1823/20481823/docs_service_history-1774704670369.jpg?ixlib=js-3.8.0&auto=format&s=2c1272af93a78e56b238f563b52b0457 not downloaded yet
2026-03-29 20:13:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7542%252F20467542%252F20467542-instrument_cluster-modified-1774695037425.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7542/20467542/20467542-instrument_cluster-modified-1774695037425.jpeg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3228%252F20413228%252Finterior_boot-1774704272702.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3228/20413228/interior_boot-1774704272702.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5821%252F17665821%252Finstrument_cluster-1774700995257.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5821/17665821/instrument_cluster-1774700995257.jpeg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7542%252F20467542%252Finterior_boot-1774694296374.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7542/20467542/interior_boot-1774694296374.jpeg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3228%252F20413228%252Fdocs_service_history-1774704529601.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd4b6a50e3aa3a4eb37a3d7531635e883%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3228/20413228/docs_service_history-1774704529601.jpg?ixlib=js-3.8.0&auto=format&s=d4b6a50e3aa3a4eb37a3d7531635e883 not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5821%252F17665821%252Finterior_boot-1774700781898.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5821/17665821/interior_boot-1774700781898.jpeg not downloaded yet
2026-03-29 20:13:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d63e2a40-1202-5e88-9431-d1e022daf898 with identifier: 16384485
2026-03-29 20:13:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d63e2a40-1202-5e88-9431-d1e022daf898 with scrape type 1
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d63e2a40-1202-5e88-9431-d1e022daf898
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4485%252F16384485%252Fexterior_front_driver-1774699555437.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4485/16384485/exterior_front_driver-1774699555437.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7542%252F20467542%252Fdocs_service_history-1774694622775.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D261ab60e8f98f30ba37814ba14dcb003%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7542/20467542/docs_service_history-1774694622775.jpeg?ixlib=js-3.8.0&auto=format&s=261ab60e8f98f30ba37814ba14dcb003 not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3228%252F20413228%252Fdocs_service_history-1774704534588.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D27dbfa48300f74648eebf3d5e5d59cd2%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3228/20413228/docs_service_history-1774704534588.jpg?ixlib=js-3.8.0&auto=format&s=27dbfa48300f74648eebf3d5e5d59cd2 not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5821%252F17665821%252Fdocs_service_history-1774701189112.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D60520eab2eb7f1cb6200b6e5ee3f35fa%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5821/17665821/docs_service_history-1774701189112.jpeg?ixlib=js-3.8.0&auto=format&s=60520eab2eb7f1cb6200b6e5ee3f35fa not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4485%252F16384485%252Fexterior_rear_driver-1774699654081.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4485/16384485/exterior_rear_driver-1774699654081.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4485%252F16384485%252Fexterior_front_passenger-1774699584711.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4485/16384485/exterior_front_passenger-1774699584711.jpg not downloaded yet
2026-03-29 20:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19642157.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4485%252F16384485%252Fexterior_rear_passenger-1774699609480.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4485/16384485/exterior_rear_passenger-1774699609480.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4485%252F16384485%252Finterior_front_seats-1774700284174.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4485/16384485/interior_front_seats-1774700284174.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4485%252F16384485%252Finterior_rear_seats-1774700232968.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4485/16384485/interior_rear_seats-1774700232968.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4485%252F16384485%252Finterior_dashboard-1774700365054.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4485/16384485/interior_dashboard-1774700365054.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4485%252F16384485%252Finterior_boot-1774700248310.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4485/16384485/interior_boot-1774700248310.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4485%252F16384485%252Fdocs_service_history-1774700728691.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2dd51d58d5603fb8ec7db92b9cf1b8ec%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4485/16384485/docs_service_history-1774700728691.jpg?ixlib=js-3.8.0&auto=format&s=2dd51d58d5603fb8ec7db92b9cf1b8ec not downloaded yet
2026-03-29 20:13:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7327a8b6-9a65-5112-a773-bf302f17ef75 with identifier: 19642157
2026-03-29 20:13:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7327a8b6-9a65-5112-a773-bf302f17ef75 with scrape type 1
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7327a8b6-9a65-5112-a773-bf302f17ef75
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2157%252F19642157%252Fexterior_front_driver-1774691046286.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2157/19642157/exterior_front_driver-1774691046286.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4485%252F16384485%252Fdamage_scratches-1774699697405.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4485/16384485/damage_scratches-1774699697405.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2157%252F19642157%252Fexterior_rear_driver-1774691064634.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2157/19642157/exterior_rear_driver-1774691064634.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2157%252F19642157%252Fexterior_front_passenger-1774691098695.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2157/19642157/exterior_front_passenger-1774691098695.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2157%252F19642157%252Fexterior_rear_passenger-1774691078120.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2157/19642157/exterior_rear_passenger-1774691078120.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2157%252F19642157%252Finterior_front_seats-1774691727783.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2157/19642157/interior_front_seats-1774691727783.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2157%252F19642157%252Finterior_rear_seats-1774691739647.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2157/19642157/interior_rear_seats-1774691739647.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2157%252F19642157%252Finterior_dashboard-1774691792600.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2157/19642157/interior_dashboard-1774691792600.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2157%252F19642157%252Finstrument_cluster-1774692540205.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2157/19642157/instrument_cluster-1774692540205.jpg not downloaded yet
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2157%252F19642157%252Finterior_boot-1774691951408.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2157/19642157/interior_boot-1774691951408.jpg not downloaded yet
2026-03-29 20:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5821/17665821/interior_dashboard-1774700740642.jpeg> (referer: None)
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2157%252F19642157%252Fdocs_service_history-1774691989858.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D59b430f4c64e918fe57dcd508771d5d9%27 HTTP/1.1" 200 None
2026-03-29 20:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2157/19642157/docs_service_history-1774691989858.jpg?ixlib=js-3.8.0&auto=format&s=59b430f4c64e918fe57dcd508771d5d9 not downloaded yet
2026-03-29 20:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4485/16384485/exterior_rear_driver-1774699654081.jpg> (referer: None)
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d8a390>
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_877cfb0f-156f-506e-a883-ce6ef2e9acd7/877cfb0f-156f-506e-a883-ce6ef2e9acd7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5821%252F17665821%252Finterior_dashboard-1774700740642.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5821/17665821/interior_dashboard-1774700740642.jpeg saved to cache
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 877cfb0f-156f-506e-a883-ce6ef2e9acd7
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a06610>
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d63e2a40-1202-5e88-9431-d1e022daf898/d63e2a40-1202-5e88-9431-d1e022daf898_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4485%252F16384485%252Fexterior_rear_driver-1774699654081.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4485/16384485/exterior_rear_driver-1774699654081.jpg saved to cache
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d63e2a40-1202-5e88-9431-d1e022daf898
2026-03-29 20:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2157/19642157/interior_boot-1774691951408.jpg> (referer: None)
2026-03-29 20:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20202633.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:13:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a0f950>
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7327a8b6-9a65-5112-a773-bf302f17ef75/7327a8b6-9a65-5112-a773-bf302f17ef75_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2157%252F19642157%252Finterior_boot-1774691951408.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2157/19642157/interior_boot-1774691951408.jpg saved to cache
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7327a8b6-9a65-5112-a773-bf302f17ef75
2026-03-29 20:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19936274.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8df8307-483c-58fc-88e0-a17dfae303c8 with identifier: 20202633
2026-03-29 20:13:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8df8307-483c-58fc-88e0-a17dfae303c8 with scrape type 1
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d8df8307-483c-58fc-88e0-a17dfae303c8
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2633%252F20202633%252Fexterior_front_driver-1774716173030.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2633/20202633/exterior_front_driver-1774716173030.jpg not downloaded yet
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2633%252F20202633%252Fexterior_rear_driver-1774716196046.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2633/20202633/exterior_rear_driver-1774716196046.jpg not downloaded yet
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2633%252F20202633%252Fexterior_front_passenger-1774785522167.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2633/20202633/exterior_front_passenger-1774785522167.jpg not downloaded yet
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2633%252F20202633%252Fexterior_rear_passenger-1774716224619.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2633/20202633/exterior_rear_passenger-1774716224619.jpg not downloaded yet
2026-03-29 20:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20424839.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2633%252F20202633%252Finterior_front_seats-1774717581727.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2633/20202633/interior_front_seats-1774717581727.jpg not downloaded yet
2026-03-29 20:13:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4635950e-3385-5532-9d00-272baa21d7fe with identifier: 19936274
2026-03-29 20:13:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4635950e-3385-5532-9d00-272baa21d7fe with scrape type 1
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4635950e-3385-5532-9d00-272baa21d7fe
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6274%252F19936274%252Fexterior_front_driver-1771845070185.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6274/19936274/exterior_front_driver-1771845070185.jpg already downloaded
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6274%252F19936274%252Fexterior_rear_driver-1771845077073.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6274/19936274/exterior_rear_driver-1771845077073.jpg already downloaded
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6274%252F19936274%252Fexterior_front_passenger-1771845169218.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6274/19936274/exterior_front_passenger-1771845169218.jpg already downloaded
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6274%252F19936274%252Fexterior_rear_passenger-1771774809174.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6274/19936274/exterior_rear_passenger-1771774809174.jpg already downloaded
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6274%252F19936274%252Finterior_front_seats-1771775026802.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6274/19936274/interior_front_seats-1771775026802.jpg already downloaded
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6274%252F19936274%252Finterior_rear_seats-1771775185025.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6274/19936274/interior_rear_seats-1771775185025.jpg already downloaded
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6274%252F19936274%252Finterior_dashboard-1774617467736.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6274/19936274/interior_dashboard-1774617467736.jpg not downloaded yet
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2633%252F20202633%252Finterior_rear_seats-1774717595429.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2633/20202633/interior_rear_seats-1774717595429.jpg not downloaded yet
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6274%252F19936274%252Finstrument_cluster-1771775008616.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6274/19936274/instrument_cluster-1771775008616.jpg already downloaded
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6274%252F19936274%252Finterior_boot-1771775088017.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6274/19936274/interior_boot-1771775088017.jpg already downloaded
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F6274%252F19936274%252Fdocs_service_history-1771837663296.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da7137cd7c511d9e356e804a91db4ee4e%27 HTTP/1.1" 200 None
2026-03-29 20:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/6274/19936274/docs_service_history-1771837663296.jpg?ixlib=js-3.8.0&auto=format&s=a7137cd7c511d9e356e804a91db4ee4e already downloaded
2026-03-29 20:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2633%252F20202633%252Finterior_dashboard-1774717947225.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2633/20202633/interior_dashboard-1774717947225.jpg not downloaded yet
2026-03-29 20:13:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85aa33fa-b35f-5c1a-848f-6115cf143eb7 with identifier: 20424839
2026-03-29 20:13:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85aa33fa-b35f-5c1a-848f-6115cf143eb7 with scrape type 1
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 85aa33fa-b35f-5c1a-848f-6115cf143eb7
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4839%252F20424839%252Fexterior_front_driver-1774706739918.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4839/20424839/exterior_front_driver-1774706739918.jpg not downloaded yet
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2633%252F20202633%252Finstrument_cluster-1774717668908.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2633/20202633/instrument_cluster-1774717668908.jpg not downloaded yet
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4839%252F20424839%252Fexterior_rear_driver-1774706740410.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4839/20424839/exterior_rear_driver-1774706740410.jpg not downloaded yet
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2633%252F20202633%252Finterior_boot-1774717744874.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2633/20202633/interior_boot-1774717744874.jpg not downloaded yet
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4839%252F20424839%252Fexterior_front_passenger-1774706744205.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4839/20424839/exterior_front_passenger-1774706744205.jpg not downloaded yet
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2633%252F20202633%252Fdocs_service_history-1774718270071.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D051ae087f1627136db6c7721d899282a%27 HTTP/1.1" 200 None
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2633/20202633/docs_service_history-1774718270071.jpg?ixlib=js-3.8.0&auto=format&s=051ae087f1627136db6c7721d899282a not downloaded yet
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4839%252F20424839%252Fexterior_rear_passenger-1774706745707.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4839/20424839/exterior_rear_passenger-1774706745707.jpg not downloaded yet
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4839%252F20424839%252Finterior_front_seats-1774707725140.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4839/20424839/interior_front_seats-1774707725140.jpg not downloaded yet
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4839%252F20424839%252Finterior_rear_seats-1774707875161.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4839/20424839/interior_rear_seats-1774707875161.jpg not downloaded yet
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4839%252F20424839%252Finterior_dashboard-1774708972492.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4839/20424839/interior_dashboard-1774708972492.jpg not downloaded yet
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4839%252F20424839%252Finstrument_cluster-1774709251714.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4839/20424839/instrument_cluster-1774709251714.jpg not downloaded yet
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4839%252F20424839%252Finterior_boot-1774709004841.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4839/20424839/interior_boot-1774709004841.jpg not downloaded yet
2026-03-29 20:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2157/19642157/interior_dashboard-1774691792600.jpg> (referer: None)
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4839%252F20424839%252Fdocs_service_history-1774708343398.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd9898a63a9bbd8fe884b2f66287e3151%27 HTTP/1.1" 200 None
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4839/20424839/docs_service_history-1774708343398.jpg?ixlib=js-3.8.0&auto=format&s=d9898a63a9bbd8fe884b2f66287e3151 not downloaded yet
2026-03-29 20:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2633/20202633/exterior_rear_passenger-1774716224619.jpg> (referer: None)
2026-03-29 20:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2157/19642157/instrument_cluster-1774692540205.jpg> (referer: None)
2026-03-29 20:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2157/19642157/docs_service_history-1774691989858.jpg?ixlib=js-3.8.0&auto=format&s=59b430f4c64e918fe57dcd508771d5d9> (referer: None)
2026-03-29 20:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2157/19642157/interior_rear_seats-1774691739647.jpg> (referer: None)
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e3dd90>
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7327a8b6-9a65-5112-a773-bf302f17ef75/7327a8b6-9a65-5112-a773-bf302f17ef75_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2157%252F19642157%252Finterior_dashboard-1774691792600.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2157/19642157/interior_dashboard-1774691792600.jpg saved to cache
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7327a8b6-9a65-5112-a773-bf302f17ef75
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e3e210>
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8df8307-483c-58fc-88e0-a17dfae303c8/d8df8307-483c-58fc-88e0-a17dfae303c8_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2633%252F20202633%252Fexterior_rear_passenger-1774716224619.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2633/20202633/exterior_rear_passenger-1774716224619.jpg saved to cache
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d8df8307-483c-58fc-88e0-a17dfae303c8
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658514b90>
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7327a8b6-9a65-5112-a773-bf302f17ef75/7327a8b6-9a65-5112-a773-bf302f17ef75_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2157%252F19642157%252Finstrument_cluster-1774692540205.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2157/19642157/instrument_cluster-1774692540205.jpg saved to cache
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7327a8b6-9a65-5112-a773-bf302f17ef75
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65850cc90>
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7327a8b6-9a65-5112-a773-bf302f17ef75/7327a8b6-9a65-5112-a773-bf302f17ef75_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2157%252F19642157%252Fdocs_service_history-1774691989858.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D59b430f4c64e918fe57dcd508771d5d9') HTTP/1.1" 204 0
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2157/19642157/docs_service_history-1774691989858.jpg?ixlib=js-3.8.0&auto=format&s=59b430f4c64e918fe57dcd508771d5d9 saved to cache
2026-03-29 20:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7327a8b6-9a65-5112-a773-bf302f17ef75
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659bfce10>
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7327a8b6-9a65-5112-a773-bf302f17ef75/7327a8b6-9a65-5112-a773-bf302f17ef75_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2157%252F19642157%252Finterior_rear_seats-1774691739647.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2157/19642157/interior_rear_seats-1774691739647.jpg saved to cache
2026-03-29 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7327a8b6-9a65-5112-a773-bf302f17ef75
2026-03-29 20:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4839/20424839/instrument_cluster-1774709251714.jpg> (referer: None)
2026-03-29 20:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4839/20424839/docs_service_history-1774708343398.jpg?ixlib=js-3.8.0&auto=format&s=d9898a63a9bbd8fe884b2f66287e3151> (referer: None)
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6585143d0>
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85aa33fa-b35f-5c1a-848f-6115cf143eb7/85aa33fa-b35f-5c1a-848f-6115cf143eb7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4839%252F20424839%252Finstrument_cluster-1774709251714.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4839/20424839/instrument_cluster-1774709251714.jpg saved to cache
2026-03-29 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 85aa33fa-b35f-5c1a-848f-6115cf143eb7
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b48250>
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85aa33fa-b35f-5c1a-848f-6115cf143eb7/85aa33fa-b35f-5c1a-848f-6115cf143eb7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4839%252F20424839%252Fdocs_service_history-1774708343398.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd9898a63a9bbd8fe884b2f66287e3151') HTTP/1.1" 204 0
2026-03-29 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4839/20424839/docs_service_history-1774708343398.jpg?ixlib=js-3.8.0&auto=format&s=d9898a63a9bbd8fe884b2f66287e3151 saved to cache
2026-03-29 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 85aa33fa-b35f-5c1a-848f-6115cf143eb7
2026-03-29 20:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15737342.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4839/20424839/interior_front_seats-1774707725140.jpg> (referer: None)
2026-03-29 20:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4839/20424839/interior_rear_seats-1774707875161.jpg> (referer: None)
2026-03-29 20:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4839/20424839/interior_dashboard-1774708972492.jpg> (referer: None)
2026-03-29 20:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4839/20424839/interior_boot-1774709004841.jpg> (referer: None)
2026-03-29 20:13:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89eecece-c233-5146-ae27-a84aea1e4b32 with identifier: 15737342
2026-03-29 20:13:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89eecece-c233-5146-ae27-a84aea1e4b32 with scrape type 1
2026-03-29 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 89eecece-c233-5146-ae27-a84aea1e4b32
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7342%252F15737342%252Fexterior_front_driver-1774779060879.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7342/15737342/exterior_front_driver-1774779060879.jpeg not downloaded yet
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7342%252F15737342%252Fexterior_rear_driver-1774779063718.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7342/15737342/exterior_rear_driver-1774779063718.jpeg not downloaded yet
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7342%252F15737342%252Fexterior_front_passenger-1774779068041.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7342/15737342/exterior_front_passenger-1774779068041.jpeg not downloaded yet
2026-03-29 20:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2633/20202633/docs_service_history-1774718270071.jpg?ixlib=js-3.8.0&auto=format&s=051ae087f1627136db6c7721d899282a> (referer: None)
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a01b50>
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85aa33fa-b35f-5c1a-848f-6115cf143eb7/85aa33fa-b35f-5c1a-848f-6115cf143eb7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4839%252F20424839%252Finterior_front_seats-1774707725140.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4839/20424839/interior_front_seats-1774707725140.jpg saved to cache
2026-03-29 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 85aa33fa-b35f-5c1a-848f-6115cf143eb7
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be4c810>
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85aa33fa-b35f-5c1a-848f-6115cf143eb7/85aa33fa-b35f-5c1a-848f-6115cf143eb7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4839%252F20424839%252Finterior_rear_seats-1774707875161.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4839/20424839/interior_rear_seats-1774707875161.jpg saved to cache
2026-03-29 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 85aa33fa-b35f-5c1a-848f-6115cf143eb7
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be4ed90>
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85aa33fa-b35f-5c1a-848f-6115cf143eb7/85aa33fa-b35f-5c1a-848f-6115cf143eb7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4839%252F20424839%252Finterior_dashboard-1774708972492.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4839/20424839/interior_dashboard-1774708972492.jpg saved to cache
2026-03-29 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 85aa33fa-b35f-5c1a-848f-6115cf143eb7
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7342%252F15737342%252Fexterior_rear_passenger-1774779058612.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7342/15737342/exterior_rear_passenger-1774779058612.jpeg not downloaded yet
2026-03-29 20:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20469643.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7342%252F15737342%252Finterior_front_seats-1774779080484.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7342/15737342/interior_front_seats-1774779080484.jpeg not downloaded yet
2026-03-29 20:13:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658521290>
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85aa33fa-b35f-5c1a-848f-6115cf143eb7/85aa33fa-b35f-5c1a-848f-6115cf143eb7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4839%252F20424839%252Finterior_boot-1774709004841.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4839/20424839/interior_boot-1774709004841.jpg saved to cache
2026-03-29 20:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 85aa33fa-b35f-5c1a-848f-6115cf143eb7
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b08a50>
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8df8307-483c-58fc-88e0-a17dfae303c8/d8df8307-483c-58fc-88e0-a17dfae303c8_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2633%252F20202633%252Fdocs_service_history-1774718270071.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D051ae087f1627136db6c7721d899282a') HTTP/1.1" 204 0
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2633/20202633/docs_service_history-1774718270071.jpg?ixlib=js-3.8.0&auto=format&s=051ae087f1627136db6c7721d899282a saved to cache
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d8df8307-483c-58fc-88e0-a17dfae303c8
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7342%252F15737342%252Finterior_dashboard-1774779089398.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7342/15737342/interior_dashboard-1774779089398.jpeg not downloaded yet
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7342%252F15737342%252Finstrument_cluster-1774779215071.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7342/15737342/instrument_cluster-1774779215071.jpeg not downloaded yet
2026-03-29 20:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4839/20424839/exterior_rear_passenger-1774706745707.jpg> (referer: None)
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7342%252F15737342%252Finterior_boot-1774779073063.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7342/15737342/interior_boot-1774779073063.jpeg not downloaded yet
2026-03-29 20:13:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a8128e3-fa19-5f13-b01c-255bcbc7b65f with identifier: 20469643
2026-03-29 20:13:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a8128e3-fa19-5f13-b01c-255bcbc7b65f with scrape type 1
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3a8128e3-fa19-5f13-b01c-255bcbc7b65f
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9643%252F20469643%252Fexterior_front_driver-1774699318445.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9643/20469643/exterior_front_driver-1774699318445.jpg not downloaded yet
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7342%252F15737342%252Fdocs_service_history-1774777513999.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8750d5764865972d54f12c45212f0093%27 HTTP/1.1" 200 None
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7342/15737342/docs_service_history-1774777513999.jpeg?ixlib=js-3.8.0&auto=format&s=8750d5764865972d54f12c45212f0093 not downloaded yet
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9643%252F20469643%252Fexterior_rear_driver-1774699351935.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9643/20469643/exterior_rear_driver-1774699351935.jpg not downloaded yet
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7342%252F15737342%252Fdocs_service_history-1774777582849.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D90c16db21ec621a7f71a3ff3b2ba990b%27 HTTP/1.1" 200 None
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7342/15737342/docs_service_history-1774777582849.jpeg?ixlib=js-3.8.0&auto=format&s=90c16db21ec621a7f71a3ff3b2ba990b not downloaded yet
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9643%252F20469643%252Fexterior_front_passenger-1774699370607.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9643/20469643/exterior_front_passenger-1774699370607.jpg not downloaded yet
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658db2b50>
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85aa33fa-b35f-5c1a-848f-6115cf143eb7/85aa33fa-b35f-5c1a-848f-6115cf143eb7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4839%252F20424839%252Fexterior_rear_passenger-1774706745707.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4839/20424839/exterior_rear_passenger-1774706745707.jpg saved to cache
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 85aa33fa-b35f-5c1a-848f-6115cf143eb7
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9643%252F20469643%252Fexterior_rear_passenger-1774699364298.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9643/20469643/exterior_rear_passenger-1774699364298.jpg not downloaded yet
2026-03-29 20:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20387458.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9643%252F20469643%252Finterior_front_seats-1774700228907.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9643/20469643/interior_front_seats-1774700228907.jpg not downloaded yet
2026-03-29 20:13:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9643%252F20469643%252Finterior_rear_seats-1774700244785.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9643/20469643/interior_rear_seats-1774700244785.jpg not downloaded yet
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9643%252F20469643%252Finterior_dashboard-1774700195803.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9643/20469643/interior_dashboard-1774700195803.jpg not downloaded yet
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9643%252F20469643%252Finstrument_cluster-1774700327550.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9643/20469643/instrument_cluster-1774700327550.jpg not downloaded yet
2026-03-29 20:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20488442.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9643%252F20469643%252Finterior_boot-1774700893106.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9643/20469643/interior_boot-1774700893106.jpg not downloaded yet
2026-03-29 20:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4839/20424839/exterior_front_passenger-1774706744205.jpg> (referer: None)
2026-03-29 20:13:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1b50426-9aaa-5f41-8e71-68c60cfee6ab with identifier: 20387458
2026-03-29 20:13:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1b50426-9aaa-5f41-8e71-68c60cfee6ab with scrape type 1
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d1b50426-9aaa-5f41-8e71-68c60cfee6ab
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7458%252F20387458%252Fexterior_front_driver-1774596974482.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7458/20387458/exterior_front_driver-1774596974482.jpg not downloaded yet
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9643%252F20469643%252Fdocs_service_history-1774700496384.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D793c178146650d3ad51669c3945eae44%27 HTTP/1.1" 200 None
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9643/20469643/docs_service_history-1774700496384.jpg?ixlib=js-3.8.0&auto=format&s=793c178146650d3ad51669c3945eae44 not downloaded yet
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7458%252F20387458%252Fexterior_rear_driver-1774596988786.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7458/20387458/exterior_rear_driver-1774596988786.jpg not downloaded yet
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7458%252F20387458%252Fexterior_front_passenger-1774597021413.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7458/20387458/exterior_front_passenger-1774597021413.jpg not downloaded yet
2026-03-29 20:13:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61f4b41e-afa0-593d-a54d-2b31994ad274 with identifier: 20488442
2026-03-29 20:13:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61f4b41e-afa0-593d-a54d-2b31994ad274 with scrape type 1
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 61f4b41e-afa0-593d-a54d-2b31994ad274
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8442%252F20488442%252Fexterior_front_driver-1774709857098.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8442/20488442/exterior_front_driver-1774709857098.jpg not downloaded yet
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7458%252F20387458%252Fexterior_rear_passenger-1774597013817.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7458/20387458/exterior_rear_passenger-1774597013817.jpg not downloaded yet
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8442%252F20488442%252Fexterior_rear_driver-1774709877200.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8442/20488442/exterior_rear_driver-1774709877200.jpg not downloaded yet
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7458%252F20387458%252Finterior_front_seats-1774597362141.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7458/20387458/interior_front_seats-1774597362141.jpg not downloaded yet
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6588b22d0>
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_85aa33fa-b35f-5c1a-848f-6115cf143eb7/85aa33fa-b35f-5c1a-848f-6115cf143eb7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4839%252F20424839%252Fexterior_front_passenger-1774706744205.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4839/20424839/exterior_front_passenger-1774706744205.jpg saved to cache
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 85aa33fa-b35f-5c1a-848f-6115cf143eb7
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8442%252F20488442%252Fexterior_front_passenger-1774709913321.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8442/20488442/exterior_front_passenger-1774709913321.jpg not downloaded yet
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7458%252F20387458%252Finterior_rear_seats-1774597503646.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7458/20387458/interior_rear_seats-1774597503646.jpg not downloaded yet
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8442%252F20488442%252Fexterior_rear_passenger-1774709893389.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8442/20488442/exterior_rear_passenger-1774709893389.jpg not downloaded yet
2026-03-29 20:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20485139.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7458%252F20387458%252Finterior_dashboard-1774597354982.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7458/20387458/interior_dashboard-1774597354982.jpg not downloaded yet
2026-03-29 20:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8442%252F20488442%252Finterior_front_seats-1774710416168.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8442/20488442/interior_front_seats-1774710416168.jpg not downloaded yet
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7458%252F20387458%252Finterior_boot-1774597400550.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7458/20387458/interior_boot-1774597400550.jpg not downloaded yet
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8442%252F20488442%252Finterior_rear_seats-1774710439287.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8442/20488442/interior_rear_seats-1774710439287.jpg not downloaded yet
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7458%252F20387458%252Fdamage_missing_trims-1774706365626.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7458/20387458/damage_missing_trims-1774706365626.jpg not downloaded yet
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8442%252F20488442%252Finterior_dashboard-1774710479224.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8442/20488442/interior_dashboard-1774710479224.jpg not downloaded yet
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7458%252F20387458%252Fdamage_missing_trims-1774707756085.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7458/20387458/damage_missing_trims-1774707756085.jpg not downloaded yet
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8442%252F20488442%252Finstrument_cluster-1774710614837.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8442/20488442/instrument_cluster-1774710614837.jpg not downloaded yet
2026-03-29 20:13:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674 with identifier: 20485139
2026-03-29 20:13:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674 with scrape type 1
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5139%252F20485139%252Fexterior_front_driver-1774696197234.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5139/20485139/exterior_front_driver-1774696197234.jpg not downloaded yet
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8442%252F20488442%252Finterior_boot-1774710482858.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8442/20488442/interior_boot-1774710482858.jpg not downloaded yet
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5139%252F20485139%252Fexterior_rear_driver-1774696215479.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5139/20485139/exterior_rear_driver-1774696215479.jpg not downloaded yet
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8442%252F20488442%252Fdocs_service_history-1774711051659.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D000e46333b7b740d97c3014f8582b0cd%27 HTTP/1.1" 200 None
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8442/20488442/docs_service_history-1774711051659.jpg?ixlib=js-3.8.0&auto=format&s=000e46333b7b740d97c3014f8582b0cd not downloaded yet
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5139%252F20485139%252Fexterior_front_passenger-1774693776307.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5139/20485139/exterior_front_passenger-1774693776307.jpg not downloaded yet
2026-03-29 20:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9643/20469643/exterior_rear_passenger-1774699364298.jpg> (referer: None)
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5139%252F20485139%252Fexterior_rear_passenger-1774693745625.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5139/20485139/exterior_rear_passenger-1774693745625.jpg not downloaded yet
2026-03-29 20:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17084288.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5139%252F20485139%252Finterior_front_seats-1774694180013.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5139/20485139/interior_front_seats-1774694180013.jpg not downloaded yet
2026-03-29 20:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9643/20469643/interior_dashboard-1774700195803.jpg> (referer: None)
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5139%252F20485139%252Finterior_rear_seats-1774694545659.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5139/20485139/interior_rear_seats-1774694545659.jpg not downloaded yet
2026-03-29 20:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2633/20202633/interior_boot-1774717744874.jpg> (referer: None)
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5139%252F20485139%252Finterior_dashboard-1774694609332.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5139/20485139/interior_dashboard-1774694609332.jpg not downloaded yet
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5139%252F20485139%252Finstrument_cluster-1774694249497.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5139/20485139/instrument_cluster-1774694249497.jpg not downloaded yet
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5139%252F20485139%252Finterior_boot-1774694319955.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5139/20485139/interior_boot-1774694319955.jpg not downloaded yet
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c1f810>
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a8128e3-fa19-5f13-b01c-255bcbc7b65f/3a8128e3-fa19-5f13-b01c-255bcbc7b65f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9643%252F20469643%252Fexterior_rear_passenger-1774699364298.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9643/20469643/exterior_rear_passenger-1774699364298.jpg saved to cache
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a8128e3-fa19-5f13-b01c-255bcbc7b65f
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5139%252F20485139%252Fdocs_service_history-1774695090870.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D92484ed99cf848dde04a22a839c34fe2%27 HTTP/1.1" 200 None
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5139/20485139/docs_service_history-1774695090870.jpg?ixlib=js-3.8.0&auto=format&s=92484ed99cf848dde04a22a839c34fe2 not downloaded yet
2026-03-29 20:13:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21771194-1862-570c-96e3-c04d802b542c with identifier: 17084288
2026-03-29 20:13:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21771194-1862-570c-96e3-c04d802b542c with scrape type 1
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 21771194-1862-570c-96e3-c04d802b542c
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4288%252F17084288%252F17084288-exterior_front_driver-modified-1770646234694.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4288/17084288/17084288-exterior_front_driver-modified-1770646234694.jpeg already downloaded
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4288%252F17084288%252Fexterior_rear_driver-1770643978201.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4288/17084288/exterior_rear_driver-1770643978201.jpg already downloaded
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4288%252F17084288%252Fexterior_front_passenger-1770643919571.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4288/17084288/exterior_front_passenger-1770643919571.jpg already downloaded
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4288%252F17084288%252Fexterior_rear_passenger-1770643943172.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4288/17084288/exterior_rear_passenger-1770643943172.jpg already downloaded
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4288%252F17084288%252Finterior_front_seats-1770644057383.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4288/17084288/interior_front_seats-1770644057383.jpg already downloaded
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4288%252F17084288%252Finterior_rear_seats-1770644133058.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4288/17084288/interior_rear_seats-1770644133058.jpg already downloaded
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4288%252F17084288%252F17084288-interior_dashboard-modified-1770646274416.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4288/17084288/17084288-interior_dashboard-modified-1770646274416.jpeg already downloaded
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4288%252F17084288%252F17084288-interior_boot-modified-1770646297832.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4288/17084288/17084288-interior_boot-modified-1770646297832.jpeg already downloaded
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F4288%252F17084288%252Fdocs_service_history-1770645010891.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd6b3aafec5c9def438b187e980dca53b%27 HTTP/1.1" 200 None
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/4288/17084288/docs_service_history-1770645010891.jpg?ixlib=js-3.8.0&auto=format&s=d6b3aafec5c9def438b187e980dca53b already downloaded
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F4288%252F17084288%252Fdocs_service_history-1770645023329.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D526b5fb7cd1807e24a7c6910e8de81db%27 HTTP/1.1" 200 None
2026-03-29 20:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/4288/17084288/docs_service_history-1770645023329.jpg?ixlib=js-3.8.0&auto=format&s=526b5fb7cd1807e24a7c6910e8de81db already downloaded
2026-03-29 20:13:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 21771194-1862-570c-96e3-c04d802b542c, identifier: 17084288
2026-03-29 20:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7342/15737342/exterior_rear_passenger-1774779058612.jpeg> (referer: None)
2026-03-29 20:13:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 21771194-1862-570c-96e3-c04d802b542c with identifier: 17084288
2026-03-29 20:13:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 21771194-1862-570c-96e3-c04d802b542c with identifier: 17084288
2026-03-29 20:13:21 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 21771194-1862-570c-96e3-c04d802b542c with identifier: 17084288 to the API
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17084288.json>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '21771194-1862-570c-96e3-c04d802b542c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BJ18 SRU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17084288',
'listing': 'auction',
'location': 'Hampshire Fareham',
'make': 'Audi',
'model': 'S4',
'odometer': 71800,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photo_urls': ['https://motorway-photos-modified.imgix.net/4288/17084288/17084288-exterior_front_driver-modified-1770646234694.jpeg',
'https://motorway-photos-redacted.imgix.net/4288/17084288/exterior_rear_driver-1770643978201.jpg',
'https://motorway-photos-redacted.imgix.net/4288/17084288/exterior_front_passenger-1770643919571.jpg',
'https://motorway-photos-redacted.imgix.net/4288/17084288/exterior_rear_passenger-1770643943172.jpg',
'https://motorway-photos.imgix.net/4288/17084288/interior_front_seats-1770644057383.jpg',
'https://motorway-photos.imgix.net/4288/17084288/interior_rear_seats-1770644133058.jpg',
'https://motorway-photos-modified.imgix.net/4288/17084288/17084288-interior_dashboard-modified-1770646274416.jpeg',
'https://motorway-photos-modified.imgix.net/4288/17084288/17084288-interior_boot-modified-1770646297832.jpeg',
'https://motorway-service-history-photos.imgix.net/redacted/4288/17084288/docs_service_history-1770645010891.jpg?ixlib=js-3.8.0&auto=format&s=d6b3aafec5c9def438b187e980dca53b',
'https://motorway-service-history-photos.imgix.net/redacted/4288/17084288/docs_service_history-1770645023329.jpg?ixlib=js-3.8.0&auto=format&s=526b5fb7cd1807e24a7c6910e8de81db'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313a4b21-f25e-5788-b6c3-d81de7c53d9e/313a4b21-f25e-5788-b6c3-d81de7c53d9e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356030,
'Height': 979,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4288/17084288/17084288-exterior_front_driver-modified-1770646234694.jpeg',
'Width': 1305},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313a4b21-f25e-5788-b6c3-d81de7c53d9e/313a4b21-f25e-5788-b6c3-d81de7c53d9e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261724,
'Height': 846,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4288/17084288/exterior_rear_driver-1770643978201.jpg',
'Width': 1128},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313a4b21-f25e-5788-b6c3-d81de7c53d9e/313a4b21-f25e-5788-b6c3-d81de7c53d9e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 209996,
'Height': 802,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4288/17084288/exterior_front_passenger-1770643919571.jpg',
'Width': 1069},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313a4b21-f25e-5788-b6c3-d81de7c53d9e/313a4b21-f25e-5788-b6c3-d81de7c53d9e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344785,
'Height': 969,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4288/17084288/exterior_rear_passenger-1770643943172.jpg',
'Width': 1292},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313a4b21-f25e-5788-b6c3-d81de7c53d9e/313a4b21-f25e-5788-b6c3-d81de7c53d9e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 681683,
'Height': 1080,
'OriginUrl': 'https://motorway-photos.imgix.net/4288/17084288/interior_front_seats-1770644057383.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313a4b21-f25e-5788-b6c3-d81de7c53d9e/313a4b21-f25e-5788-b6c3-d81de7c53d9e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 834486,
'Height': 1080,
'OriginUrl': 'https://motorway-photos.imgix.net/4288/17084288/interior_rear_seats-1770644133058.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313a4b21-f25e-5788-b6c3-d81de7c53d9e/313a4b21-f25e-5788-b6c3-d81de7c53d9e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320659,
'Height': 1080,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4288/17084288/17084288-interior_dashboard-modified-1770646274416.jpeg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313a4b21-f25e-5788-b6c3-d81de7c53d9e/313a4b21-f25e-5788-b6c3-d81de7c53d9e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 410381,
'Height': 1080,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4288/17084288/17084288-interior_boot-modified-1770646297832.jpeg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313a4b21-f25e-5788-b6c3-d81de7c53d9e/313a4b21-f25e-5788-b6c3-d81de7c53d9e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 613301,
'Height': 1080,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/4288/17084288/docs_service_history-1770645010891.jpg?ixlib=js-3.8.0&auto=format&s=d6b3aafec5c9def438b187e980dca53b',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_313a4b21-f25e-5788-b6c3-d81de7c53d9e/313a4b21-f25e-5788-b6c3-d81de7c53d9e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 635398,
'Height': 1080,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/4288/17084288/docs_service_history-1770645023329.jpg?ixlib=js-3.8.0&auto=format&s=526b5fb7cd1807e24a7c6910e8de81db',
'Width': 1440}],
'price': 20678,
'price_includes_vat': False,
'registration_date': '2018-03-23',
'seats_number': None,
'seller_name': None,
'title': 'Audi S4 TFSI Quattro Auto',
'transmission': 'automatic',
'trim': 'TFSI Quattro Auto',
'vin': 'WAUZZZF40JA091002',
'year': 2018}
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717084288%27 HTTP/1.1" 200 None
2026-03-29 20:13:21 [motorway.uk] INFO: Saving data for 17084288: {'created_time': 1774815201.741409, 'last_price_update_time': 1774815201.741419, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17084288') HTTP/1.1" 204 0
2026-03-29 20:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659986010>
2026-03-29 20:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a8128e3-fa19-5f13-b01c-255bcbc7b65f/3a8128e3-fa19-5f13-b01c-255bcbc7b65f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9643%252F20469643%252Finterior_dashboard-1774700195803.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9643/20469643/interior_dashboard-1774700195803.jpg saved to cache
2026-03-29 20:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3a8128e3-fa19-5f13-b01c-255bcbc7b65f
2026-03-29 20:13:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d74a90>
2026-03-29 20:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8df8307-483c-58fc-88e0-a17dfae303c8/d8df8307-483c-58fc-88e0-a17dfae303c8_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2633%252F20202633%252Finterior_boot-1774717744874.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2633/20202633/interior_boot-1774717744874.jpg saved to cache
2026-03-29 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d8df8307-483c-58fc-88e0-a17dfae303c8
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599d2b10>
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89eecece-c233-5146-ae27-a84aea1e4b32/89eecece-c233-5146-ae27-a84aea1e4b32_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7342%252F15737342%252Fexterior_rear_passenger-1774779058612.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7342/15737342/exterior_rear_passenger-1774779058612.jpeg saved to cache
2026-03-29 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 89eecece-c233-5146-ae27-a84aea1e4b32
2026-03-29 20:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9643/20469643/instrument_cluster-1774700327550.jpg> (referer: None)
2026-03-29 20:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7342/15737342/exterior_rear_driver-1774779063718.jpeg> (referer: None)
2026-03-29 20:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7342/15737342/exterior_front_driver-1774779060879.jpeg> (referer: None)
2026-03-29 20:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7342/15737342/exterior_front_passenger-1774779068041.jpeg> (referer: None)
2026-03-29 20:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5139/20485139/exterior_front_passenger-1774693776307.jpg> (referer: None)
2026-03-29 20:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8442/20488442/exterior_rear_passenger-1774709893389.jpg> (referer: None)
2026-03-29 20:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5139/20485139/interior_front_seats-1774694180013.jpg> (referer: None)
2026-03-29 20:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5139/20485139/exterior_rear_passenger-1774693745625.jpg> (referer: None)
2026-03-29 20:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7342/15737342/instrument_cluster-1774779215071.jpeg> (referer: None)
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586e16d0>
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a8128e3-fa19-5f13-b01c-255bcbc7b65f/3a8128e3-fa19-5f13-b01c-255bcbc7b65f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9643%252F20469643%252Finstrument_cluster-1774700327550.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9643/20469643/instrument_cluster-1774700327550.jpg saved to cache
2026-03-29 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a8128e3-fa19-5f13-b01c-255bcbc7b65f
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658dad490>
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89eecece-c233-5146-ae27-a84aea1e4b32/89eecece-c233-5146-ae27-a84aea1e4b32_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7342%252F15737342%252Fexterior_rear_driver-1774779063718.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7342/15737342/exterior_rear_driver-1774779063718.jpeg saved to cache
2026-03-29 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 89eecece-c233-5146-ae27-a84aea1e4b32
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d7a7d0>
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89eecece-c233-5146-ae27-a84aea1e4b32/89eecece-c233-5146-ae27-a84aea1e4b32_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7342%252F15737342%252Fexterior_front_driver-1774779060879.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7342/15737342/exterior_front_driver-1774779060879.jpeg saved to cache
2026-03-29 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89eecece-c233-5146-ae27-a84aea1e4b32
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfc95d0>
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89eecece-c233-5146-ae27-a84aea1e4b32/89eecece-c233-5146-ae27-a84aea1e4b32_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7342%252F15737342%252Fexterior_front_passenger-1774779068041.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7342/15737342/exterior_front_passenger-1774779068041.jpeg saved to cache
2026-03-29 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 89eecece-c233-5146-ae27-a84aea1e4b32
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586f2110>
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674/e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5139%252F20485139%252Fexterior_front_passenger-1774693776307.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5139/20485139/exterior_front_passenger-1774693776307.jpg saved to cache
2026-03-29 20:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfc8e90>
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61f4b41e-afa0-593d-a54d-2b31994ad274/61f4b41e-afa0-593d-a54d-2b31994ad274_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8442%252F20488442%252Fexterior_rear_passenger-1774709893389.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8442/20488442/exterior_rear_passenger-1774709893389.jpg saved to cache
2026-03-29 20:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 61f4b41e-afa0-593d-a54d-2b31994ad274
2026-03-29 20:13:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d87c90>
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674/e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5139%252F20485139%252Finterior_front_seats-1774694180013.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5139/20485139/interior_front_seats-1774694180013.jpg saved to cache
2026-03-29 20:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659bd9f90>
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674/e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5139%252F20485139%252Fexterior_rear_passenger-1774693745625.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5139/20485139/exterior_rear_passenger-1774693745625.jpg saved to cache
2026-03-29 20:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674
2026-03-29 20:13:23 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:13:23 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:13:23 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x83\xac~\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x06\xa3\x9c\x00\x83\xa2r\x00\x00\x00\x00'
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d95390>
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89eecece-c233-5146-ae27-a84aea1e4b32/89eecece-c233-5146-ae27-a84aea1e4b32_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7342%252F15737342%252Finstrument_cluster-1774779215071.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7342/15737342/instrument_cluster-1774779215071.jpeg saved to cache
2026-03-29 20:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 89eecece-c233-5146-ae27-a84aea1e4b32
2026-03-29 20:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5139/20485139/docs_service_history-1774695090870.jpg?ixlib=js-3.8.0&auto=format&s=92484ed99cf848dde04a22a839c34fe2> (referer: None)
2026-03-29 20:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5139/20485139/instrument_cluster-1774694249497.jpg> (referer: None)
2026-03-29 20:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5139/20485139/interior_boot-1774694319955.jpg> (referer: None)
2026-03-29 20:13:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d7b650>
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674/e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5139%252F20485139%252Fdocs_service_history-1774695090870.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D92484ed99cf848dde04a22a839c34fe2') HTTP/1.1" 204 0
2026-03-29 20:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5139/20485139/docs_service_history-1774695090870.jpg?ixlib=js-3.8.0&auto=format&s=92484ed99cf848dde04a22a839c34fe2 saved to cache
2026-03-29 20:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674
2026-03-29 20:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14816704.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a79e10>
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674/e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5139%252F20485139%252Finstrument_cluster-1774694249497.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5139/20485139/instrument_cluster-1774694249497.jpg saved to cache
2026-03-29 20:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674
2026-03-29 20:13:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfcabd0>
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674/e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5139%252F20485139%252Finterior_boot-1774694319955.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5139/20485139/interior_boot-1774694319955.jpg saved to cache
2026-03-29 20:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674
2026-03-29 20:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7458/20387458/damage_missing_trims-1774707756085.jpg> (referer: None)
2026-03-29 20:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20039478.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:23 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (12730028) larger than download warn size (10485760) in request <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8442/20488442/docs_service_history-1774711051659.jpg?ixlib=js-3.8.0&auto=format&s=000e46333b7b740d97c3014f8582b0cd>.
2026-03-29 20:13:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cf46345-9e5b-5dac-9ec3-54b298104bf4 with identifier: 14816704
2026-03-29 20:13:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cf46345-9e5b-5dac-9ec3-54b298104bf4 with scrape type 1
2026-03-29 20:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6cf46345-9e5b-5dac-9ec3-54b298104bf4
2026-03-29 20:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6704%252F14816704%252Fexterior_front_driver-1774709171930.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6704/14816704/exterior_front_driver-1774709171930.jpg not downloaded yet
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6704%252F14816704%252Fexterior_rear_driver-1774709153886.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6704/14816704/exterior_rear_driver-1774709153886.jpg not downloaded yet
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6704%252F14816704%252Fexterior_front_passenger-1774709128109.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6704/14816704/exterior_front_passenger-1774709128109.jpg not downloaded yet
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6704%252F14816704%252Fexterior_rear_passenger-1774709117002.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6704/14816704/exterior_rear_passenger-1774709117002.jpg not downloaded yet
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6704%252F14816704%252Finterior_front_seats-1774709769959.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6704/14816704/interior_front_seats-1774709769959.jpg not downloaded yet
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659cee310>
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b50426-9aaa-5f41-8e71-68c60cfee6ab/d1b50426-9aaa-5f41-8e71-68c60cfee6ab_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7458%252F20387458%252Fdamage_missing_trims-1774707756085.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7458/20387458/damage_missing_trims-1774707756085.jpg saved to cache
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d1b50426-9aaa-5f41-8e71-68c60cfee6ab
2026-03-29 20:13:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6381d4c9-30c7-54c9-a842-740f5af2d82a with identifier: 20039478
2026-03-29 20:13:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6381d4c9-30c7-54c9-a842-740f5af2d82a with scrape type 1
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6381d4c9-30c7-54c9-a842-740f5af2d82a
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9478%252F20039478%252Fexterior_front_driver-1774549157771.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9478/20039478/exterior_front_driver-1774549157771.jpg not downloaded yet
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6704%252F14816704%252Finterior_rear_seats-1774709781994.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6704/14816704/interior_rear_seats-1774709781994.jpg not downloaded yet
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9478%252F20039478%252Fexterior_rear_driver-1774549190502.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9478/20039478/exterior_rear_driver-1774549190502.jpg not downloaded yet
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6704%252F14816704%252Finterior_dashboard-1774709939817.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6704/14816704/interior_dashboard-1774709939817.jpg not downloaded yet
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9478%252F20039478%252Fexterior_front_passenger-1774549290515.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9478/20039478/exterior_front_passenger-1774549290515.jpg not downloaded yet
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6704%252F14816704%252Finstrument_cluster-1774709871633.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6704/14816704/instrument_cluster-1774709871633.jpg not downloaded yet
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9478%252F20039478%252Fexterior_rear_passenger-1774549370512.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9478/20039478/exterior_rear_passenger-1774549370512.jpg not downloaded yet
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6704%252F14816704%252Finterior_boot-1774709848730.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6704/14816704/interior_boot-1774709848730.jpg not downloaded yet
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9478%252F20039478%252Finterior_front_seats-1774549790988.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9478/20039478/interior_front_seats-1774549790988.jpg not downloaded yet
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6704%252F14816704%252Fdocs_service_history-1774712476401.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dadcca7cf4a1c3250e5f310a1a39e48d9%27 HTTP/1.1" 200 None
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6704/14816704/docs_service_history-1774712476401.jpg?ixlib=js-3.8.0&auto=format&s=adcca7cf4a1c3250e5f310a1a39e48d9 not downloaded yet
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9478%252F20039478%252Finterior_rear_seats-1774549825975.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9478/20039478/interior_rear_seats-1774549825975.jpg not downloaded yet
2026-03-29 20:13:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5139/20485139/exterior_front_driver-1774696197234.jpg> (referer: None)
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9478%252F20039478%252Finterior_dashboard-1774549960742.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9478/20039478/interior_dashboard-1774549960742.jpg not downloaded yet
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9478%252F20039478%252Finterior_boot-1774549894182.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9478/20039478/interior_boot-1774549894182.jpg not downloaded yet
2026-03-29 20:13:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8442/20488442/interior_dashboard-1774710479224.jpg> (referer: None)
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9478%252F20039478%252Fdocs_service_history-1774551236323.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8d79633eb20c2cc35e4d1ecb752199cf%27 HTTP/1.1" 200 None
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9478/20039478/docs_service_history-1774551236323.jpg?ixlib=js-3.8.0&auto=format&s=8d79633eb20c2cc35e4d1ecb752199cf not downloaded yet
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9478%252F20039478%252Fdamage_scratches-1774551481920.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9478/20039478/damage_scratches-1774551481920.jpg not downloaded yet
2026-03-29 20:13:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5139/20485139/exterior_rear_driver-1774696215479.jpg> (referer: None)
2026-03-29 20:13:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=540&page=15&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65c0ef210>
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674/e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5139%252F20485139%252Fexterior_front_driver-1774696197234.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5139/20485139/exterior_front_driver-1774696197234.jpg saved to cache
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65c0edc50>
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61f4b41e-afa0-593d-a54d-2b31994ad274/61f4b41e-afa0-593d-a54d-2b31994ad274_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8442%252F20488442%252Finterior_dashboard-1774710479224.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8442/20488442/interior_dashboard-1774710479224.jpg saved to cache
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 61f4b41e-afa0-593d-a54d-2b31994ad274
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599ef510>
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674/e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5139%252F20485139%252Fexterior_rear_driver-1774696215479.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5139/20485139/exterior_rear_driver-1774696215479.jpg saved to cache
2026-03-29 20:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 20301561
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 20480470
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 20025955
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 19072079
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719072079%27 HTTP/1.1" 200 None
2026-03-29 20:13:24 [motorway.uk] INFO: Scrape type for 19072079: 1
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 20478414
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 20390094
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 20355039
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 19897967
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 20416855
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 20036264
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 20463207
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 18730909
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 20382318
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 20398514
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 20484917
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 18872105
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 19791860
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 18667851
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 9844685
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 16823030
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 20408961
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 20296127
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 20222166
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 20474874
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 12127571
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 20483047
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 17857405
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 17585425
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717585425%27 HTTP/1.1" 200 None
2026-03-29 20:13:24 [motorway.uk] INFO: Scrape type for 17585425: 1
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 20401950
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 15315241
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 20394022
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720394022%27 HTTP/1.1" 200 None
2026-03-29 20:13:24 [motorway.uk] INFO: Scrape type for 20394022: 1
2026-03-29 20:13:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7458/20387458/damage_missing_trims-1774706365626.jpg> (referer: None)
2026-03-29 20:13:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8442/20488442/instrument_cluster-1774710614837.jpg> (referer: None)
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 20239538
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 20066529
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 2726366
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 20047376
2026-03-29 20:13:24 [motorway.uk] INFO: Found listing with ID: 19669988
2026-03-29 20:13:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5139/20485139/interior_dashboard-1774694609332.jpg> (referer: None)
2026-03-29 20:13:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/6704/14816704/docs_service_history-1774712476401.jpg?ixlib=js-3.8.0&auto=format&s=adcca7cf4a1c3250e5f310a1a39e48d9> (referer: None)
2026-03-29 20:13:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5139/20485139/interior_rear_seats-1774694545659.jpg> (referer: None)
2026-03-29 20:13:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9478/20039478/interior_boot-1774549894182.jpg> (referer: None)
2026-03-29 20:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7458/20387458/interior_dashboard-1774597354982.jpg> (referer: None)
2026-03-29 20:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7458/20387458/interior_boot-1774597400550.jpg> (referer: None)
2026-03-29 20:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8442/20488442/interior_front_seats-1774710416168.jpg> (referer: None)
2026-03-29 20:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8442/20488442/interior_rear_seats-1774710439287.jpg> (referer: None)
2026-03-29 20:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8442/20488442/interior_boot-1774710482858.jpg> (referer: None)
2026-03-29 20:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/9478/20039478/docs_service_history-1774551236323.jpg?ixlib=js-3.8.0&auto=format&s=8d79633eb20c2cc35e4d1ecb752199cf> (referer: None)
2026-03-29 20:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b45f90>
2026-03-29 20:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b50426-9aaa-5f41-8e71-68c60cfee6ab/d1b50426-9aaa-5f41-8e71-68c60cfee6ab_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7458%252F20387458%252Fdamage_missing_trims-1774706365626.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7458/20387458/damage_missing_trims-1774706365626.jpg saved to cache
2026-03-29 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d1b50426-9aaa-5f41-8e71-68c60cfee6ab
2026-03-29 20:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9478/20039478/damage_scratches-1774551481920.jpg> (referer: None)
2026-03-29 20:13:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e26c90>
2026-03-29 20:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61f4b41e-afa0-593d-a54d-2b31994ad274/61f4b41e-afa0-593d-a54d-2b31994ad274_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8442%252F20488442%252Finstrument_cluster-1774710614837.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8442/20488442/instrument_cluster-1774710614837.jpg saved to cache
2026-03-29 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 61f4b41e-afa0-593d-a54d-2b31994ad274
2026-03-29 20:13:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d03b50>
2026-03-29 20:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674/e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5139%252F20485139%252Finterior_dashboard-1774694609332.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5139/20485139/interior_dashboard-1774694609332.jpg saved to cache
2026-03-29 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674
2026-03-29 20:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf9c910>
2026-03-29 20:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cf46345-9e5b-5dac-9ec3-54b298104bf4/6cf46345-9e5b-5dac-9ec3-54b298104bf4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6704%252F14816704%252Fdocs_service_history-1774712476401.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dadcca7cf4a1c3250e5f310a1a39e48d9') HTTP/1.1" 204 0
2026-03-29 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6704/14816704/docs_service_history-1774712476401.jpg?ixlib=js-3.8.0&auto=format&s=adcca7cf4a1c3250e5f310a1a39e48d9 saved to cache
2026-03-29 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6cf46345-9e5b-5dac-9ec3-54b298104bf4
2026-03-29 20:13:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf083d0>
2026-03-29 20:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674/e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5139%252F20485139%252Finterior_rear_seats-1774694545659.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5139/20485139/interior_rear_seats-1774694545659.jpg saved to cache
2026-03-29 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674
2026-03-29 20:13:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674, skipping ID generation
2026-03-29 20:13:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674 with scrape type 1
2026-03-29 20:13:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674 sending to next pipeline
2026-03-29 20:13:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674, identifier: 20485139
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b84fd0>
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6381d4c9-30c7-54c9-a842-740f5af2d82a/6381d4c9-30c7-54c9-a842-740f5af2d82a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9478%252F20039478%252Finterior_boot-1774549894182.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9478/20039478/interior_boot-1774549894182.jpg saved to cache
2026-03-29 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6381d4c9-30c7-54c9-a842-740f5af2d82a
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d6d590>
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b50426-9aaa-5f41-8e71-68c60cfee6ab/d1b50426-9aaa-5f41-8e71-68c60cfee6ab_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7458%252F20387458%252Finterior_dashboard-1774597354982.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7458/20387458/interior_dashboard-1774597354982.jpg saved to cache
2026-03-29 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d1b50426-9aaa-5f41-8e71-68c60cfee6ab
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b2fad0>
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b50426-9aaa-5f41-8e71-68c60cfee6ab/d1b50426-9aaa-5f41-8e71-68c60cfee6ab_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7458%252F20387458%252Finterior_boot-1774597400550.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7458/20387458/interior_boot-1774597400550.jpg saved to cache
2026-03-29 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d1b50426-9aaa-5f41-8e71-68c60cfee6ab
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d00f90>
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61f4b41e-afa0-593d-a54d-2b31994ad274/61f4b41e-afa0-593d-a54d-2b31994ad274_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8442%252F20488442%252Finterior_front_seats-1774710416168.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8442/20488442/interior_front_seats-1774710416168.jpg saved to cache
2026-03-29 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 61f4b41e-afa0-593d-a54d-2b31994ad274
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d6e650>
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61f4b41e-afa0-593d-a54d-2b31994ad274/61f4b41e-afa0-593d-a54d-2b31994ad274_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8442%252F20488442%252Finterior_rear_seats-1774710439287.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8442/20488442/interior_rear_seats-1774710439287.jpg saved to cache
2026-03-29 20:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 61f4b41e-afa0-593d-a54d-2b31994ad274
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658338650>
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61f4b41e-afa0-593d-a54d-2b31994ad274/61f4b41e-afa0-593d-a54d-2b31994ad274_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8442%252F20488442%252Finterior_boot-1774710482858.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8442/20488442/interior_boot-1774710482858.jpg saved to cache
2026-03-29 20:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 61f4b41e-afa0-593d-a54d-2b31994ad274
2026-03-29 20:13:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65bd75fd0>
2026-03-29 20:13:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6381d4c9-30c7-54c9-a842-740f5af2d82a/6381d4c9-30c7-54c9-a842-740f5af2d82a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9478%252F20039478%252Fdocs_service_history-1774551236323.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8d79633eb20c2cc35e4d1ecb752199cf') HTTP/1.1" 204 0
2026-03-29 20:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9478/20039478/docs_service_history-1774551236323.jpg?ixlib=js-3.8.0&auto=format&s=8d79633eb20c2cc35e4d1ecb752199cf saved to cache
2026-03-29 20:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6381d4c9-30c7-54c9-a842-740f5af2d82a
2026-03-29 20:13:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674 with identifier: 20485139
2026-03-29 20:13:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674 with identifier: 20485139
2026-03-29 20:13:27 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674 with identifier: 20485139 to the API
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/5139/20485139/interior_rear_seats-1774694545659.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.9L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KR72 NXZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20485139',
'listing': 'auction',
'location': 'Lancashire Chorley',
'make': 'Mercedes',
'model': 'GLE Class',
'odometer': 31830,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674/e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2545315,
'Height': 2878,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5139/20485139/exterior_front_driver-1774696197234.jpg',
'Width': 3837},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674/e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2150667,
'Height': 2800,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5139/20485139/exterior_rear_driver-1774696215479.jpg',
'Width': 3733},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674/e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1701357,
'Height': 2792,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5139/20485139/exterior_front_passenger-1774693776307.jpg',
'Width': 3723},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674/e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1578800,
'Height': 2584,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5139/20485139/exterior_rear_passenger-1774693745625.jpg',
'Width': 3445},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674/e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3321886,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5139/20485139/interior_front_seats-1774694180013.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674/e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3815205,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5139/20485139/interior_rear_seats-1774694545659.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674/e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2901901,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5139/20485139/interior_dashboard-1774694609332.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674/e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2195787,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5139/20485139/instrument_cluster-1774694249497.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674/e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3605608,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5139/20485139/interior_boot-1774694319955.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674/e8f82a95-6a1d-56ef-9bc5-48ef9f6d7674_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1627726,
'Height': 2151,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5139/20485139/docs_service_history-1774695090870.jpg?ixlib=js-3.8.0&auto=format&s=92484ed99cf848dde04a22a839c34fe2',
'Width': 4891}],
'price': 42650,
'price_includes_vat': False,
'registration_date': '2023-01-03',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes GLE 400 AMG Line Prem D 4M A',
'transmission': 'automatic',
'trim': 'GLE 400 AMG Line Prem D 4M A',
'vin': 'W1N1671232A831275',
'year': 2023}
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720485139%27 HTTP/1.1" 200 None
2026-03-29 20:13:27 [motorway.uk] INFO: Saving data for 20485139: {'created_time': 1774815207.454832, 'last_price_update_time': 1774815207.454844, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20485139') HTTP/1.1" 204 0
2026-03-29 20:13:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658315810>
2026-03-29 20:13:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6381d4c9-30c7-54c9-a842-740f5af2d82a/6381d4c9-30c7-54c9-a842-740f5af2d82a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9478%252F20039478%252Fdamage_scratches-1774551481920.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9478/20039478/damage_scratches-1774551481920.jpg saved to cache
2026-03-29 20:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6381d4c9-30c7-54c9-a842-740f5af2d82a
2026-03-29 20:13:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20272813.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:27 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8442/20488442/docs_service_history-1774711051659.jpg?ixlib=js-3.8.0&auto=format&s=000e46333b7b740d97c3014f8582b0cd>.
2026-03-29 20:13:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c53c568c-92cb-5cd7-b4b8-8a90e0b08a41 with identifier: 20272813
2026-03-29 20:13:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c53c568c-92cb-5cd7-b4b8-8a90e0b08a41 with scrape type 1
2026-03-29 20:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c53c568c-92cb-5cd7-b4b8-8a90e0b08a41
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2813%252F20272813%252Fexterior_front_driver-1774717832344.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2813/20272813/exterior_front_driver-1774717832344.jpg not downloaded yet
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2813%252F20272813%252Fexterior_rear_driver-1774717845708.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2813/20272813/exterior_rear_driver-1774717845708.jpg not downloaded yet
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2813%252F20272813%252Fexterior_front_passenger-1774717959901.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2813/20272813/exterior_front_passenger-1774717959901.jpg not downloaded yet
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2813%252F20272813%252Fexterior_rear_passenger-1774717948399.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2813/20272813/exterior_rear_passenger-1774717948399.jpg not downloaded yet
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2813%252F20272813%252Finterior_front_seats-1774718248804.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2813/20272813/interior_front_seats-1774718248804.jpg not downloaded yet
2026-03-29 20:13:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20396926.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2813%252F20272813%252Finterior_rear_seats-1774718261483.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2813/20272813/interior_rear_seats-1774718261483.jpg not downloaded yet
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2813%252F20272813%252Finterior_dashboard-1774718296268.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2813/20272813/interior_dashboard-1774718296268.jpg not downloaded yet
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2813%252F20272813%252Finstrument_cluster-1774718353408.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2813/20272813/instrument_cluster-1774718353408.jpg not downloaded yet
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2813%252F20272813%252Finterior_boot-1774718300726.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2813/20272813/interior_boot-1774718300726.jpg not downloaded yet
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2813%252F20272813%252Fdocs_service_history-1774770872072.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8d79b7c88a8073dd713ee6cded412b73%27 HTTP/1.1" 200 None
2026-03-29 20:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2813/20272813/docs_service_history-1774770872072.jpg?ixlib=js-3.8.0&auto=format&s=8d79b7c88a8073dd713ee6cded412b73 not downloaded yet
2026-03-29 20:13:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdbce3c9-156c-5f4f-b6f2-95b6c0773c84 with identifier: 20396926
2026-03-29 20:13:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdbce3c9-156c-5f4f-b6f2-95b6c0773c84 with scrape type 1
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cdbce3c9-156c-5f4f-b6f2-95b6c0773c84
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6926%252F20396926%252Fexterior_front_driver-1774721886486.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6926/20396926/exterior_front_driver-1774721886486.jpeg not downloaded yet
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6926%252F20396926%252Fexterior_rear_driver-1774721928908.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6926/20396926/exterior_rear_driver-1774721928908.jpeg not downloaded yet
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6926%252F20396926%252Fexterior_front_passenger-1774721905296.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6926/20396926/exterior_front_passenger-1774721905296.jpeg not downloaded yet
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6926%252F20396926%252Fexterior_rear_passenger-1774721914223.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6926/20396926/exterior_rear_passenger-1774721914223.jpeg not downloaded yet
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6926%252F20396926%252Finterior_front_seats-1774722040551.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6926/20396926/interior_front_seats-1774722040551.jpeg not downloaded yet
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6926%252F20396926%252Finterior_rear_seats-1774722106108.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6926/20396926/interior_rear_seats-1774722106108.jpeg not downloaded yet
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6926%252F20396926%252Finterior_dashboard-1774722152314.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6926/20396926/interior_dashboard-1774722152314.jpeg not downloaded yet
2026-03-29 20:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9478/20039478/exterior_front_passenger-1774549290515.jpg> (referer: None)
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6926%252F20396926%252Finstrument_cluster-1774722305925.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6926/20396926/instrument_cluster-1774722305925.jpeg not downloaded yet
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6926%252F20396926%252Finterior_boot-1774722206594.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6926/20396926/interior_boot-1774722206594.jpeg not downloaded yet
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6926%252F20396926%252Fdamage_scratches-1774722278686.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6926/20396926/damage_scratches-1774722278686.jpeg not downloaded yet
2026-03-29 20:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8442/20488442/docs_service_history-1774711051659.jpg?ixlib=js-3.8.0&auto=format&s=000e46333b7b740d97c3014f8582b0cd> (referer: None)
2026-03-29 20:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9478/20039478/exterior_rear_passenger-1774549370512.jpg> (referer: None)
2026-03-29 20:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9478/20039478/interior_dashboard-1774549960742.jpg> (referer: None)
2026-03-29 20:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9478/20039478/interior_rear_seats-1774549825975.jpg> (referer: None)
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589e40d0>
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6381d4c9-30c7-54c9-a842-740f5af2d82a/6381d4c9-30c7-54c9-a842-740f5af2d82a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9478%252F20039478%252Fexterior_front_passenger-1774549290515.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9478/20039478/exterior_front_passenger-1774549290515.jpg saved to cache
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6381d4c9-30c7-54c9-a842-740f5af2d82a
2026-03-29 20:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6704/14816704/interior_dashboard-1774709939817.jpg> (referer: None)
2026-03-29 20:13:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a16410>
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61f4b41e-afa0-593d-a54d-2b31994ad274/61f4b41e-afa0-593d-a54d-2b31994ad274_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8442%252F20488442%252Fdocs_service_history-1774711051659.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D000e46333b7b740d97c3014f8582b0cd') HTTP/1.1" 204 0
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8442/20488442/docs_service_history-1774711051659.jpg?ixlib=js-3.8.0&auto=format&s=000e46333b7b740d97c3014f8582b0cd saved to cache
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 61f4b41e-afa0-593d-a54d-2b31994ad274
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658366ed0>
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6381d4c9-30c7-54c9-a842-740f5af2d82a/6381d4c9-30c7-54c9-a842-740f5af2d82a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9478%252F20039478%252Fexterior_rear_passenger-1774549370512.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9478/20039478/exterior_rear_passenger-1774549370512.jpg saved to cache
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6381d4c9-30c7-54c9-a842-740f5af2d82a
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfb5d10>
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6381d4c9-30c7-54c9-a842-740f5af2d82a/6381d4c9-30c7-54c9-a842-740f5af2d82a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9478%252F20039478%252Finterior_dashboard-1774549960742.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9478/20039478/interior_dashboard-1774549960742.jpg saved to cache
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6381d4c9-30c7-54c9-a842-740f5af2d82a
2026-03-29 20:13:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:13:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c59010>
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6381d4c9-30c7-54c9-a842-740f5af2d82a/6381d4c9-30c7-54c9-a842-740f5af2d82a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9478%252F20039478%252Finterior_rear_seats-1774549825975.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9478/20039478/interior_rear_seats-1774549825975.jpg saved to cache
2026-03-29 20:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6381d4c9-30c7-54c9-a842-740f5af2d82a
2026-03-29 20:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9478/20039478/interior_front_seats-1774549790988.jpg> (referer: None)
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e55b90>
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cf46345-9e5b-5dac-9ec3-54b298104bf4/6cf46345-9e5b-5dac-9ec3-54b298104bf4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6704%252F14816704%252Finterior_dashboard-1774709939817.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6704/14816704/interior_dashboard-1774709939817.jpg saved to cache
2026-03-29 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6cf46345-9e5b-5dac-9ec3-54b298104bf4
2026-03-29 20:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6704/14816704/interior_boot-1774709848730.jpg> (referer: None)
2026-03-29 20:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2813/20272813/interior_front_seats-1774718248804.jpg> (referer: None)
2026-03-29 20:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9478/20039478/exterior_rear_driver-1774549190502.jpg> (referer: None)
2026-03-29 20:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6704/14816704/interior_rear_seats-1774709781994.jpg> (referer: None)
2026-03-29 20:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6926/20396926/interior_dashboard-1774722152314.jpeg> (referer: None)
2026-03-29 20:13:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:13:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598df190>
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6381d4c9-30c7-54c9-a842-740f5af2d82a/6381d4c9-30c7-54c9-a842-740f5af2d82a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9478%252F20039478%252Finterior_front_seats-1774549790988.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9478/20039478/interior_front_seats-1774549790988.jpg saved to cache
2026-03-29 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6381d4c9-30c7-54c9-a842-740f5af2d82a
2026-03-29 20:13:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a31050>
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cf46345-9e5b-5dac-9ec3-54b298104bf4/6cf46345-9e5b-5dac-9ec3-54b298104bf4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6704%252F14816704%252Finterior_boot-1774709848730.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6704/14816704/interior_boot-1774709848730.jpg saved to cache
2026-03-29 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6cf46345-9e5b-5dac-9ec3-54b298104bf4
2026-03-29 20:13:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cbb990>
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c53c568c-92cb-5cd7-b4b8-8a90e0b08a41/c53c568c-92cb-5cd7-b4b8-8a90e0b08a41_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2813%252F20272813%252Finterior_front_seats-1774718248804.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2813/20272813/interior_front_seats-1774718248804.jpg saved to cache
2026-03-29 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c53c568c-92cb-5cd7-b4b8-8a90e0b08a41
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582f0a10>
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6381d4c9-30c7-54c9-a842-740f5af2d82a/6381d4c9-30c7-54c9-a842-740f5af2d82a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9478%252F20039478%252Fexterior_rear_driver-1774549190502.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9478/20039478/exterior_rear_driver-1774549190502.jpg saved to cache
2026-03-29 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6381d4c9-30c7-54c9-a842-740f5af2d82a
2026-03-29 20:13:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658db1b90>
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cf46345-9e5b-5dac-9ec3-54b298104bf4/6cf46345-9e5b-5dac-9ec3-54b298104bf4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6704%252F14816704%252Finterior_rear_seats-1774709781994.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6704/14816704/interior_rear_seats-1774709781994.jpg saved to cache
2026-03-29 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6cf46345-9e5b-5dac-9ec3-54b298104bf4
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c5ced0>
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbce3c9-156c-5f4f-b6f2-95b6c0773c84/cdbce3c9-156c-5f4f-b6f2-95b6c0773c84_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6926%252F20396926%252Finterior_dashboard-1774722152314.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6926/20396926/interior_dashboard-1774722152314.jpeg saved to cache
2026-03-29 20:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cdbce3c9-156c-5f4f-b6f2-95b6c0773c84
2026-03-29 20:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=576&page=16&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6704/14816704/instrument_cluster-1774709871633.jpg> (referer: None)
2026-03-29 20:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6926/20396926/damage_scratches-1774722278686.jpeg> (referer: None)
2026-03-29 20:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6926/20396926/instrument_cluster-1774722305925.jpeg> (referer: None)
2026-03-29 20:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6926/20396926/interior_boot-1774722206594.jpeg> (referer: None)
2026-03-29 20:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6926/20396926/interior_rear_seats-1774722106108.jpeg> (referer: None)
2026-03-29 20:13:30 [motorway.uk] INFO: Found listing with ID: 19821442
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719821442%27 HTTP/1.1" 200 None
2026-03-29 20:13:30 [motorway.uk] INFO: Scrape type for 19821442: 1
2026-03-29 20:13:30 [motorway.uk] INFO: Found listing with ID: 14648195
2026-03-29 20:13:30 [motorway.uk] INFO: Found listing with ID: 20442579
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720442579%27 HTTP/1.1" 200 None
2026-03-29 20:13:30 [motorway.uk] INFO: Scrape type for 20442579: 1
2026-03-29 20:13:30 [motorway.uk] INFO: Found listing with ID: 19708166
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719708166%27 HTTP/1.1" 200 None
2026-03-29 20:13:30 [motorway.uk] INFO: Scrape type for 19708166: 1
2026-03-29 20:13:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658454090>
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cf46345-9e5b-5dac-9ec3-54b298104bf4/6cf46345-9e5b-5dac-9ec3-54b298104bf4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6704%252F14816704%252Finstrument_cluster-1774709871633.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6704/14816704/instrument_cluster-1774709871633.jpg saved to cache
2026-03-29 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6cf46345-9e5b-5dac-9ec3-54b298104bf4
2026-03-29 20:13:30 [motorway.uk] INFO: Found listing with ID: 20460964
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720460964%27 HTTP/1.1" 200 None
2026-03-29 20:13:30 [motorway.uk] INFO: Scrape type for 20460964: 1
2026-03-29 20:13:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2813/20272813/docs_service_history-1774770872072.jpg?ixlib=js-3.8.0&auto=format&s=8d79b7c88a8073dd713ee6cded412b73> (referer: None)
2026-03-29 20:13:30 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:13:30 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:13:30 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x1e\xc2\x90\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01z\xb9\x00\x1e\xb8\x8a\x00\x00\x00\x00'
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c150d0>
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbce3c9-156c-5f4f-b6f2-95b6c0773c84/cdbce3c9-156c-5f4f-b6f2-95b6c0773c84_image_9.mpo HTTP/1.1" 201 0
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6926%252F20396926%252Fdamage_scratches-1774722278686.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6926/20396926/damage_scratches-1774722278686.jpeg saved to cache
2026-03-29 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cdbce3c9-156c-5f4f-b6f2-95b6c0773c84
2026-03-29 20:13:30 [motorway.uk] INFO: Found listing with ID: 20264228
2026-03-29 20:13:30 [motorway.uk] INFO: Found listing with ID: 15594477
2026-03-29 20:13:30 [motorway.uk] INFO: Found listing with ID: 20307515
2026-03-29 20:13:30 [motorway.uk] INFO: Found listing with ID: 20481960
2026-03-29 20:13:30 [motorway.uk] INFO: Found listing with ID: 15910710
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715910710%27 HTTP/1.1" 200 None
2026-03-29 20:13:30 [motorway.uk] INFO: Scrape type for 15910710: 1
2026-03-29 20:13:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17585425.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:30 [motorway.uk] INFO: Found listing with ID: 19313899
2026-03-29 20:13:30 [motorway.uk] INFO: Found listing with ID: 20338223
2026-03-29 20:13:30 [motorway.uk] INFO: Found listing with ID: 18332731
2026-03-29 20:13:30 [motorway.uk] INFO: Found listing with ID: 20355749
2026-03-29 20:13:30 [motorway.uk] INFO: Found listing with ID: 10308764
2026-03-29 20:13:30 [motorway.uk] INFO: Found listing with ID: 20467839
2026-03-29 20:13:30 [motorway.uk] INFO: Found listing with ID: 17807552
2026-03-29 20:13:30 [motorway.uk] INFO: Found listing with ID: 20191585
2026-03-29 20:13:30 [motorway.uk] INFO: Found listing with ID: 20484266
2026-03-29 20:13:30 [motorway.uk] INFO: Found listing with ID: 18989112
2026-03-29 20:13:30 [motorway.uk] INFO: Found listing with ID: 20444774
2026-03-29 20:13:30 [motorway.uk] INFO: Found listing with ID: 13523395
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713523395%27 HTTP/1.1" 200 None
2026-03-29 20:13:30 [motorway.uk] INFO: Scrape type for 13523395: 1
2026-03-29 20:13:30 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:13:30 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:13:30 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00*d\xd4\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xc47\x00*Z\xce\x00\x00\x00\x00'
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65bf04290>
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbce3c9-156c-5f4f-b6f2-95b6c0773c84/cdbce3c9-156c-5f4f-b6f2-95b6c0773c84_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6926%252F20396926%252Finstrument_cluster-1774722305925.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6926/20396926/instrument_cluster-1774722305925.jpeg saved to cache
2026-03-29 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cdbce3c9-156c-5f4f-b6f2-95b6c0773c84
2026-03-29 20:13:30 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:13:30 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:13:30 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x001\xa8\xbe\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x04\xfc\x001\x9e\xb8\x00\x00\x00\x00'
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d7d1d0>
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbce3c9-156c-5f4f-b6f2-95b6c0773c84/cdbce3c9-156c-5f4f-b6f2-95b6c0773c84_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6926%252F20396926%252Finterior_boot-1774722206594.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6926/20396926/interior_boot-1774722206594.jpeg saved to cache
2026-03-29 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cdbce3c9-156c-5f4f-b6f2-95b6c0773c84
2026-03-29 20:13:30 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:13:30 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:13:30 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x002\x1e\xe1\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x8d\xf5\x002\x14\xdb\x00\x00\x00\x00'
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f05150>
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbce3c9-156c-5f4f-b6f2-95b6c0773c84/cdbce3c9-156c-5f4f-b6f2-95b6c0773c84_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6926%252F20396926%252Finterior_rear_seats-1774722106108.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6926/20396926/interior_rear_seats-1774722106108.jpeg saved to cache
2026-03-29 20:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cdbce3c9-156c-5f4f-b6f2-95b6c0773c84
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583e5790>
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c53c568c-92cb-5cd7-b4b8-8a90e0b08a41/c53c568c-92cb-5cd7-b4b8-8a90e0b08a41_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2813%252F20272813%252Fdocs_service_history-1774770872072.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8d79b7c88a8073dd713ee6cded412b73') HTTP/1.1" 204 0
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2813/20272813/docs_service_history-1774770872072.jpg?ixlib=js-3.8.0&auto=format&s=8d79b7c88a8073dd713ee6cded412b73 saved to cache
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c53c568c-92cb-5cd7-b4b8-8a90e0b08a41
2026-03-29 20:13:31 [motorway.uk] INFO: Found listing with ID: 18011097
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718011097%27 HTTP/1.1" 200 None
2026-03-29 20:13:31 [motorway.uk] INFO: Scrape type for 18011097: 1
2026-03-29 20:13:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c23fb1c6-07a8-59cb-b95b-ee9201b8cb76 with identifier: 17585425
2026-03-29 20:13:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c23fb1c6-07a8-59cb-b95b-ee9201b8cb76 with scrape type 1
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c23fb1c6-07a8-59cb-b95b-ee9201b8cb76
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5425%252F17585425%252Fexterior_front_driver-1774628522021.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5425/17585425/exterior_front_driver-1774628522021.jpg not downloaded yet
2026-03-29 20:13:31 [motorway.uk] INFO: Found listing with ID: 5866923
2026-03-29 20:13:31 [motorway.uk] INFO: Found listing with ID: 20468575
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720468575%27 HTTP/1.1" 200 None
2026-03-29 20:13:31 [motorway.uk] INFO: Scrape type for 20468575: 1
2026-03-29 20:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6926/20396926/interior_front_seats-1774722040551.jpeg> (referer: None)
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5425%252F17585425%252Fexterior_rear_driver-1774628530790.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5425/17585425/exterior_rear_driver-1774628530790.jpg not downloaded yet
2026-03-29 20:13:31 [motorway.uk] INFO: Found listing with ID: 11768479
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711768479%27 HTTP/1.1" 200 None
2026-03-29 20:13:31 [motorway.uk] INFO: Scrape type for 11768479: 0
2026-03-29 20:13:31 [motorway.uk] INFO: Found listing with ID: 14717398
2026-03-29 20:13:31 [motorway.uk] INFO: Found listing with ID: 20455953
2026-03-29 20:13:31 [motorway.uk] INFO: Found listing with ID: 20240624
2026-03-29 20:13:31 [motorway.uk] INFO: Found listing with ID: 18507220
2026-03-29 20:13:31 [motorway.uk] INFO: Found listing with ID: 17656743
2026-03-29 20:13:31 [motorway.uk] INFO: Found listing with ID: 20131585
2026-03-29 20:13:31 [motorway.uk] INFO: Found listing with ID: 20444590
2026-03-29 20:13:31 [motorway.uk] INFO: Found listing with ID: 20396560
2026-03-29 20:13:31 [motorway.uk] INFO: Found listing with ID: 20484632
2026-03-29 20:13:31 [motorway.uk] INFO: Found listing with ID: 2939803
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5425%252F17585425%252Fexterior_front_passenger-1774628559612.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5425/17585425/exterior_front_passenger-1774628559612.jpg not downloaded yet
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5425%252F17585425%252Fexterior_rear_passenger-1774628548929.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5425/17585425/exterior_rear_passenger-1774628548929.jpg not downloaded yet
2026-03-29 20:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2813/20272813/interior_dashboard-1774718296268.jpg> (referer: None)
2026-03-29 20:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6926/20396926/exterior_rear_passenger-1774721914223.jpeg> (referer: None)
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5425%252F17585425%252Finterior_front_seats-1774629085728.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5425/17585425/interior_front_seats-1774629085728.jpg not downloaded yet
2026-03-29 20:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6926/20396926/exterior_rear_driver-1774721928908.jpeg> (referer: None)
2026-03-29 20:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6926/20396926/exterior_front_passenger-1774721905296.jpeg> (referer: None)
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5425%252F17585425%252Finterior_rear_seats-1774629109435.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5425/17585425/interior_rear_seats-1774629109435.jpg not downloaded yet
2026-03-29 20:13:31 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:13:31 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:13:31 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x006\xcc\xdc\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xac+\x006\xc2\xd6\x00\x00\x00\x00'
2026-03-29 20:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658da7690>
2026-03-29 20:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbce3c9-156c-5f4f-b6f2-95b6c0773c84/cdbce3c9-156c-5f4f-b6f2-95b6c0773c84_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6926%252F20396926%252Finterior_front_seats-1774722040551.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6926/20396926/interior_front_seats-1774722040551.jpeg saved to cache
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cdbce3c9-156c-5f4f-b6f2-95b6c0773c84
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5425%252F17585425%252Finterior_dashboard-1774692644043.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5425/17585425/interior_dashboard-1774692644043.jpg not downloaded yet
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5425%252F17585425%252Finstrument_cluster-1774629188839.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5425/17585425/instrument_cluster-1774629188839.jpg not downloaded yet
2026-03-29 20:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be7d150>
2026-03-29 20:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c53c568c-92cb-5cd7-b4b8-8a90e0b08a41/c53c568c-92cb-5cd7-b4b8-8a90e0b08a41_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2813%252F20272813%252Finterior_dashboard-1774718296268.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2813/20272813/interior_dashboard-1774718296268.jpg saved to cache
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c53c568c-92cb-5cd7-b4b8-8a90e0b08a41
2026-03-29 20:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584f3a50>
2026-03-29 20:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbce3c9-156c-5f4f-b6f2-95b6c0773c84/cdbce3c9-156c-5f4f-b6f2-95b6c0773c84_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6926%252F20396926%252Fexterior_rear_passenger-1774721914223.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6926/20396926/exterior_rear_passenger-1774721914223.jpeg saved to cache
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cdbce3c9-156c-5f4f-b6f2-95b6c0773c84
2026-03-29 20:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ca2250>
2026-03-29 20:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbce3c9-156c-5f4f-b6f2-95b6c0773c84/cdbce3c9-156c-5f4f-b6f2-95b6c0773c84_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6926%252F20396926%252Fexterior_rear_driver-1774721928908.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6926/20396926/exterior_rear_driver-1774721928908.jpeg saved to cache
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cdbce3c9-156c-5f4f-b6f2-95b6c0773c84
2026-03-29 20:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b3bdd0>
2026-03-29 20:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbce3c9-156c-5f4f-b6f2-95b6c0773c84/cdbce3c9-156c-5f4f-b6f2-95b6c0773c84_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6926%252F20396926%252Fexterior_front_passenger-1774721905296.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6926/20396926/exterior_front_passenger-1774721905296.jpeg saved to cache
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cdbce3c9-156c-5f4f-b6f2-95b6c0773c84
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5425%252F17585425%252Finterior_boot-1774629156584.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5425/17585425/interior_boot-1774629156584.jpg not downloaded yet
2026-03-29 20:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19072079.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5425%252F17585425%252Fdocs_service_history-1774629467853.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D98e2d255991d423a6eecd849fd89d48e%27 HTTP/1.1" 200 None
2026-03-29 20:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5425/17585425/docs_service_history-1774629467853.jpg?ixlib=js-3.8.0&auto=format&s=98e2d255991d423a6eecd849fd89d48e not downloaded yet
2026-03-29 20:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6926/20396926/exterior_front_driver-1774721886486.jpeg> (referer: None)
2026-03-29 20:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2813/20272813/instrument_cluster-1774718353408.jpg> (referer: None)
2026-03-29 20:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2813/20272813/interior_rear_seats-1774718261483.jpg> (referer: None)
2026-03-29 20:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5425/17585425/exterior_front_driver-1774628522021.jpg> (referer: None)
2026-03-29 20:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2813/20272813/interior_boot-1774718300726.jpg> (referer: None)
2026-03-29 20:13:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d82df10-a56e-5b49-8ac2-a8a257bafe77 with identifier: 19072079
2026-03-29 20:13:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d82df10-a56e-5b49-8ac2-a8a257bafe77 with scrape type 1
2026-03-29 20:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9d82df10-a56e-5b49-8ac2-a8a257bafe77
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2079%252F19072079%252Fexterior_front_driver-1774782192329.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2079/19072079/exterior_front_driver-1774782192329.jpg not downloaded yet
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2079%252F19072079%252Fexterior_rear_driver-1774722479518.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2079/19072079/exterior_rear_driver-1774722479518.jpg not downloaded yet
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2079%252F19072079%252Fexterior_front_passenger-1774722475383.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2079/19072079/exterior_front_passenger-1774722475383.jpg not downloaded yet
2026-03-29 20:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659afa2d0>
2026-03-29 20:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdbce3c9-156c-5f4f-b6f2-95b6c0773c84/cdbce3c9-156c-5f4f-b6f2-95b6c0773c84_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6926%252F20396926%252Fexterior_front_driver-1774721886486.jpeg') HTTP/1.1" 204 0
2026-03-29 20:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6926/20396926/exterior_front_driver-1774721886486.jpeg saved to cache
2026-03-29 20:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cdbce3c9-156c-5f4f-b6f2-95b6c0773c84
2026-03-29 20:13:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cdbce3c9-156c-5f4f-b6f2-95b6c0773c84, skipping ID generation
2026-03-29 20:13:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdbce3c9-156c-5f4f-b6f2-95b6c0773c84 with scrape type 1
2026-03-29 20:13:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cdbce3c9-156c-5f4f-b6f2-95b6c0773c84 sending to next pipeline
2026-03-29 20:13:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: cdbce3c9-156c-5f4f-b6f2-95b6c0773c84, identifier: 20396926
2026-03-29 20:13:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: cdbce3c9-156c-5f4f-b6f2-95b6c0773c84 with identifier: 20396926
2026-03-29 20:13:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: cdbce3c9-156c-5f4f-b6f2-95b6c0773c84 with identifier: 20396926
2026-03-29 20:13:32 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: cdbce3c9-156c-5f4f-b6f2-95b6c0773c84 with identifier: 20396926 to the API
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6926/20396926/exterior_front_driver-1774721886486.jpeg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'cdbce3c9-156c-5f4f-b6f2-95b6c0773c84',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BK64 NZP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20396926',
'listing': 'auction',
'location': 'Greater London Worcester Park',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 60000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbce3c9-156c-5f4f-b6f2-95b6c0773c84/cdbce3c9-156c-5f4f-b6f2-95b6c0773c84_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1663953,
'Height': 2757,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6926/20396926/exterior_front_driver-1774721886486.jpeg',
'Width': 3676},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbce3c9-156c-5f4f-b6f2-95b6c0773c84/cdbce3c9-156c-5f4f-b6f2-95b6c0773c84_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1104860,
'Height': 2495,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6926/20396926/exterior_rear_driver-1774721928908.jpeg',
'Width': 3327},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbce3c9-156c-5f4f-b6f2-95b6c0773c84/cdbce3c9-156c-5f4f-b6f2-95b6c0773c84_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1067729,
'Height': 2400,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6926/20396926/exterior_front_passenger-1774721905296.jpeg',
'Width': 3200},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbce3c9-156c-5f4f-b6f2-95b6c0773c84/cdbce3c9-156c-5f4f-b6f2-95b6c0773c84_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1165380,
'Height': 2461,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6926/20396926/exterior_rear_passenger-1774721914223.jpeg',
'Width': 3281},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbce3c9-156c-5f4f-b6f2-95b6c0773c84/cdbce3c9-156c-5f4f-b6f2-95b6c0773c84_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3700999,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6926/20396926/interior_front_seats-1774722040551.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbce3c9-156c-5f4f-b6f2-95b6c0773c84/cdbce3c9-156c-5f4f-b6f2-95b6c0773c84_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3452118,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6926/20396926/interior_rear_seats-1774722106108.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbce3c9-156c-5f4f-b6f2-95b6c0773c84/cdbce3c9-156c-5f4f-b6f2-95b6c0773c84_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1433005,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6926/20396926/interior_dashboard-1774722152314.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbce3c9-156c-5f4f-b6f2-95b6c0773c84/cdbce3c9-156c-5f4f-b6f2-95b6c0773c84_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2894091,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6926/20396926/instrument_cluster-1774722305925.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbce3c9-156c-5f4f-b6f2-95b6c0773c84/cdbce3c9-156c-5f4f-b6f2-95b6c0773c84_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3386810,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6926/20396926/interior_boot-1774722206594.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cdbce3c9-156c-5f4f-b6f2-95b6c0773c84/cdbce3c9-156c-5f4f-b6f2-95b6c0773c84_image_9.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2112841,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6926/20396926/damage_scratches-1774722278686.jpeg',
'Width': 4032}],
'price': 6057,
'price_includes_vat': False,
'registration_date': '2014-09-26',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Polo SE TSI S-A',
'transmission': 'automatic',
'trim': 'SE TSI S-A',
'vin': 'WVWZZZ6RZFU020069',
'year': 2014}
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720396926%27 HTTP/1.1" 200 None
2026-03-29 20:13:32 [motorway.uk] INFO: Saving data for 20396926: {'created_time': 1774815212.986221, 'last_price_update_time': 1774815212.986231, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20396926') HTTP/1.1" 204 0
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2079%252F19072079%252Fexterior_rear_passenger-1774722481005.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2079/19072079/exterior_rear_passenger-1774722481005.jpg not downloaded yet
2026-03-29 20:13:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6585288d0>
2026-03-29 20:13:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c53c568c-92cb-5cd7-b4b8-8a90e0b08a41/c53c568c-92cb-5cd7-b4b8-8a90e0b08a41_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2813%252F20272813%252Finstrument_cluster-1774718353408.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2813/20272813/instrument_cluster-1774718353408.jpg saved to cache
2026-03-29 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c53c568c-92cb-5cd7-b4b8-8a90e0b08a41
2026-03-29 20:13:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fd9a10>
2026-03-29 20:13:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c53c568c-92cb-5cd7-b4b8-8a90e0b08a41/c53c568c-92cb-5cd7-b4b8-8a90e0b08a41_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2813%252F20272813%252Finterior_rear_seats-1774718261483.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2813/20272813/interior_rear_seats-1774718261483.jpg saved to cache
2026-03-29 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c53c568c-92cb-5cd7-b4b8-8a90e0b08a41
2026-03-29 20:13:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf5c6d0>
2026-03-29 20:13:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c23fb1c6-07a8-59cb-b95b-ee9201b8cb76/c23fb1c6-07a8-59cb-b95b-ee9201b8cb76_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5425%252F17585425%252Fexterior_front_driver-1774628522021.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5425/17585425/exterior_front_driver-1774628522021.jpg saved to cache
2026-03-29 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c23fb1c6-07a8-59cb-b95b-ee9201b8cb76
2026-03-29 20:13:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ca15d0>
2026-03-29 20:13:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c53c568c-92cb-5cd7-b4b8-8a90e0b08a41/c53c568c-92cb-5cd7-b4b8-8a90e0b08a41_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2813%252F20272813%252Finterior_boot-1774718300726.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2813/20272813/interior_boot-1774718300726.jpg saved to cache
2026-03-29 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c53c568c-92cb-5cd7-b4b8-8a90e0b08a41
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2079%252F19072079%252Finterior_front_seats-1774722821567.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2079/19072079/interior_front_seats-1774722821567.jpg not downloaded yet
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2079%252F19072079%252Finterior_rear_seats-1774782223464.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2079/19072079/interior_rear_seats-1774782223464.jpg not downloaded yet
2026-03-29 20:13:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20394022.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5425/17585425/docs_service_history-1774629467853.jpg?ixlib=js-3.8.0&auto=format&s=98e2d255991d423a6eecd849fd89d48e> (referer: None)
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2079%252F19072079%252Finterior_dashboard-1774722953222.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2079/19072079/interior_dashboard-1774722953222.jpg not downloaded yet
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2079%252F19072079%252Finstrument_cluster-1774781294133.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2079/19072079/instrument_cluster-1774781294133.jpg not downloaded yet
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2079%252F19072079%252Finterior_boot-1774781441727.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2079/19072079/interior_boot-1774781441727.jpg not downloaded yet
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2079%252F19072079%252Fdocs_service_history-1774781880314.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8745fd9eefe2ff078ab3698314ffda6f%27 HTTP/1.1" 200 None
2026-03-29 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2079/19072079/docs_service_history-1774781880314.jpg?ixlib=js-3.8.0&auto=format&s=8745fd9eefe2ff078ab3698314ffda6f not downloaded yet
2026-03-29 20:13:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e25743b6-4f93-53e4-b8f4-d480530832f9 with identifier: 20394022
2026-03-29 20:13:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e25743b6-4f93-53e4-b8f4-d480530832f9 with scrape type 1
2026-03-29 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e25743b6-4f93-53e4-b8f4-d480530832f9
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4022%252F20394022%252Fexterior_front_driver-1774690660531.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4022/20394022/exterior_front_driver-1774690660531.jpg not downloaded yet
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4022%252F20394022%252Fexterior_rear_driver-1774690653119.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4022/20394022/exterior_rear_driver-1774690653119.jpg not downloaded yet
2026-03-29 20:13:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658534ed0>
2026-03-29 20:13:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c23fb1c6-07a8-59cb-b95b-ee9201b8cb76/c23fb1c6-07a8-59cb-b95b-ee9201b8cb76_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5425%252F17585425%252Fdocs_service_history-1774629467853.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D98e2d255991d423a6eecd849fd89d48e') HTTP/1.1" 204 0
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5425/17585425/docs_service_history-1774629467853.jpg?ixlib=js-3.8.0&auto=format&s=98e2d255991d423a6eecd849fd89d48e saved to cache
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c23fb1c6-07a8-59cb-b95b-ee9201b8cb76
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4022%252F20394022%252Fexterior_front_passenger-1774690658613.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4022/20394022/exterior_front_passenger-1774690658613.jpg not downloaded yet
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4022%252F20394022%252Fexterior_rear_passenger-1774690661998.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4022/20394022/exterior_rear_passenger-1774690661998.jpg not downloaded yet
2026-03-29 20:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5425/17585425/exterior_rear_passenger-1774628548929.jpg> (referer: None)
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4022%252F20394022%252Finterior_front_seats-1774691255564.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4022/20394022/interior_front_seats-1774691255564.jpg not downloaded yet
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4022%252F20394022%252Finterior_dashboard-1774691274443.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4022/20394022/interior_dashboard-1774691274443.jpg not downloaded yet
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4022%252F20394022%252Finterior_boot-1774691252874.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4022/20394022/interior_boot-1774691252874.jpg not downloaded yet
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4022%252F20394022%252Fdocs_service_history-1774691433241.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9769025e086ab8bf52a61bc8f0077a27%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4022/20394022/docs_service_history-1774691433241.jpg?ixlib=js-3.8.0&auto=format&s=9769025e086ab8bf52a61bc8f0077a27 not downloaded yet
2026-03-29 20:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2079/19072079/exterior_front_passenger-1774722475383.jpg> (referer: None)
2026-03-29 20:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2079/19072079/exterior_rear_driver-1774722479518.jpg> (referer: None)
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4022%252F20394022%252Fdocs_service_history-1774691505062.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D060e420e99232f4b07d22765b36c0f92%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4022/20394022/docs_service_history-1774691505062.jpg?ixlib=js-3.8.0&auto=format&s=060e420e99232f4b07d22765b36c0f92 not downloaded yet
2026-03-29 20:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2079/19072079/interior_rear_seats-1774782223464.jpg> (referer: None)
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4022%252F20394022%252Fdocs_service_history-1774691529532.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4e9a5b399a980909fa213b473f8a5088%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4022/20394022/docs_service_history-1774691529532.jpg?ixlib=js-3.8.0&auto=format&s=4e9a5b399a980909fa213b473f8a5088 not downloaded yet
2026-03-29 20:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fd9b50>
2026-03-29 20:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c23fb1c6-07a8-59cb-b95b-ee9201b8cb76/c23fb1c6-07a8-59cb-b95b-ee9201b8cb76_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5425%252F17585425%252Fexterior_rear_passenger-1774628548929.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5425/17585425/exterior_rear_passenger-1774628548929.jpg saved to cache
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c23fb1c6-07a8-59cb-b95b-ee9201b8cb76
2026-03-29 20:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2079/19072079/interior_front_seats-1774722821567.jpg> (referer: None)
2026-03-29 20:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13523395.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5425/17585425/interior_dashboard-1774692644043.jpg> (referer: None)
2026-03-29 20:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659be8b90>
2026-03-29 20:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d82df10-a56e-5b49-8ac2-a8a257bafe77/9d82df10-a56e-5b49-8ac2-a8a257bafe77_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2079%252F19072079%252Fexterior_front_passenger-1774722475383.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2079/19072079/exterior_front_passenger-1774722475383.jpg saved to cache
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9d82df10-a56e-5b49-8ac2-a8a257bafe77
2026-03-29 20:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fd23d0>
2026-03-29 20:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d82df10-a56e-5b49-8ac2-a8a257bafe77/9d82df10-a56e-5b49-8ac2-a8a257bafe77_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2079%252F19072079%252Fexterior_rear_driver-1774722479518.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2079/19072079/exterior_rear_driver-1774722479518.jpg saved to cache
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9d82df10-a56e-5b49-8ac2-a8a257bafe77
2026-03-29 20:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582f20d0>
2026-03-29 20:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d82df10-a56e-5b49-8ac2-a8a257bafe77/9d82df10-a56e-5b49-8ac2-a8a257bafe77_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2079%252F19072079%252Finterior_rear_seats-1774782223464.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2079/19072079/interior_rear_seats-1774782223464.jpg saved to cache
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9d82df10-a56e-5b49-8ac2-a8a257bafe77
2026-03-29 20:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5425/17585425/instrument_cluster-1774629188839.jpg> (referer: None)
2026-03-29 20:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf530d0>
2026-03-29 20:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d82df10-a56e-5b49-8ac2-a8a257bafe77/9d82df10-a56e-5b49-8ac2-a8a257bafe77_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2079%252F19072079%252Finterior_front_seats-1774722821567.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2079/19072079/interior_front_seats-1774722821567.jpg saved to cache
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9d82df10-a56e-5b49-8ac2-a8a257bafe77
2026-03-29 20:13:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31c52695-401a-544b-b88a-79015e24b6dc with identifier: 13523395
2026-03-29 20:13:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31c52695-401a-544b-b88a-79015e24b6dc with scrape type 1
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 31c52695-401a-544b-b88a-79015e24b6dc
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3395%252F13523395%252Fexterior_front_driver-1774695631416.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3395/13523395/exterior_front_driver-1774695631416.jpg not downloaded yet
2026-03-29 20:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e12f90>
2026-03-29 20:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c23fb1c6-07a8-59cb-b95b-ee9201b8cb76/c23fb1c6-07a8-59cb-b95b-ee9201b8cb76_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5425%252F17585425%252Finterior_dashboard-1774692644043.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5425/17585425/interior_dashboard-1774692644043.jpg saved to cache
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c23fb1c6-07a8-59cb-b95b-ee9201b8cb76
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3395%252F13523395%252Fexterior_rear_driver-1774693614614.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3395/13523395/exterior_rear_driver-1774693614614.jpg not downloaded yet
2026-03-29 20:13:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19708166.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3395%252F13523395%252Fexterior_front_passenger-1774693610191.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3395/13523395/exterior_front_passenger-1774693610191.jpg not downloaded yet
2026-03-29 20:13:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a16050>
2026-03-29 20:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c23fb1c6-07a8-59cb-b95b-ee9201b8cb76/c23fb1c6-07a8-59cb-b95b-ee9201b8cb76_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5425%252F17585425%252Finstrument_cluster-1774629188839.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5425/17585425/instrument_cluster-1774629188839.jpg saved to cache
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c23fb1c6-07a8-59cb-b95b-ee9201b8cb76
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3395%252F13523395%252Fexterior_rear_passenger-1774693608462.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3395/13523395/exterior_rear_passenger-1774693608462.jpg not downloaded yet
2026-03-29 20:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20442579.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0 with identifier: 19708166
2026-03-29 20:13:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0 with scrape type 1
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8166%252F19708166%252Fexterior_front_driver-1773852131274.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8166/19708166/exterior_front_driver-1773852131274.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3395%252F13523395%252Finterior_front_seats-1774695526997.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3395/13523395/interior_front_seats-1774695526997.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8166%252F19708166%252Fexterior_rear_driver-1773852153180.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8166/19708166/exterior_rear_driver-1773852153180.jpg not downloaded yet
2026-03-29 20:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5425/17585425/interior_boot-1774629156584.jpg> (referer: None)
2026-03-29 20:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2079/19072079/exterior_rear_passenger-1774722481005.jpg> (referer: None)
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3395%252F13523395%252Finterior_rear_seats-1774695188193.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3395/13523395/interior_rear_seats-1774695188193.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8166%252F19708166%252Fexterior_front_passenger-1773852169918.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8166/19708166/exterior_front_passenger-1773852169918.jpg not downloaded yet
2026-03-29 20:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4022/20394022/docs_service_history-1774691505062.jpg?ixlib=js-3.8.0&auto=format&s=060e420e99232f4b07d22765b36c0f92> (referer: None)
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3395%252F13523395%252Finterior_dashboard-1774694958930.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3395/13523395/interior_dashboard-1774694958930.jpg not downloaded yet
2026-03-29 20:13:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3fa7ba2-d421-5588-aa5c-c79602ac96d0 with identifier: 20442579
2026-03-29 20:13:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3fa7ba2-d421-5588-aa5c-c79602ac96d0 with scrape type 1
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3fa7ba2-d421-5588-aa5c-c79602ac96d0
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2579%252F20442579%252Fexterior_front_driver-1774700468726.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2579/20442579/exterior_front_driver-1774700468726.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8166%252F19708166%252Fexterior_rear_passenger-1773852165342.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8166/19708166/exterior_rear_passenger-1773852165342.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3395%252F13523395%252Finstrument_cluster-1774694580113.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3395/13523395/instrument_cluster-1774694580113.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2579%252F20442579%252Fexterior_rear_driver-1774700482890.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2579/20442579/exterior_rear_driver-1774700482890.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8166%252F19708166%252Finterior_front_seats-1773853141619.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8166/19708166/interior_front_seats-1773853141619.jpg not downloaded yet
2026-03-29 20:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5425/17585425/interior_front_seats-1774629085728.jpg> (referer: None)
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3395%252F13523395%252Finterior_boot-1774694946552.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3395/13523395/interior_boot-1774694946552.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2579%252F20442579%252Fexterior_front_passenger-1774700510095.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2579/20442579/exterior_front_passenger-1774700510095.jpg not downloaded yet
2026-03-29 20:13:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bfacd0>
2026-03-29 20:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c23fb1c6-07a8-59cb-b95b-ee9201b8cb76/c23fb1c6-07a8-59cb-b95b-ee9201b8cb76_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5425%252F17585425%252Finterior_boot-1774629156584.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5425/17585425/interior_boot-1774629156584.jpg saved to cache
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c23fb1c6-07a8-59cb-b95b-ee9201b8cb76
2026-03-29 20:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583d20d0>
2026-03-29 20:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d82df10-a56e-5b49-8ac2-a8a257bafe77/9d82df10-a56e-5b49-8ac2-a8a257bafe77_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2079%252F19072079%252Fexterior_rear_passenger-1774722481005.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2079/19072079/exterior_rear_passenger-1774722481005.jpg saved to cache
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9d82df10-a56e-5b49-8ac2-a8a257bafe77
2026-03-29 20:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5425/17585425/interior_rear_seats-1774629109435.jpg> (referer: None)
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8166%252F19708166%252Finterior_rear_seats-1773853164488.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8166/19708166/interior_rear_seats-1773853164488.jpg not downloaded yet
2026-03-29 20:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4022/20394022/exterior_rear_passenger-1774690661998.jpg> (referer: None)
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3395%252F13523395%252Fdocs_service_history-1774696126389.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd42dec154a24227c77a6dc405ce44f75%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3395/13523395/docs_service_history-1774696126389.jpg?ixlib=js-3.8.0&auto=format&s=d42dec154a24227c77a6dc405ce44f75 not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2579%252F20442579%252Fexterior_rear_passenger-1774700493361.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2579/20442579/exterior_rear_passenger-1774700493361.jpg not downloaded yet
2026-03-29 20:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e2d910>
2026-03-29 20:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25743b6-4f93-53e4-b8f4-d480530832f9/e25743b6-4f93-53e4-b8f4-d480530832f9_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4022%252F20394022%252Fdocs_service_history-1774691505062.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D060e420e99232f4b07d22765b36c0f92') HTTP/1.1" 204 0
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4022/20394022/docs_service_history-1774691505062.jpg?ixlib=js-3.8.0&auto=format&s=060e420e99232f4b07d22765b36c0f92 saved to cache
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e25743b6-4f93-53e4-b8f4-d480530832f9
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8166%252F19708166%252Finterior_dashboard-1773853195099.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8166/19708166/interior_dashboard-1773853195099.jpg not downloaded yet
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2579%252F20442579%252Finterior_front_seats-1774700845988.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2579/20442579/interior_front_seats-1774700845988.jpg not downloaded yet
2026-03-29 20:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4022/20394022/docs_service_history-1774691433241.jpg?ixlib=js-3.8.0&auto=format&s=9769025e086ab8bf52a61bc8f0077a27> (referer: None)
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8166%252F19708166%252Finstrument_cluster-1773853232003.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8166/19708166/instrument_cluster-1773853232003.jpg not downloaded yet
2026-03-29 20:13:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:13:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf46c10>
2026-03-29 20:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c23fb1c6-07a8-59cb-b95b-ee9201b8cb76/c23fb1c6-07a8-59cb-b95b-ee9201b8cb76_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5425%252F17585425%252Finterior_front_seats-1774629085728.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5425/17585425/interior_front_seats-1774629085728.jpg saved to cache
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c23fb1c6-07a8-59cb-b95b-ee9201b8cb76
2026-03-29 20:13:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:13:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584a16d0>
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c23fb1c6-07a8-59cb-b95b-ee9201b8cb76/c23fb1c6-07a8-59cb-b95b-ee9201b8cb76_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5425%252F17585425%252Finterior_rear_seats-1774629109435.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5425/17585425/interior_rear_seats-1774629109435.jpg saved to cache
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c23fb1c6-07a8-59cb-b95b-ee9201b8cb76
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65847fb90>
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25743b6-4f93-53e4-b8f4-d480530832f9/e25743b6-4f93-53e4-b8f4-d480530832f9_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4022%252F20394022%252Fexterior_rear_passenger-1774690661998.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4022/20394022/exterior_rear_passenger-1774690661998.jpg saved to cache
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e25743b6-4f93-53e4-b8f4-d480530832f9
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2579%252F20442579%252Finterior_rear_seats-1774700863165.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2579/20442579/interior_rear_seats-1774700863165.jpg not downloaded yet
2026-03-29 20:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4022/20394022/docs_service_history-1774691529532.jpg?ixlib=js-3.8.0&auto=format&s=4e9a5b399a980909fa213b473f8a5088> (referer: None)
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8166%252F19708166%252Finterior_boot-1773853202571.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8166/19708166/interior_boot-1773853202571.jpg not downloaded yet
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2579%252F20442579%252Finterior_dashboard-1774700896900.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2579/20442579/interior_dashboard-1774700896900.jpg not downloaded yet
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583025d0>
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25743b6-4f93-53e4-b8f4-d480530832f9/e25743b6-4f93-53e4-b8f4-d480530832f9_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4022%252F20394022%252Fdocs_service_history-1774691433241.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9769025e086ab8bf52a61bc8f0077a27') HTTP/1.1" 204 0
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4022/20394022/docs_service_history-1774691433241.jpg?ixlib=js-3.8.0&auto=format&s=9769025e086ab8bf52a61bc8f0077a27 saved to cache
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e25743b6-4f93-53e4-b8f4-d480530832f9
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8166%252F19708166%252Fdocs_service_history-1773853323839.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3d01e8ff0e8b0d96e8a691425853e593%27 HTTP/1.1" 200 None
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8166/19708166/docs_service_history-1773853323839.jpg?ixlib=js-3.8.0&auto=format&s=3d01e8ff0e8b0d96e8a691425853e593 not downloaded yet
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2579%252F20442579%252Finstrument_cluster-1774700948763.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2579/20442579/instrument_cluster-1774700948763.jpg not downloaded yet
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d40f90>
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25743b6-4f93-53e4-b8f4-d480530832f9/e25743b6-4f93-53e4-b8f4-d480530832f9_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4022%252F20394022%252Fdocs_service_history-1774691529532.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4e9a5b399a980909fa213b473f8a5088') HTTP/1.1" 204 0
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4022/20394022/docs_service_history-1774691529532.jpg?ixlib=js-3.8.0&auto=format&s=4e9a5b399a980909fa213b473f8a5088 saved to cache
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e25743b6-4f93-53e4-b8f4-d480530832f9
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2579%252F20442579%252Finterior_boot-1774700905098.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2579/20442579/interior_boot-1774700905098.jpg not downloaded yet
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2579%252F20442579%252Fdocs_service_history-1774701233230.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df36756d8e9a94afb4ad2af324fcc1096%27 HTTP/1.1" 200 None
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2579/20442579/docs_service_history-1774701233230.jpg?ixlib=js-3.8.0&auto=format&s=f36756d8e9a94afb4ad2af324fcc1096 not downloaded yet
2026-03-29 20:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4022/20394022/interior_dashboard-1774691274443.jpg> (referer: None)
2026-03-29 20:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4022/20394022/interior_boot-1774691252874.jpg> (referer: None)
2026-03-29 20:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3395/13523395/exterior_rear_driver-1774693614614.jpg> (referer: None)
2026-03-29 20:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3395/13523395/exterior_front_driver-1774695631416.jpg> (referer: None)
2026-03-29 20:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3395/13523395/exterior_front_passenger-1774693610191.jpg> (referer: None)
2026-03-29 20:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4022/20394022/interior_front_seats-1774691255564.jpg> (referer: None)
2026-03-29 20:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3395/13523395/docs_service_history-1774696126389.jpg?ixlib=js-3.8.0&auto=format&s=d42dec154a24227c77a6dc405ce44f75> (referer: None)
2026-03-29 20:13:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2579/20442579/interior_rear_seats-1774700863165.jpg> (referer: None)
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d43690>
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25743b6-4f93-53e4-b8f4-d480530832f9/e25743b6-4f93-53e4-b8f4-d480530832f9_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4022%252F20394022%252Finterior_dashboard-1774691274443.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4022/20394022/interior_dashboard-1774691274443.jpg saved to cache
2026-03-29 20:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e25743b6-4f93-53e4-b8f4-d480530832f9
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a81450>
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25743b6-4f93-53e4-b8f4-d480530832f9/e25743b6-4f93-53e4-b8f4-d480530832f9_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4022%252F20394022%252Finterior_boot-1774691252874.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4022/20394022/interior_boot-1774691252874.jpg saved to cache
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e25743b6-4f93-53e4-b8f4-d480530832f9
2026-03-29 20:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20460964.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65d6c1b50>
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c52695-401a-544b-b88a-79015e24b6dc/31c52695-401a-544b-b88a-79015e24b6dc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3395%252F13523395%252Fexterior_rear_driver-1774693614614.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3395/13523395/exterior_rear_driver-1774693614614.jpg saved to cache
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 31c52695-401a-544b-b88a-79015e24b6dc
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ccd850>
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c52695-401a-544b-b88a-79015e24b6dc/31c52695-401a-544b-b88a-79015e24b6dc_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3395%252F13523395%252Fexterior_front_driver-1774695631416.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3395/13523395/exterior_front_driver-1774695631416.jpg saved to cache
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31c52695-401a-544b-b88a-79015e24b6dc
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf60690>
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c52695-401a-544b-b88a-79015e24b6dc/31c52695-401a-544b-b88a-79015e24b6dc_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3395%252F13523395%252Fexterior_front_passenger-1774693610191.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3395/13523395/exterior_front_passenger-1774693610191.jpg saved to cache
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 31c52695-401a-544b-b88a-79015e24b6dc
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a82390>
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25743b6-4f93-53e4-b8f4-d480530832f9/e25743b6-4f93-53e4-b8f4-d480530832f9_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4022%252F20394022%252Finterior_front_seats-1774691255564.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4022/20394022/interior_front_seats-1774691255564.jpg saved to cache
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e25743b6-4f93-53e4-b8f4-d480530832f9
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f268d0>
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c52695-401a-544b-b88a-79015e24b6dc/31c52695-401a-544b-b88a-79015e24b6dc_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3395%252F13523395%252Fdocs_service_history-1774696126389.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd42dec154a24227c77a6dc405ce44f75') HTTP/1.1" 204 0
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3395/13523395/docs_service_history-1774696126389.jpg?ixlib=js-3.8.0&auto=format&s=d42dec154a24227c77a6dc405ce44f75 saved to cache
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 31c52695-401a-544b-b88a-79015e24b6dc
2026-03-29 20:13:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf20f90>
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3fa7ba2-d421-5588-aa5c-c79602ac96d0/c3fa7ba2-d421-5588-aa5c-c79602ac96d0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2579%252F20442579%252Finterior_rear_seats-1774700863165.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2579/20442579/interior_rear_seats-1774700863165.jpg saved to cache
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c3fa7ba2-d421-5588-aa5c-c79602ac96d0
2026-03-29 20:13:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 070190d7-9f64-58bd-9af3-6a4b2176aada with identifier: 20460964
2026-03-29 20:13:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 070190d7-9f64-58bd-9af3-6a4b2176aada with scrape type 1
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 070190d7-9f64-58bd-9af3-6a4b2176aada
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0964%252F20460964%252Fexterior_front_driver-1774624336401.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0964/20460964/exterior_front_driver-1774624336401.jpg not downloaded yet
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0964%252F20460964%252Fexterior_rear_driver-1774624350900.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0964/20460964/exterior_rear_driver-1774624350900.jpg not downloaded yet
2026-03-29 20:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2579/20442579/exterior_front_passenger-1774700510095.jpg> (referer: None)
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0964%252F20460964%252Fexterior_front_passenger-1774624380475.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0964/20460964/exterior_front_passenger-1774624380475.jpg not downloaded yet
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0964%252F20460964%252Fexterior_rear_passenger-1774624367903.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0964/20460964/exterior_rear_passenger-1774624367903.jpg not downloaded yet
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0964%252F20460964%252Finterior_front_seats-1774624958359.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0964/20460964/interior_front_seats-1774624958359.jpg not downloaded yet
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0964%252F20460964%252Finterior_rear_seats-1774624986610.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0964/20460964/interior_rear_seats-1774624986610.jpg not downloaded yet
2026-03-29 20:13:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8166/19708166/interior_dashboard-1773853195099.jpg> (referer: None)
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0964%252F20460964%252Finterior_dashboard-1774625022036.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0964/20460964/interior_dashboard-1774625022036.jpg not downloaded yet
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0964%252F20460964%252Finstrument_cluster-1774625077000.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0964/20460964/instrument_cluster-1774625077000.jpg not downloaded yet
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0964%252F20460964%252Finterior_boot-1774625039483.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0964/20460964/interior_boot-1774625039483.jpg not downloaded yet
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf634d0>
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3fa7ba2-d421-5588-aa5c-c79602ac96d0/c3fa7ba2-d421-5588-aa5c-c79602ac96d0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2579%252F20442579%252Fexterior_front_passenger-1774700510095.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2579/20442579/exterior_front_passenger-1774700510095.jpg saved to cache
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c3fa7ba2-d421-5588-aa5c-c79602ac96d0
2026-03-29 20:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2579/20442579/docs_service_history-1774701233230.jpg?ixlib=js-3.8.0&auto=format&s=f36756d8e9a94afb4ad2af324fcc1096> (referer: None)
2026-03-29 20:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2579/20442579/exterior_rear_passenger-1774700493361.jpg> (referer: None)
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0964%252F20460964%252Fdocs_service_history-1774642852239.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D52873376ecac4a2f511d7a0096c69907%27 HTTP/1.1" 200 None
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0964/20460964/docs_service_history-1774642852239.jpg?ixlib=js-3.8.0&auto=format&s=52873376ecac4a2f511d7a0096c69907 not downloaded yet
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cfbe90>
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0/8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8166%252F19708166%252Finterior_dashboard-1773853195099.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8166/19708166/interior_dashboard-1773853195099.jpg saved to cache
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0
2026-03-29 20:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8166/19708166/docs_service_history-1773853323839.jpg?ixlib=js-3.8.0&auto=format&s=3d01e8ff0e8b0d96e8a691425853e593> (referer: None)
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ea9550>
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3fa7ba2-d421-5588-aa5c-c79602ac96d0/c3fa7ba2-d421-5588-aa5c-c79602ac96d0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2579%252F20442579%252Fdocs_service_history-1774701233230.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df36756d8e9a94afb4ad2af324fcc1096') HTTP/1.1" 204 0
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2579/20442579/docs_service_history-1774701233230.jpg?ixlib=js-3.8.0&auto=format&s=f36756d8e9a94afb4ad2af324fcc1096 saved to cache
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c3fa7ba2-d421-5588-aa5c-c79602ac96d0
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584c0650>
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3fa7ba2-d421-5588-aa5c-c79602ac96d0/c3fa7ba2-d421-5588-aa5c-c79602ac96d0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2579%252F20442579%252Fexterior_rear_passenger-1774700493361.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2579/20442579/exterior_rear_passenger-1774700493361.jpg saved to cache
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c3fa7ba2-d421-5588-aa5c-c79602ac96d0
2026-03-29 20:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8166/19708166/instrument_cluster-1773853232003.jpg> (referer: None)
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65be8b110>
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0/8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8166%252F19708166%252Fdocs_service_history-1773853323839.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3d01e8ff0e8b0d96e8a691425853e593') HTTP/1.1" 204 0
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8166/19708166/docs_service_history-1773853323839.jpg?ixlib=js-3.8.0&auto=format&s=3d01e8ff0e8b0d96e8a691425853e593 saved to cache
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0
2026-03-29 20:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2579/20442579/exterior_rear_driver-1774700482890.jpg> (referer: None)
2026-03-29 20:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2579/20442579/interior_front_seats-1774700845988.jpg> (referer: None)
2026-03-29 20:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8166/19708166/interior_rear_seats-1773853164488.jpg> (referer: None)
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cf0e50>
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0/8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8166%252F19708166%252Finstrument_cluster-1773853232003.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8166/19708166/instrument_cluster-1773853232003.jpg saved to cache
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0
2026-03-29 20:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2579/20442579/instrument_cluster-1774700948763.jpg> (referer: None)
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ea93d0>
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3fa7ba2-d421-5588-aa5c-c79602ac96d0/c3fa7ba2-d421-5588-aa5c-c79602ac96d0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2579%252F20442579%252Fexterior_rear_driver-1774700482890.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2579/20442579/exterior_rear_driver-1774700482890.jpg saved to cache
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3fa7ba2-d421-5588-aa5c-c79602ac96d0
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a0f590>
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3fa7ba2-d421-5588-aa5c-c79602ac96d0/c3fa7ba2-d421-5588-aa5c-c79602ac96d0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2579%252F20442579%252Finterior_front_seats-1774700845988.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2579/20442579/interior_front_seats-1774700845988.jpg saved to cache
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c3fa7ba2-d421-5588-aa5c-c79602ac96d0
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658796bd0>
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0/8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8166%252F19708166%252Finterior_rear_seats-1773853164488.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8166/19708166/interior_rear_seats-1773853164488.jpg saved to cache
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a0d810>
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3fa7ba2-d421-5588-aa5c-c79602ac96d0/c3fa7ba2-d421-5588-aa5c-c79602ac96d0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2579%252F20442579%252Finstrument_cluster-1774700948763.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2579/20442579/instrument_cluster-1774700948763.jpg saved to cache
2026-03-29 20:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c3fa7ba2-d421-5588-aa5c-c79602ac96d0
2026-03-29 20:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3395/13523395/interior_boot-1774694946552.jpg> (referer: None)
2026-03-29 20:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0964/20460964/exterior_rear_driver-1774624350900.jpg> (referer: None)
2026-03-29 20:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8166/19708166/interior_front_seats-1773853141619.jpg> (referer: None)
2026-03-29 20:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2579/20442579/interior_dashboard-1774700896900.jpg> (referer: None)
2026-03-29 20:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8166/19708166/interior_boot-1773853202571.jpg> (referer: None)
2026-03-29 20:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2579/20442579/interior_boot-1774700905098.jpg> (referer: None)
2026-03-29 20:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0964/20460964/interior_dashboard-1774625022036.jpg> (referer: None)
2026-03-29 20:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0964/20460964/interior_boot-1774625039483.jpg> (referer: None)
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d78f50>
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c52695-401a-544b-b88a-79015e24b6dc/31c52695-401a-544b-b88a-79015e24b6dc_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3395%252F13523395%252Finterior_boot-1774694946552.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3395/13523395/interior_boot-1774694946552.jpg saved to cache
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 31c52695-401a-544b-b88a-79015e24b6dc
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f84c90>
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_070190d7-9f64-58bd-9af3-6a4b2176aada/070190d7-9f64-58bd-9af3-6a4b2176aada_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0964%252F20460964%252Fexterior_rear_driver-1774624350900.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0964/20460964/exterior_rear_driver-1774624350900.jpg saved to cache
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 070190d7-9f64-58bd-9af3-6a4b2176aada
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f0df10>
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0/8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8166%252F19708166%252Finterior_front_seats-1773853141619.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8166/19708166/interior_front_seats-1773853141619.jpg saved to cache
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be02250>
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3fa7ba2-d421-5588-aa5c-c79602ac96d0/c3fa7ba2-d421-5588-aa5c-c79602ac96d0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2579%252F20442579%252Finterior_dashboard-1774700896900.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2579/20442579/interior_dashboard-1774700896900.jpg saved to cache
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c3fa7ba2-d421-5588-aa5c-c79602ac96d0
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f0dfd0>
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0/8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8166%252F19708166%252Finterior_boot-1773853202571.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8166/19708166/interior_boot-1773853202571.jpg saved to cache
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f0d7d0>
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3fa7ba2-d421-5588-aa5c-c79602ac96d0/c3fa7ba2-d421-5588-aa5c-c79602ac96d0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2579%252F20442579%252Finterior_boot-1774700905098.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2579/20442579/interior_boot-1774700905098.jpg saved to cache
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c3fa7ba2-d421-5588-aa5c-c79602ac96d0
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a5c2d0>
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_070190d7-9f64-58bd-9af3-6a4b2176aada/070190d7-9f64-58bd-9af3-6a4b2176aada_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0964%252F20460964%252Finterior_dashboard-1774625022036.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0964/20460964/interior_dashboard-1774625022036.jpg saved to cache
2026-03-29 20:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 070190d7-9f64-58bd-9af3-6a4b2176aada
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a5e550>
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_070190d7-9f64-58bd-9af3-6a4b2176aada/070190d7-9f64-58bd-9af3-6a4b2176aada_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0964%252F20460964%252Finterior_boot-1774625039483.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0964/20460964/interior_boot-1774625039483.jpg saved to cache
2026-03-29 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 070190d7-9f64-58bd-9af3-6a4b2176aada
2026-03-29 20:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0964/20460964/instrument_cluster-1774625077000.jpg> (referer: None)
2026-03-29 20:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0964/20460964/interior_rear_seats-1774624986610.jpg> (referer: None)
2026-03-29 20:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8166/19708166/exterior_rear_passenger-1773852165342.jpg> (referer: None)
2026-03-29 20:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3395/13523395/instrument_cluster-1774694580113.jpg> (referer: None)
2026-03-29 20:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0964/20460964/exterior_front_driver-1774624336401.jpg> (referer: None)
2026-03-29 20:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0964/20460964/exterior_front_passenger-1774624380475.jpg> (referer: None)
2026-03-29 20:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0964/20460964/interior_front_seats-1774624958359.jpg> (referer: None)
2026-03-29 20:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0964/20460964/docs_service_history-1774642852239.jpg?ixlib=js-3.8.0&auto=format&s=52873376ecac4a2f511d7a0096c69907> (referer: None)
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b4a850>
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_070190d7-9f64-58bd-9af3-6a4b2176aada/070190d7-9f64-58bd-9af3-6a4b2176aada_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0964%252F20460964%252Finstrument_cluster-1774625077000.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0964/20460964/instrument_cluster-1774625077000.jpg saved to cache
2026-03-29 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 070190d7-9f64-58bd-9af3-6a4b2176aada
2026-03-29 20:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0964/20460964/exterior_rear_passenger-1774624367903.jpg> (referer: None)
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ace950>
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_070190d7-9f64-58bd-9af3-6a4b2176aada/070190d7-9f64-58bd-9af3-6a4b2176aada_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0964%252F20460964%252Finterior_rear_seats-1774624986610.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0964/20460964/interior_rear_seats-1774624986610.jpg saved to cache
2026-03-29 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 070190d7-9f64-58bd-9af3-6a4b2176aada
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a7a810>
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0/8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8166%252F19708166%252Fexterior_rear_passenger-1773852165342.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8166/19708166/exterior_rear_passenger-1773852165342.jpg saved to cache
2026-03-29 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c70450>
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c52695-401a-544b-b88a-79015e24b6dc/31c52695-401a-544b-b88a-79015e24b6dc_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3395%252F13523395%252Finstrument_cluster-1774694580113.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3395/13523395/instrument_cluster-1774694580113.jpg saved to cache
2026-03-29 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 31c52695-401a-544b-b88a-79015e24b6dc
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c71250>
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_070190d7-9f64-58bd-9af3-6a4b2176aada/070190d7-9f64-58bd-9af3-6a4b2176aada_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0964%252F20460964%252Fexterior_front_driver-1774624336401.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0964/20460964/exterior_front_driver-1774624336401.jpg saved to cache
2026-03-29 20:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 070190d7-9f64-58bd-9af3-6a4b2176aada
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f68c90>
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_070190d7-9f64-58bd-9af3-6a4b2176aada/070190d7-9f64-58bd-9af3-6a4b2176aada_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0964%252F20460964%252Fexterior_front_passenger-1774624380475.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0964/20460964/exterior_front_passenger-1774624380475.jpg saved to cache
2026-03-29 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 070190d7-9f64-58bd-9af3-6a4b2176aada
2026-03-29 20:13:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65bf15250>
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_070190d7-9f64-58bd-9af3-6a4b2176aada/070190d7-9f64-58bd-9af3-6a4b2176aada_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0964%252F20460964%252Finterior_front_seats-1774624958359.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0964/20460964/interior_front_seats-1774624958359.jpg saved to cache
2026-03-29 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 070190d7-9f64-58bd-9af3-6a4b2176aada
2026-03-29 20:13:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599ba210>
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_070190d7-9f64-58bd-9af3-6a4b2176aada/070190d7-9f64-58bd-9af3-6a4b2176aada_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0964%252F20460964%252Fdocs_service_history-1774642852239.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D52873376ecac4a2f511d7a0096c69907') HTTP/1.1" 204 0
2026-03-29 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0964/20460964/docs_service_history-1774642852239.jpg?ixlib=js-3.8.0&auto=format&s=52873376ecac4a2f511d7a0096c69907 saved to cache
2026-03-29 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 070190d7-9f64-58bd-9af3-6a4b2176aada
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65869bd90>
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_070190d7-9f64-58bd-9af3-6a4b2176aada/070190d7-9f64-58bd-9af3-6a4b2176aada_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0964%252F20460964%252Fexterior_rear_passenger-1774624367903.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0964/20460964/exterior_rear_passenger-1774624367903.jpg saved to cache
2026-03-29 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 070190d7-9f64-58bd-9af3-6a4b2176aada
2026-03-29 20:13:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 070190d7-9f64-58bd-9af3-6a4b2176aada, skipping ID generation
2026-03-29 20:13:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 070190d7-9f64-58bd-9af3-6a4b2176aada with scrape type 1
2026-03-29 20:13:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 070190d7-9f64-58bd-9af3-6a4b2176aada sending to next pipeline
2026-03-29 20:13:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 070190d7-9f64-58bd-9af3-6a4b2176aada, identifier: 20460964
2026-03-29 20:13:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 070190d7-9f64-58bd-9af3-6a4b2176aada with identifier: 20460964
2026-03-29 20:13:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 070190d7-9f64-58bd-9af3-6a4b2176aada with identifier: 20460964
2026-03-29 20:13:42 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 070190d7-9f64-58bd-9af3-6a4b2176aada with identifier: 20460964 to the API
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0964/20460964/exterior_rear_passenger-1774624367903.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '070190d7-9f64-58bd-9af3-6a4b2176aada',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MJ19 CYE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20460964',
'listing': 'auction',
'location': 'Central Bedfordshire Bedford',
'make': 'Audi',
'model': 'Q5',
'odometer': 77018,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_070190d7-9f64-58bd-9af3-6a4b2176aada/070190d7-9f64-58bd-9af3-6a4b2176aada_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2251265,
'Height': 2592,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0964/20460964/exterior_front_driver-1774624336401.jpg',
'Width': 3456},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_070190d7-9f64-58bd-9af3-6a4b2176aada/070190d7-9f64-58bd-9af3-6a4b2176aada_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2252784,
'Height': 2597,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0964/20460964/exterior_rear_driver-1774624350900.jpg',
'Width': 3462},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_070190d7-9f64-58bd-9af3-6a4b2176aada/070190d7-9f64-58bd-9af3-6a4b2176aada_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2422359,
'Height': 2678,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0964/20460964/exterior_front_passenger-1774624380475.jpg',
'Width': 3570},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_070190d7-9f64-58bd-9af3-6a4b2176aada/070190d7-9f64-58bd-9af3-6a4b2176aada_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2074932,
'Height': 2520,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0964/20460964/exterior_rear_passenger-1774624367903.jpg',
'Width': 3360},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_070190d7-9f64-58bd-9af3-6a4b2176aada/070190d7-9f64-58bd-9af3-6a4b2176aada_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4310659,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0964/20460964/interior_front_seats-1774624958359.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_070190d7-9f64-58bd-9af3-6a4b2176aada/070190d7-9f64-58bd-9af3-6a4b2176aada_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4218646,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0964/20460964/interior_rear_seats-1774624986610.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_070190d7-9f64-58bd-9af3-6a4b2176aada/070190d7-9f64-58bd-9af3-6a4b2176aada_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3695108,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0964/20460964/interior_dashboard-1774625022036.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_070190d7-9f64-58bd-9af3-6a4b2176aada/070190d7-9f64-58bd-9af3-6a4b2176aada_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2677317,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0964/20460964/instrument_cluster-1774625077000.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_070190d7-9f64-58bd-9af3-6a4b2176aada/070190d7-9f64-58bd-9af3-6a4b2176aada_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3762504,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0964/20460964/interior_boot-1774625039483.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_070190d7-9f64-58bd-9af3-6a4b2176aada/070190d7-9f64-58bd-9af3-6a4b2176aada_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3479967,
'Height': 3413,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0964/20460964/docs_service_history-1774642852239.jpg?ixlib=js-3.8.0&auto=format&s=52873376ecac4a2f511d7a0096c69907',
'Width': 2636}],
'price': 18119,
'price_includes_vat': False,
'registration_date': '2019-03-30',
'seats_number': None,
'seller_name': None,
'title': 'Audi Q5 S Line BLK ED40 TDI Quat SA',
'transmission': 'automatic',
'trim': 'S Line BLK ED40 TDI Quat SA',
'vin': 'WAUZZZFY6K2015539',
'year': 2019}
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720460964%27 HTTP/1.1" 200 None
2026-03-29 20:13:42 [motorway.uk] INFO: Saving data for 20460964: {'created_time': 1774815222.445063, 'last_price_update_time': 1774815222.445074, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20460964') HTTP/1.1" 204 0
2026-03-29 20:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/2079/19072079/docs_service_history-1774781880314.jpg?ixlib=js-3.8.0&auto=format&s=8745fd9eefe2ff078ab3698314ffda6f> (referer: None)
2026-03-29 20:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2079/19072079/instrument_cluster-1774781294133.jpg> (referer: None)
2026-03-29 20:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2079/19072079/interior_boot-1774781441727.jpg> (referer: None)
2026-03-29 20:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8166/19708166/exterior_front_passenger-1773852169918.jpg> (referer: None)
2026-03-29 20:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3395/13523395/interior_dashboard-1774694958930.jpg> (referer: None)
2026-03-29 20:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2579/20442579/exterior_front_driver-1774700468726.jpg> (referer: None)
2026-03-29 20:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8166/19708166/exterior_rear_driver-1773852153180.jpg> (referer: None)
2026-03-29 20:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4022/20394022/exterior_front_passenger-1774690658613.jpg> (referer: None)
2026-03-29 20:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8166/19708166/exterior_front_driver-1773852131274.jpg> (referer: None)
2026-03-29 20:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3395/13523395/interior_front_seats-1774695526997.jpg> (referer: None)
2026-03-29 20:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3395/13523395/interior_rear_seats-1774695188193.jpg> (referer: None)
2026-03-29 20:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3395/13523395/exterior_rear_passenger-1774693608462.jpg> (referer: None)
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b516d0>
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d82df10-a56e-5b49-8ac2-a8a257bafe77/9d82df10-a56e-5b49-8ac2-a8a257bafe77_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2079%252F19072079%252Fdocs_service_history-1774781880314.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8745fd9eefe2ff078ab3698314ffda6f') HTTP/1.1" 204 0
2026-03-29 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2079/19072079/docs_service_history-1774781880314.jpg?ixlib=js-3.8.0&auto=format&s=8745fd9eefe2ff078ab3698314ffda6f saved to cache
2026-03-29 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9d82df10-a56e-5b49-8ac2-a8a257bafe77
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b52150>
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d82df10-a56e-5b49-8ac2-a8a257bafe77/9d82df10-a56e-5b49-8ac2-a8a257bafe77_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2079%252F19072079%252Finstrument_cluster-1774781294133.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2079/19072079/instrument_cluster-1774781294133.jpg saved to cache
2026-03-29 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9d82df10-a56e-5b49-8ac2-a8a257bafe77
2026-03-29 20:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15910710.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2079/19072079/exterior_front_driver-1774782192329.jpg> (referer: None)
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c39a50>
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d82df10-a56e-5b49-8ac2-a8a257bafe77/9d82df10-a56e-5b49-8ac2-a8a257bafe77_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2079%252F19072079%252Finterior_boot-1774781441727.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2079/19072079/interior_boot-1774781441727.jpg saved to cache
2026-03-29 20:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9d82df10-a56e-5b49-8ac2-a8a257bafe77
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d68810>
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0/8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8166%252F19708166%252Fexterior_front_passenger-1773852169918.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8166/19708166/exterior_front_passenger-1773852169918.jpg saved to cache
2026-03-29 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598f07d0>
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c52695-401a-544b-b88a-79015e24b6dc/31c52695-401a-544b-b88a-79015e24b6dc_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3395%252F13523395%252Finterior_dashboard-1774694958930.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3395/13523395/interior_dashboard-1774694958930.jpg saved to cache
2026-03-29 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 31c52695-401a-544b-b88a-79015e24b6dc
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b6be10>
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3fa7ba2-d421-5588-aa5c-c79602ac96d0/c3fa7ba2-d421-5588-aa5c-c79602ac96d0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2579%252F20442579%252Fexterior_front_driver-1774700468726.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2579/20442579/exterior_front_driver-1774700468726.jpg saved to cache
2026-03-29 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3fa7ba2-d421-5588-aa5c-c79602ac96d0
2026-03-29 20:13:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3fa7ba2-d421-5588-aa5c-c79602ac96d0, skipping ID generation
2026-03-29 20:13:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3fa7ba2-d421-5588-aa5c-c79602ac96d0 with scrape type 1
2026-03-29 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3fa7ba2-d421-5588-aa5c-c79602ac96d0 sending to next pipeline
2026-03-29 20:13:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c3fa7ba2-d421-5588-aa5c-c79602ac96d0, identifier: 20442579
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65998f2d0>
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0/8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8166%252F19708166%252Fexterior_rear_driver-1773852153180.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8166/19708166/exterior_rear_driver-1773852153180.jpg saved to cache
2026-03-29 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c39a50>
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25743b6-4f93-53e4-b8f4-d480530832f9/e25743b6-4f93-53e4-b8f4-d480530832f9_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4022%252F20394022%252Fexterior_front_passenger-1774690658613.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4022/20394022/exterior_front_passenger-1774690658613.jpg saved to cache
2026-03-29 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e25743b6-4f93-53e4-b8f4-d480530832f9
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d8a1d0>
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0/8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8166%252F19708166%252Fexterior_front_driver-1773852131274.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8166/19708166/exterior_front_driver-1773852131274.jpg saved to cache
2026-03-29 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0
2026-03-29 20:13:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0, skipping ID generation
2026-03-29 20:13:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0 with scrape type 1
2026-03-29 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0 sending to next pipeline
2026-03-29 20:13:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0, identifier: 19708166
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599d9950>
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c52695-401a-544b-b88a-79015e24b6dc/31c52695-401a-544b-b88a-79015e24b6dc_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3395%252F13523395%252Finterior_front_seats-1774695526997.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3395/13523395/interior_front_seats-1774695526997.jpg saved to cache
2026-03-29 20:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 31c52695-401a-544b-b88a-79015e24b6dc
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f0d050>
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c52695-401a-544b-b88a-79015e24b6dc/31c52695-401a-544b-b88a-79015e24b6dc_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3395%252F13523395%252Finterior_rear_seats-1774695188193.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3395/13523395/interior_rear_seats-1774695188193.jpg saved to cache
2026-03-29 20:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 31c52695-401a-544b-b88a-79015e24b6dc
2026-03-29 20:13:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a84350>
2026-03-29 20:13:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31c52695-401a-544b-b88a-79015e24b6dc/31c52695-401a-544b-b88a-79015e24b6dc_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3395%252F13523395%252Fexterior_rear_passenger-1774693608462.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3395/13523395/exterior_rear_passenger-1774693608462.jpg saved to cache
2026-03-29 20:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 31c52695-401a-544b-b88a-79015e24b6dc
2026-03-29 20:13:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31c52695-401a-544b-b88a-79015e24b6dc, skipping ID generation
2026-03-29 20:13:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31c52695-401a-544b-b88a-79015e24b6dc with scrape type 1
2026-03-29 20:13:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31c52695-401a-544b-b88a-79015e24b6dc sending to next pipeline
2026-03-29 20:13:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 31c52695-401a-544b-b88a-79015e24b6dc, identifier: 13523395
2026-03-29 20:13:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c3fa7ba2-d421-5588-aa5c-c79602ac96d0 with identifier: 20442579
2026-03-29 20:13:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c3fa7ba2-d421-5588-aa5c-c79602ac96d0 with identifier: 20442579
2026-03-29 20:13:44 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c3fa7ba2-d421-5588-aa5c-c79602ac96d0 with identifier: 20442579 to the API
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2579/20442579/exterior_front_driver-1774700468726.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'c3fa7ba2-d421-5588-aa5c-c79602ac96d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EF15 YPG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20442579',
'listing': 'auction',
'location': 'Surrey Godalming',
'make': 'Kia',
'model': 'Sportage',
'odometer': 46551,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 34,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3fa7ba2-d421-5588-aa5c-c79602ac96d0/c3fa7ba2-d421-5588-aa5c-c79602ac96d0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1810021,
'Height': 2786,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2579/20442579/exterior_front_driver-1774700468726.jpg',
'Width': 3714},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3fa7ba2-d421-5588-aa5c-c79602ac96d0/c3fa7ba2-d421-5588-aa5c-c79602ac96d0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1136302,
'Height': 2129,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2579/20442579/exterior_rear_driver-1774700482890.jpg',
'Width': 2838},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3fa7ba2-d421-5588-aa5c-c79602ac96d0/c3fa7ba2-d421-5588-aa5c-c79602ac96d0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1494452,
'Height': 2417,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2579/20442579/exterior_front_passenger-1774700510095.jpg',
'Width': 3223},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3fa7ba2-d421-5588-aa5c-c79602ac96d0/c3fa7ba2-d421-5588-aa5c-c79602ac96d0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1915009,
'Height': 2756,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2579/20442579/exterior_rear_passenger-1774700493361.jpg',
'Width': 3675},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3fa7ba2-d421-5588-aa5c-c79602ac96d0/c3fa7ba2-d421-5588-aa5c-c79602ac96d0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3349814,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2579/20442579/interior_front_seats-1774700845988.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3fa7ba2-d421-5588-aa5c-c79602ac96d0/c3fa7ba2-d421-5588-aa5c-c79602ac96d0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2834325,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2579/20442579/interior_rear_seats-1774700863165.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3fa7ba2-d421-5588-aa5c-c79602ac96d0/c3fa7ba2-d421-5588-aa5c-c79602ac96d0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3118944,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2579/20442579/interior_dashboard-1774700896900.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3fa7ba2-d421-5588-aa5c-c79602ac96d0/c3fa7ba2-d421-5588-aa5c-c79602ac96d0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1903953,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2579/20442579/instrument_cluster-1774700948763.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3fa7ba2-d421-5588-aa5c-c79602ac96d0/c3fa7ba2-d421-5588-aa5c-c79602ac96d0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3961553,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2579/20442579/interior_boot-1774700905098.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3fa7ba2-d421-5588-aa5c-c79602ac96d0/c3fa7ba2-d421-5588-aa5c-c79602ac96d0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 582217,
'Height': 1482,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2579/20442579/docs_service_history-1774701233230.jpg?ixlib=js-3.8.0&auto=format&s=f36756d8e9a94afb4ad2af324fcc1096',
'Width': 4116}],
'price': 8706,
'price_includes_vat': False,
'registration_date': '2015-06-29',
'seats_number': None,
'seller_name': None,
'title': 'Kia Sportage KX-4 CRDI Auto',
'transmission': 'automatic',
'trim': 'KX-4 CRDI Auto',
'vin': 'U5YPC813SEL630316',
'year': 2015}
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720442579%27 HTTP/1.1" 200 None
2026-03-29 20:13:44 [motorway.uk] INFO: Saving data for 20442579: {'created_time': 1774815224.690882, 'last_price_update_time': 1774815224.690895, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20442579') HTTP/1.1" 204 0
2026-03-29 20:13:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0 with identifier: 19708166
2026-03-29 20:13:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0 with identifier: 19708166
2026-03-29 20:13:44 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0 with identifier: 19708166 to the API
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8166/19708166/exterior_front_driver-1773852131274.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '4.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'PE17 CLJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19708166',
'listing': 'auction',
'location': 'Shropshire Shrewsbury',
'make': 'Audi',
'model': 'SQ7',
'odometer': 86250,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0/8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2525700,
'Height': 2865,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8166/19708166/exterior_front_driver-1773852131274.jpg',
'Width': 3820},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0/8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2238754,
'Height': 2690,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8166/19708166/exterior_rear_driver-1773852153180.jpg',
'Width': 3586},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0/8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2247249,
'Height': 2945,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8166/19708166/exterior_front_passenger-1773852169918.jpg',
'Width': 3926},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0/8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2139266,
'Height': 2700,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8166/19708166/exterior_rear_passenger-1773852165342.jpg',
'Width': 3600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0/8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2958340,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8166/19708166/interior_front_seats-1773853141619.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0/8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2898573,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8166/19708166/interior_rear_seats-1773853164488.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0/8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2006200,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8166/19708166/interior_dashboard-1773853195099.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0/8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2496260,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8166/19708166/instrument_cluster-1773853232003.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0/8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4172168,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8166/19708166/interior_boot-1773853202571.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0/8e19af1f-3aa5-5c4f-ad13-7dd75d0d20a0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 499171,
'Height': 2698,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8166/19708166/docs_service_history-1773853323839.jpg?ixlib=js-3.8.0&auto=format&s=3d01e8ff0e8b0d96e8a691425853e593',
'Width': 1320}],
'price': 24661,
'price_includes_vat': False,
'registration_date': '2017-03-17',
'seats_number': None,
'seller_name': None,
'title': 'Audi SQ7 TDI Quattro Auto',
'transmission': 'automatic',
'trim': 'TDI Quattro Auto',
'vin': 'WAUZZZ4M1HD040913',
'year': 2017}
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719708166%27 HTTP/1.1" 200 None
2026-03-29 20:13:45 [motorway.uk] INFO: Saving data for 19708166: {'created_time': 1774815225.097881, 'last_price_update_time': 1774815225.097891, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19708166') HTTP/1.1" 204 0
2026-03-29 20:13:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 31c52695-401a-544b-b88a-79015e24b6dc with identifier: 13523395
2026-03-29 20:13:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 31c52695-401a-544b-b88a-79015e24b6dc with identifier: 13523395
2026-03-29 20:13:45 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 31c52695-401a-544b-b88a-79015e24b6dc with identifier: 13523395 to the API
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3395/13523395/exterior_rear_passenger-1774693608462.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '31c52695-401a-544b-b88a-79015e24b6dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LR18 WYJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/13523395',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Nissan',
'model': 'X-Trail',
'odometer': 22000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c52695-401a-544b-b88a-79015e24b6dc/31c52695-401a-544b-b88a-79015e24b6dc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2095857,
'Height': 2841,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3395/13523395/exterior_front_driver-1774695631416.jpg',
'Width': 3788},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c52695-401a-544b-b88a-79015e24b6dc/31c52695-401a-544b-b88a-79015e24b6dc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1448279,
'Height': 2460,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3395/13523395/exterior_rear_driver-1774693614614.jpg',
'Width': 3280},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c52695-401a-544b-b88a-79015e24b6dc/31c52695-401a-544b-b88a-79015e24b6dc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1613726,
'Height': 2394,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3395/13523395/exterior_front_passenger-1774693610191.jpg',
'Width': 3192},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c52695-401a-544b-b88a-79015e24b6dc/31c52695-401a-544b-b88a-79015e24b6dc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1620532,
'Height': 2434,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3395/13523395/exterior_rear_passenger-1774693608462.jpg',
'Width': 3245},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c52695-401a-544b-b88a-79015e24b6dc/31c52695-401a-544b-b88a-79015e24b6dc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2211236,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/3395/13523395/interior_front_seats-1774695526997.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c52695-401a-544b-b88a-79015e24b6dc/31c52695-401a-544b-b88a-79015e24b6dc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2657162,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/3395/13523395/interior_rear_seats-1774695188193.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c52695-401a-544b-b88a-79015e24b6dc/31c52695-401a-544b-b88a-79015e24b6dc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1653538,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3395/13523395/interior_dashboard-1774694958930.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c52695-401a-544b-b88a-79015e24b6dc/31c52695-401a-544b-b88a-79015e24b6dc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1470019,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3395/13523395/instrument_cluster-1774694580113.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c52695-401a-544b-b88a-79015e24b6dc/31c52695-401a-544b-b88a-79015e24b6dc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2279070,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/3395/13523395/interior_boot-1774694946552.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31c52695-401a-544b-b88a-79015e24b6dc/31c52695-401a-544b-b88a-79015e24b6dc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 986975,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3395/13523395/docs_service_history-1774696126389.jpg?ixlib=js-3.8.0&auto=format&s=d42dec154a24227c77a6dc405ce44f75',
'Width': 3840}],
'price': 13577,
'price_includes_vat': False,
'registration_date': '2018-05-31',
'seats_number': None,
'seller_name': None,
'title': 'Nissan X-Trail N-Connecta DCI 4X4',
'transmission': 'manual',
'trim': 'N-Connecta DCI 4X4',
'vin': 'JN1JFNT32U0102637',
'year': 2018}
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713523395%27 HTTP/1.1" 200 None
2026-03-29 20:13:45 [motorway.uk] INFO: Saving data for 13523395: {'created_time': 1774815225.517552, 'last_price_update_time': 1774815225.517564, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='13523395') HTTP/1.1" 204 0
2026-03-29 20:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4022/20394022/exterior_rear_driver-1774690653119.jpg> (referer: None)
2026-03-29 20:13:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dbc070e-a22e-5d3e-b8f4-ff6b0008a769 with identifier: 15910710
2026-03-29 20:13:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dbc070e-a22e-5d3e-b8f4-ff6b0008a769 with scrape type 1
2026-03-29 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7dbc070e-a22e-5d3e-b8f4-ff6b0008a769
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0710%252F15910710%252Fexterior_front_driver-1774775225891.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0710/15910710/exterior_front_driver-1774775225891.jpg not downloaded yet
2026-03-29 20:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598f2950>
2026-03-29 20:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d82df10-a56e-5b49-8ac2-a8a257bafe77/9d82df10-a56e-5b49-8ac2-a8a257bafe77_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2079%252F19072079%252Fexterior_front_driver-1774782192329.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2079/19072079/exterior_front_driver-1774782192329.jpg saved to cache
2026-03-29 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d82df10-a56e-5b49-8ac2-a8a257bafe77
2026-03-29 20:13:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0710%252F15910710%252Fexterior_rear_driver-1774721581397.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0710/15910710/exterior_rear_driver-1774721581397.jpg not downloaded yet
2026-03-29 20:13:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659af1390>
2026-03-29 20:13:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25743b6-4f93-53e4-b8f4-d480530832f9/e25743b6-4f93-53e4-b8f4-d480530832f9_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4022%252F20394022%252Fexterior_rear_driver-1774690653119.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4022/20394022/exterior_rear_driver-1774690653119.jpg saved to cache
2026-03-29 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e25743b6-4f93-53e4-b8f4-d480530832f9
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0710%252F15910710%252Fexterior_front_passenger-1774774960803.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0710/15910710/exterior_front_passenger-1774774960803.jpg not downloaded yet
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0710%252F15910710%252Fexterior_rear_passenger-1774775294343.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0710/15910710/exterior_rear_passenger-1774775294343.jpg not downloaded yet
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0710%252F15910710%252Finterior_front_seats-1774722223351.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0710/15910710/interior_front_seats-1774722223351.jpg not downloaded yet
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0710%252F15910710%252Finterior_rear_seats-1774722236808.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0710/15910710/interior_rear_seats-1774722236808.jpg not downloaded yet
2026-03-29 20:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2079/19072079/interior_dashboard-1774722953222.jpg> (referer: None)
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0710%252F15910710%252Finterior_dashboard-1774776885609.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0710/15910710/interior_dashboard-1774776885609.jpg not downloaded yet
2026-03-29 20:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4022/20394022/exterior_front_driver-1774690660531.jpg> (referer: None)
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0710%252F15910710%252Finterior_boot-1774722276987.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0710/15910710/interior_boot-1774722276987.jpg not downloaded yet
2026-03-29 20:13:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5425/17585425/exterior_front_passenger-1774628559612.jpg> (referer: None)
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0710%252F15910710%252Fwheels_front_driver-1774721931121.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0710/15910710/wheels_front_driver-1774721931121.jpg not downloaded yet
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0710%252F15910710%252Fwheels_rear_driver-1774721940398.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0710/15910710/wheels_rear_driver-1774721940398.jpg not downloaded yet
2026-03-29 20:13:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2813/20272813/exterior_rear_driver-1774717845708.jpg> (referer: None)
2026-03-29 20:13:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2813/20272813/exterior_front_passenger-1774717959901.jpg> (referer: None)
2026-03-29 20:13:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65856b1d0>
2026-03-29 20:13:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d82df10-a56e-5b49-8ac2-a8a257bafe77/9d82df10-a56e-5b49-8ac2-a8a257bafe77_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2079%252F19072079%252Finterior_dashboard-1774722953222.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2079/19072079/interior_dashboard-1774722953222.jpg saved to cache
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9d82df10-a56e-5b49-8ac2-a8a257bafe77
2026-03-29 20:13:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d82df10-a56e-5b49-8ac2-a8a257bafe77, skipping ID generation
2026-03-29 20:13:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d82df10-a56e-5b49-8ac2-a8a257bafe77 with scrape type 1
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d82df10-a56e-5b49-8ac2-a8a257bafe77 sending to next pipeline
2026-03-29 20:13:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9d82df10-a56e-5b49-8ac2-a8a257bafe77, identifier: 19072079
2026-03-29 20:13:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2813/20272813/exterior_rear_passenger-1774717948399.jpg> (referer: None)
2026-03-29 20:13:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9d82df10-a56e-5b49-8ac2-a8a257bafe77 with identifier: 19072079
2026-03-29 20:13:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9d82df10-a56e-5b49-8ac2-a8a257bafe77 with identifier: 19072079
2026-03-29 20:13:46 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9d82df10-a56e-5b49-8ac2-a8a257bafe77 with identifier: 19072079 to the API
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2079/19072079/interior_dashboard-1774722953222.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '9d82df10-a56e-5b49-8ac2-a8a257bafe77',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'ST18 UFU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19072079',
'listing': 'auction',
'location': 'Greater London Teddington',
'make': 'BMW',
'model': '1 Series',
'odometer': 49400,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d82df10-a56e-5b49-8ac2-a8a257bafe77/9d82df10-a56e-5b49-8ac2-a8a257bafe77_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1018142,
'Height': 2468,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2079/19072079/exterior_front_driver-1774782192329.jpg',
'Width': 3291},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d82df10-a56e-5b49-8ac2-a8a257bafe77/9d82df10-a56e-5b49-8ac2-a8a257bafe77_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 780311,
'Height': 2239,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2079/19072079/exterior_rear_driver-1774722479518.jpg',
'Width': 2985},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d82df10-a56e-5b49-8ac2-a8a257bafe77/9d82df10-a56e-5b49-8ac2-a8a257bafe77_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 783404,
'Height': 2426,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2079/19072079/exterior_front_passenger-1774722475383.jpg',
'Width': 3234},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d82df10-a56e-5b49-8ac2-a8a257bafe77/9d82df10-a56e-5b49-8ac2-a8a257bafe77_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1007874,
'Height': 2508,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2079/19072079/exterior_rear_passenger-1774722481005.jpg',
'Width': 3344},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d82df10-a56e-5b49-8ac2-a8a257bafe77/9d82df10-a56e-5b49-8ac2-a8a257bafe77_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 979240,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/2079/19072079/interior_front_seats-1774722821567.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d82df10-a56e-5b49-8ac2-a8a257bafe77/9d82df10-a56e-5b49-8ac2-a8a257bafe77_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 586759,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2079/19072079/interior_rear_seats-1774782223464.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d82df10-a56e-5b49-8ac2-a8a257bafe77/9d82df10-a56e-5b49-8ac2-a8a257bafe77_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1130277,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2079/19072079/interior_dashboard-1774722953222.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d82df10-a56e-5b49-8ac2-a8a257bafe77/9d82df10-a56e-5b49-8ac2-a8a257bafe77_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 474205,
'Height': 2128,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2079/19072079/instrument_cluster-1774781294133.jpg',
'Width': 2838},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d82df10-a56e-5b49-8ac2-a8a257bafe77/9d82df10-a56e-5b49-8ac2-a8a257bafe77_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1133464,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2079/19072079/interior_boot-1774781441727.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d82df10-a56e-5b49-8ac2-a8a257bafe77/9d82df10-a56e-5b49-8ac2-a8a257bafe77_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 371858,
'Height': 1525,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/2079/19072079/docs_service_history-1774781880314.jpg?ixlib=js-3.8.0&auto=format&s=8745fd9eefe2ff078ab3698314ffda6f',
'Width': 2034}],
'price': 10479,
'price_includes_vat': False,
'registration_date': '2018-05-31',
'seats_number': None,
'seller_name': None,
'title': 'BMW 120I M Sport Shadow Edition',
'transmission': 'manual',
'trim': '120I M Sport Shadow Edition',
'vin': 'WBA1W120005D85746',
'year': 2018}
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719072079%27 HTTP/1.1" 200 None
2026-03-29 20:13:46 [motorway.uk] INFO: Saving data for 19072079: {'created_time': 1774815226.594765, 'last_price_update_time': 1774815226.594777, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19072079') HTTP/1.1" 204 0
2026-03-29 20:13:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bc2b50>
2026-03-29 20:13:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e25743b6-4f93-53e4-b8f4-d480530832f9/e25743b6-4f93-53e4-b8f4-d480530832f9_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4022%252F20394022%252Fexterior_front_driver-1774690660531.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4022/20394022/exterior_front_driver-1774690660531.jpg saved to cache
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e25743b6-4f93-53e4-b8f4-d480530832f9
2026-03-29 20:13:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e25743b6-4f93-53e4-b8f4-d480530832f9, skipping ID generation
2026-03-29 20:13:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e25743b6-4f93-53e4-b8f4-d480530832f9 with scrape type 1
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e25743b6-4f93-53e4-b8f4-d480530832f9 sending to next pipeline
2026-03-29 20:13:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e25743b6-4f93-53e4-b8f4-d480530832f9, identifier: 20394022
2026-03-29 20:13:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584254d0>
2026-03-29 20:13:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c23fb1c6-07a8-59cb-b95b-ee9201b8cb76/c23fb1c6-07a8-59cb-b95b-ee9201b8cb76_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5425%252F17585425%252Fexterior_front_passenger-1774628559612.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5425/17585425/exterior_front_passenger-1774628559612.jpg saved to cache
2026-03-29 20:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c23fb1c6-07a8-59cb-b95b-ee9201b8cb76
2026-03-29 20:13:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586f9f50>
2026-03-29 20:13:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c53c568c-92cb-5cd7-b4b8-8a90e0b08a41/c53c568c-92cb-5cd7-b4b8-8a90e0b08a41_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2813%252F20272813%252Fexterior_rear_driver-1774717845708.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2813/20272813/exterior_rear_driver-1774717845708.jpg saved to cache
2026-03-29 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c53c568c-92cb-5cd7-b4b8-8a90e0b08a41
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a753d0>
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c53c568c-92cb-5cd7-b4b8-8a90e0b08a41/c53c568c-92cb-5cd7-b4b8-8a90e0b08a41_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2813%252F20272813%252Fexterior_front_passenger-1774717959901.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2813/20272813/exterior_front_passenger-1774717959901.jpg saved to cache
2026-03-29 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c53c568c-92cb-5cd7-b4b8-8a90e0b08a41
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587845d0>
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c53c568c-92cb-5cd7-b4b8-8a90e0b08a41/c53c568c-92cb-5cd7-b4b8-8a90e0b08a41_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2813%252F20272813%252Fexterior_rear_passenger-1774717948399.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2813/20272813/exterior_rear_passenger-1774717948399.jpg saved to cache
2026-03-29 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c53c568c-92cb-5cd7-b4b8-8a90e0b08a41
2026-03-29 20:13:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e25743b6-4f93-53e4-b8f4-d480530832f9 with identifier: 20394022
2026-03-29 20:13:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e25743b6-4f93-53e4-b8f4-d480530832f9 with identifier: 20394022
2026-03-29 20:13:47 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e25743b6-4f93-53e4-b8f4-d480530832f9 with identifier: 20394022 to the API
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4022/20394022/exterior_front_driver-1774690660531.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'e25743b6-4f93-53e4-b8f4-d480530832f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'GX73 KNM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20394022',
'listing': 'auction',
'location': 'Wokingham Reading',
'make': 'Mazda',
'model': 'MX-5',
'odometer': 577,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e25743b6-4f93-53e4-b8f4-d480530832f9/e25743b6-4f93-53e4-b8f4-d480530832f9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1575643,
'Height': 2840,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4022/20394022/exterior_front_driver-1774690660531.jpg',
'Width': 3787},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e25743b6-4f93-53e4-b8f4-d480530832f9/e25743b6-4f93-53e4-b8f4-d480530832f9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1570531,
'Height': 2692,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4022/20394022/exterior_rear_driver-1774690653119.jpg',
'Width': 3589},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e25743b6-4f93-53e4-b8f4-d480530832f9/e25743b6-4f93-53e4-b8f4-d480530832f9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1651715,
'Height': 2764,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4022/20394022/exterior_front_passenger-1774690658613.jpg',
'Width': 3685},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e25743b6-4f93-53e4-b8f4-d480530832f9/e25743b6-4f93-53e4-b8f4-d480530832f9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1377082,
'Height': 2686,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4022/20394022/exterior_rear_passenger-1774690661998.jpg',
'Width': 3581},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e25743b6-4f93-53e4-b8f4-d480530832f9/e25743b6-4f93-53e4-b8f4-d480530832f9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2324924,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4022/20394022/interior_front_seats-1774691255564.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e25743b6-4f93-53e4-b8f4-d480530832f9/e25743b6-4f93-53e4-b8f4-d480530832f9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2227379,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4022/20394022/interior_dashboard-1774691274443.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e25743b6-4f93-53e4-b8f4-d480530832f9/e25743b6-4f93-53e4-b8f4-d480530832f9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2227800,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4022/20394022/interior_boot-1774691252874.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e25743b6-4f93-53e4-b8f4-d480530832f9/e25743b6-4f93-53e4-b8f4-d480530832f9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 907292,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4022/20394022/docs_service_history-1774691433241.jpg?ixlib=js-3.8.0&auto=format&s=9769025e086ab8bf52a61bc8f0077a27',
'Width': 2880},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e25743b6-4f93-53e4-b8f4-d480530832f9/e25743b6-4f93-53e4-b8f4-d480530832f9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 861510,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4022/20394022/docs_service_history-1774691505062.jpg?ixlib=js-3.8.0&auto=format&s=060e420e99232f4b07d22765b36c0f92',
'Width': 2880},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e25743b6-4f93-53e4-b8f4-d480530832f9/e25743b6-4f93-53e4-b8f4-d480530832f9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 926409,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4022/20394022/docs_service_history-1774691529532.jpg?ixlib=js-3.8.0&auto=format&s=4e9a5b399a980909fa213b473f8a5088',
'Width': 2880}],
'price': 24541,
'price_includes_vat': False,
'registration_date': '2023-11-30',
'seats_number': None,
'seller_name': None,
'title': 'Mazda MX-5 Homura',
'transmission': 'manual',
'trim': 'Homura',
'vin': 'JMZND6E7600656949',
'year': 2023}
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720394022%27 HTTP/1.1" 200 None
2026-03-29 20:13:47 [motorway.uk] INFO: Saving data for 20394022: {'created_time': 1774815227.584528, 'last_price_update_time': 1774815227.584542, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20394022') HTTP/1.1" 204 0
2026-03-29 20:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2813/20272813/exterior_front_driver-1774717832344.jpg> (referer: None)
2026-03-29 20:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5425/17585425/exterior_rear_driver-1774628530790.jpg> (referer: None)
2026-03-29 20:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6704/14816704/exterior_rear_passenger-1774709117002.jpg> (referer: None)
2026-03-29 20:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9478/20039478/exterior_front_driver-1774549157771.jpg> (referer: None)
2026-03-29 20:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6704/14816704/exterior_front_passenger-1774709128109.jpg> (referer: None)
2026-03-29 20:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0710/15910710/interior_dashboard-1774776885609.jpg> (referer: None)
2026-03-29 20:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0710/15910710/interior_rear_seats-1774722236808.jpg> (referer: None)
2026-03-29 20:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6704/14816704/interior_front_seats-1774709769959.jpg> (referer: None)
2026-03-29 20:13:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0710/15910710/interior_front_seats-1774722223351.jpg> (referer: None)
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ed93d0>
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c53c568c-92cb-5cd7-b4b8-8a90e0b08a41/c53c568c-92cb-5cd7-b4b8-8a90e0b08a41_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2813%252F20272813%252Fexterior_front_driver-1774717832344.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2813/20272813/exterior_front_driver-1774717832344.jpg saved to cache
2026-03-29 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c53c568c-92cb-5cd7-b4b8-8a90e0b08a41
2026-03-29 20:13:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c53c568c-92cb-5cd7-b4b8-8a90e0b08a41, skipping ID generation
2026-03-29 20:13:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c53c568c-92cb-5cd7-b4b8-8a90e0b08a41 with scrape type 1
2026-03-29 20:13:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c53c568c-92cb-5cd7-b4b8-8a90e0b08a41 sending to next pipeline
2026-03-29 20:13:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c53c568c-92cb-5cd7-b4b8-8a90e0b08a41, identifier: 20272813
2026-03-29 20:13:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c53c568c-92cb-5cd7-b4b8-8a90e0b08a41 with identifier: 20272813
2026-03-29 20:13:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c53c568c-92cb-5cd7-b4b8-8a90e0b08a41 with identifier: 20272813
2026-03-29 20:13:48 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c53c568c-92cb-5cd7-b4b8-8a90e0b08a41 with identifier: 20272813 to the API
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2813/20272813/exterior_front_driver-1774717832344.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'c53c568c-92cb-5cd7-b4b8-8a90e0b08a41',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'PJ68 WMY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20272813',
'listing': 'auction',
'location': 'South Yorkshire Sheffield',
'make': 'Volkswagen',
'model': 'Touareg',
'odometer': 83571,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c53c568c-92cb-5cd7-b4b8-8a90e0b08a41/c53c568c-92cb-5cd7-b4b8-8a90e0b08a41_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1014581,
'Height': 2078,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2813/20272813/exterior_front_driver-1774717832344.jpg',
'Width': 2770},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c53c568c-92cb-5cd7-b4b8-8a90e0b08a41/c53c568c-92cb-5cd7-b4b8-8a90e0b08a41_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1100072,
'Height': 2233,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2813/20272813/exterior_rear_driver-1774717845708.jpg',
'Width': 2977},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c53c568c-92cb-5cd7-b4b8-8a90e0b08a41/c53c568c-92cb-5cd7-b4b8-8a90e0b08a41_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1153438,
'Height': 2170,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2813/20272813/exterior_front_passenger-1774717959901.jpg',
'Width': 2893},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c53c568c-92cb-5cd7-b4b8-8a90e0b08a41/c53c568c-92cb-5cd7-b4b8-8a90e0b08a41_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1304682,
'Height': 2346,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2813/20272813/exterior_rear_passenger-1774717948399.jpg',
'Width': 3128},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c53c568c-92cb-5cd7-b4b8-8a90e0b08a41/c53c568c-92cb-5cd7-b4b8-8a90e0b08a41_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3106330,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2813/20272813/interior_front_seats-1774718248804.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c53c568c-92cb-5cd7-b4b8-8a90e0b08a41/c53c568c-92cb-5cd7-b4b8-8a90e0b08a41_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2767636,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2813/20272813/interior_rear_seats-1774718261483.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c53c568c-92cb-5cd7-b4b8-8a90e0b08a41/c53c568c-92cb-5cd7-b4b8-8a90e0b08a41_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1625813,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2813/20272813/interior_dashboard-1774718296268.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c53c568c-92cb-5cd7-b4b8-8a90e0b08a41/c53c568c-92cb-5cd7-b4b8-8a90e0b08a41_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2600034,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2813/20272813/instrument_cluster-1774718353408.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c53c568c-92cb-5cd7-b4b8-8a90e0b08a41/c53c568c-92cb-5cd7-b4b8-8a90e0b08a41_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3667468,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2813/20272813/interior_boot-1774718300726.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c53c568c-92cb-5cd7-b4b8-8a90e0b08a41/c53c568c-92cb-5cd7-b4b8-8a90e0b08a41_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 709917,
'Height': 2657,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2813/20272813/docs_service_history-1774770872072.jpg?ixlib=js-3.8.0&auto=format&s=8d79b7c88a8073dd713ee6cded412b73',
'Width': 1889}],
'price': 19987,
'price_includes_vat': False,
'registration_date': '2018-12-18',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Touareg V6 R-LINE TDI Auto',
'transmission': 'automatic',
'trim': 'V6 R-LINE TDI Auto',
'vin': 'WVGZZZCRZJD004958',
'year': 2018}
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720272813%27 HTTP/1.1" 200 None
2026-03-29 20:13:48 [motorway.uk] INFO: Saving data for 20272813: {'created_time': 1774815228.378589, 'last_price_update_time': 1774815228.378599, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20272813') HTTP/1.1" 204 0
2026-03-29 20:13:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=612&page=17&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d7ac10>
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c23fb1c6-07a8-59cb-b95b-ee9201b8cb76/c23fb1c6-07a8-59cb-b95b-ee9201b8cb76_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5425%252F17585425%252Fexterior_rear_driver-1774628530790.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5425/17585425/exterior_rear_driver-1774628530790.jpg saved to cache
2026-03-29 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c23fb1c6-07a8-59cb-b95b-ee9201b8cb76
2026-03-29 20:13:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c23fb1c6-07a8-59cb-b95b-ee9201b8cb76, skipping ID generation
2026-03-29 20:13:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c23fb1c6-07a8-59cb-b95b-ee9201b8cb76 with scrape type 1
2026-03-29 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c23fb1c6-07a8-59cb-b95b-ee9201b8cb76 sending to next pipeline
2026-03-29 20:13:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c23fb1c6-07a8-59cb-b95b-ee9201b8cb76, identifier: 17585425
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c60c10>
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cf46345-9e5b-5dac-9ec3-54b298104bf4/6cf46345-9e5b-5dac-9ec3-54b298104bf4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6704%252F14816704%252Fexterior_rear_passenger-1774709117002.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6704/14816704/exterior_rear_passenger-1774709117002.jpg saved to cache
2026-03-29 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6cf46345-9e5b-5dac-9ec3-54b298104bf4
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658308950>
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6381d4c9-30c7-54c9-a842-740f5af2d82a/6381d4c9-30c7-54c9-a842-740f5af2d82a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9478%252F20039478%252Fexterior_front_driver-1774549157771.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9478/20039478/exterior_front_driver-1774549157771.jpg saved to cache
2026-03-29 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6381d4c9-30c7-54c9-a842-740f5af2d82a
2026-03-29 20:13:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6381d4c9-30c7-54c9-a842-740f5af2d82a, skipping ID generation
2026-03-29 20:13:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6381d4c9-30c7-54c9-a842-740f5af2d82a with scrape type 1
2026-03-29 20:13:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6381d4c9-30c7-54c9-a842-740f5af2d82a sending to next pipeline
2026-03-29 20:13:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6381d4c9-30c7-54c9-a842-740f5af2d82a, identifier: 20039478
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659cc34d0>
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cf46345-9e5b-5dac-9ec3-54b298104bf4/6cf46345-9e5b-5dac-9ec3-54b298104bf4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6704%252F14816704%252Fexterior_front_passenger-1774709128109.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6704/14816704/exterior_front_passenger-1774709128109.jpg saved to cache
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6cf46345-9e5b-5dac-9ec3-54b298104bf4
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cfa490>
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dbc070e-a22e-5d3e-b8f4-ff6b0008a769/7dbc070e-a22e-5d3e-b8f4-ff6b0008a769_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0710%252F15910710%252Finterior_dashboard-1774776885609.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0710/15910710/interior_dashboard-1774776885609.jpg saved to cache
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7dbc070e-a22e-5d3e-b8f4-ff6b0008a769
2026-03-29 20:13:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:13:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c62810>
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dbc070e-a22e-5d3e-b8f4-ff6b0008a769/7dbc070e-a22e-5d3e-b8f4-ff6b0008a769_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0710%252F15910710%252Finterior_rear_seats-1774722236808.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0710/15910710/interior_rear_seats-1774722236808.jpg saved to cache
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7dbc070e-a22e-5d3e-b8f4-ff6b0008a769
2026-03-29 20:13:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6580f85d0>
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cf46345-9e5b-5dac-9ec3-54b298104bf4/6cf46345-9e5b-5dac-9ec3-54b298104bf4_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6704%252F14816704%252Finterior_front_seats-1774709769959.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6704/14816704/interior_front_seats-1774709769959.jpg saved to cache
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6cf46345-9e5b-5dac-9ec3-54b298104bf4
2026-03-29 20:13:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:13:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d79b50>
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dbc070e-a22e-5d3e-b8f4-ff6b0008a769/7dbc070e-a22e-5d3e-b8f4-ff6b0008a769_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0710%252F15910710%252Finterior_front_seats-1774722223351.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0710/15910710/interior_front_seats-1774722223351.jpg saved to cache
2026-03-29 20:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7dbc070e-a22e-5d3e-b8f4-ff6b0008a769
2026-03-29 20:13:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c23fb1c6-07a8-59cb-b95b-ee9201b8cb76 with identifier: 17585425
2026-03-29 20:13:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c23fb1c6-07a8-59cb-b95b-ee9201b8cb76 with identifier: 17585425
2026-03-29 20:13:49 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c23fb1c6-07a8-59cb-b95b-ee9201b8cb76 with identifier: 17585425 to the API
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5425/17585425/exterior_rear_driver-1774628530790.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'c23fb1c6-07a8-59cb-b95b-ee9201b8cb76',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'S111 APJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17585425',
'listing': 'auction',
'location': 'Merthyr Tydfil County Borough Merthyr Tydfil',
'make': 'Jaguar',
'model': 'F-PACE',
'odometer': 58000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c23fb1c6-07a8-59cb-b95b-ee9201b8cb76/c23fb1c6-07a8-59cb-b95b-ee9201b8cb76_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1432083,
'Height': 2489,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5425/17585425/exterior_front_driver-1774628522021.jpg',
'Width': 3318},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c23fb1c6-07a8-59cb-b95b-ee9201b8cb76/c23fb1c6-07a8-59cb-b95b-ee9201b8cb76_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1169256,
'Height': 2541,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5425/17585425/exterior_rear_driver-1774628530790.jpg',
'Width': 3388},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c23fb1c6-07a8-59cb-b95b-ee9201b8cb76/c23fb1c6-07a8-59cb-b95b-ee9201b8cb76_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1448733,
'Height': 2687,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5425/17585425/exterior_front_passenger-1774628559612.jpg',
'Width': 3582},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c23fb1c6-07a8-59cb-b95b-ee9201b8cb76/c23fb1c6-07a8-59cb-b95b-ee9201b8cb76_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1485176,
'Height': 2837,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5425/17585425/exterior_rear_passenger-1774628548929.jpg',
'Width': 3783},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c23fb1c6-07a8-59cb-b95b-ee9201b8cb76/c23fb1c6-07a8-59cb-b95b-ee9201b8cb76_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3643707,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5425/17585425/interior_front_seats-1774629085728.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c23fb1c6-07a8-59cb-b95b-ee9201b8cb76/c23fb1c6-07a8-59cb-b95b-ee9201b8cb76_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3705283,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5425/17585425/interior_rear_seats-1774629109435.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c23fb1c6-07a8-59cb-b95b-ee9201b8cb76/c23fb1c6-07a8-59cb-b95b-ee9201b8cb76_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2399321,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5425/17585425/interior_dashboard-1774692644043.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c23fb1c6-07a8-59cb-b95b-ee9201b8cb76/c23fb1c6-07a8-59cb-b95b-ee9201b8cb76_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2475469,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5425/17585425/instrument_cluster-1774629188839.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c23fb1c6-07a8-59cb-b95b-ee9201b8cb76/c23fb1c6-07a8-59cb-b95b-ee9201b8cb76_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3226816,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5425/17585425/interior_boot-1774629156584.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c23fb1c6-07a8-59cb-b95b-ee9201b8cb76/c23fb1c6-07a8-59cb-b95b-ee9201b8cb76_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 403827,
'Height': 3229,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5425/17585425/docs_service_history-1774629467853.jpg?ixlib=js-3.8.0&auto=format&s=98e2d255991d423a6eecd849fd89d48e',
'Width': 2551}],
'price': 13362,
'price_includes_vat': False,
'registration_date': '2019-03-08',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar F-PACE R-Sport AWD D Auto',
'transmission': 'automatic',
'trim': 'R-Sport AWD D Auto',
'vin': 'SADCA2AN0KA605721',
'year': 2019}
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717585425%27 HTTP/1.1" 200 None
2026-03-29 20:13:49 [motorway.uk] INFO: Saving data for 17585425: {'created_time': 1774815229.955724, 'last_price_update_time': 1774815229.955736, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17585425') HTTP/1.1" 204 0
2026-03-29 20:13:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6381d4c9-30c7-54c9-a842-740f5af2d82a with identifier: 20039478
2026-03-29 20:13:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6381d4c9-30c7-54c9-a842-740f5af2d82a with identifier: 20039478
2026-03-29 20:13:50 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6381d4c9-30c7-54c9-a842-740f5af2d82a with identifier: 20039478 to the API
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9478/20039478/exterior_front_driver-1774549157771.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '6381d4c9-30c7-54c9-a842-740f5af2d82a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LR69 MXJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20039478',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Mercedes',
'model': 'CLA Class',
'odometer': 50896,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6381d4c9-30c7-54c9-a842-740f5af2d82a/6381d4c9-30c7-54c9-a842-740f5af2d82a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1798280,
'Height': 2855,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9478/20039478/exterior_front_driver-1774549157771.jpg',
'Width': 3807},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6381d4c9-30c7-54c9-a842-740f5af2d82a/6381d4c9-30c7-54c9-a842-740f5af2d82a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1716225,
'Height': 2813,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9478/20039478/exterior_rear_driver-1774549190502.jpg',
'Width': 3750},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6381d4c9-30c7-54c9-a842-740f5af2d82a/6381d4c9-30c7-54c9-a842-740f5af2d82a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1494653,
'Height': 2548,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9478/20039478/exterior_front_passenger-1774549290515.jpg',
'Width': 3397},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6381d4c9-30c7-54c9-a842-740f5af2d82a/6381d4c9-30c7-54c9-a842-740f5af2d82a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1596527,
'Height': 2664,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9478/20039478/exterior_rear_passenger-1774549370512.jpg',
'Width': 3552},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6381d4c9-30c7-54c9-a842-740f5af2d82a/6381d4c9-30c7-54c9-a842-740f5af2d82a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2600312,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9478/20039478/interior_front_seats-1774549790988.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6381d4c9-30c7-54c9-a842-740f5af2d82a/6381d4c9-30c7-54c9-a842-740f5af2d82a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1852568,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9478/20039478/interior_rear_seats-1774549825975.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6381d4c9-30c7-54c9-a842-740f5af2d82a/6381d4c9-30c7-54c9-a842-740f5af2d82a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1698888,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9478/20039478/interior_dashboard-1774549960742.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6381d4c9-30c7-54c9-a842-740f5af2d82a/6381d4c9-30c7-54c9-a842-740f5af2d82a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1888868,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9478/20039478/interior_boot-1774549894182.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6381d4c9-30c7-54c9-a842-740f5af2d82a/6381d4c9-30c7-54c9-a842-740f5af2d82a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189974,
'Height': 1430,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/9478/20039478/docs_service_history-1774551236323.jpg?ixlib=js-3.8.0&auto=format&s=8d79633eb20c2cc35e4d1ecb752199cf',
'Width': 1073},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6381d4c9-30c7-54c9-a842-740f5af2d82a/6381d4c9-30c7-54c9-a842-740f5af2d82a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74135,
'Height': 606,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9478/20039478/damage_scratches-1774551481920.jpg',
'Width': 807}],
'price': 14873,
'price_includes_vat': False,
'registration_date': '2019-09-04',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes CLA 180 AMG Line Auto',
'transmission': 'automatic',
'trim': 'CLA 180 AMG Line Auto',
'vin': 'WDD1183842N012785',
'year': 2019}
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720039478%27 HTTP/1.1" 200 None
2026-03-29 20:13:50 [motorway.uk] INFO: Saving data for 20039478: {'created_time': 1774815230.347078, 'last_price_update_time': 1774815230.347089, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20039478') HTTP/1.1" 204 0
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 20176261
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 17331668
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 20454066
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 18631801
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 3620067
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 20010331
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 6110693
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 20212993
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 18599819
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 20478024
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 20476322
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 19989124
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 20485342
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 19346587
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 18465053
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 17446512
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 19535676
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 20106291
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720106291%27 HTTP/1.1" 200 None
2026-03-29 20:13:50 [motorway.uk] INFO: Scrape type for 20106291: 1
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 18846555
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718846555%27 HTTP/1.1" 200 None
2026-03-29 20:13:50 [motorway.uk] INFO: Scrape type for 18846555: 1
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 19650847
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 16887046
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 18297776
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 19443439
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 20249715
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 18285367
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 18824482
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 19548326
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 19976408
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 17967491
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 8192755
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278192755%27 HTTP/1.1" 200 None
2026-03-29 20:13:50 [motorway.uk] INFO: Scrape type for 8192755: 1
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 20357594
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720357594%27 HTTP/1.1" 200 None
2026-03-29 20:13:50 [motorway.uk] INFO: Scrape type for 20357594: 1
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 20469292
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720469292%27 HTTP/1.1" 200 None
2026-03-29 20:13:50 [motorway.uk] INFO: Scrape type for 20469292: 1
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 20467785
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 20488132
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 20001461
2026-03-29 20:13:50 [motorway.uk] INFO: Found listing with ID: 19942570
2026-03-29 20:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0710/15910710/exterior_rear_passenger-1774775294343.jpg> (referer: None)
2026-03-29 20:13:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0710/15910710/wheels_front_driver-1774721931121.jpg> (referer: None)
2026-03-29 20:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0710/15910710/wheels_rear_driver-1774721940398.jpg> (referer: None)
2026-03-29 20:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0710/15910710/exterior_front_passenger-1774774960803.jpg> (referer: None)
2026-03-29 20:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0710/15910710/interior_boot-1774722276987.jpg> (referer: None)
2026-03-29 20:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18011097.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65851bd90>
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dbc070e-a22e-5d3e-b8f4-ff6b0008a769/7dbc070e-a22e-5d3e-b8f4-ff6b0008a769_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0710%252F15910710%252Fexterior_rear_passenger-1774775294343.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0710/15910710/exterior_rear_passenger-1774775294343.jpg saved to cache
2026-03-29 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7dbc070e-a22e-5d3e-b8f4-ff6b0008a769
2026-03-29 20:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20468575.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19821442.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0710/15910710/exterior_front_driver-1774775225891.jpg> (referer: None)
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a4de90>
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dbc070e-a22e-5d3e-b8f4-ff6b0008a769/7dbc070e-a22e-5d3e-b8f4-ff6b0008a769_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0710%252F15910710%252Fwheels_front_driver-1774721931121.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0710/15910710/wheels_front_driver-1774721931121.jpg saved to cache
2026-03-29 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7dbc070e-a22e-5d3e-b8f4-ff6b0008a769
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586f9b50>
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dbc070e-a22e-5d3e-b8f4-ff6b0008a769/7dbc070e-a22e-5d3e-b8f4-ff6b0008a769_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0710%252F15910710%252Fwheels_rear_driver-1774721940398.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0710/15910710/wheels_rear_driver-1774721940398.jpg saved to cache
2026-03-29 20:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7dbc070e-a22e-5d3e-b8f4-ff6b0008a769
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658787350>
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dbc070e-a22e-5d3e-b8f4-ff6b0008a769/7dbc070e-a22e-5d3e-b8f4-ff6b0008a769_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0710%252F15910710%252Fexterior_front_passenger-1774774960803.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0710/15910710/exterior_front_passenger-1774774960803.jpg saved to cache
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7dbc070e-a22e-5d3e-b8f4-ff6b0008a769
2026-03-29 20:13:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:13:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6580f9d10>
2026-03-29 20:13:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dbc070e-a22e-5d3e-b8f4-ff6b0008a769/7dbc070e-a22e-5d3e-b8f4-ff6b0008a769_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0710%252F15910710%252Finterior_boot-1774722276987.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0710/15910710/interior_boot-1774722276987.jpg saved to cache
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7dbc070e-a22e-5d3e-b8f4-ff6b0008a769
2026-03-29 20:13:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2851fe8f-d19d-546d-8fe9-952486cc669b with identifier: 18011097
2026-03-29 20:13:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2851fe8f-d19d-546d-8fe9-952486cc669b with scrape type 1
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2851fe8f-d19d-546d-8fe9-952486cc669b
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1097%252F18011097%252Fexterior_front_driver-1774702637296.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1097/18011097/exterior_front_driver-1774702637296.jpg not downloaded yet
2026-03-29 20:13:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1097%252F18011097%252Fexterior_rear_driver-1774704581815.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1097/18011097/exterior_rear_driver-1774704581815.jpg not downloaded yet
2026-03-29 20:13:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 905a6193-a054-577a-a86a-8b5a21e93d0e with identifier: 20468575
2026-03-29 20:13:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 905a6193-a054-577a-a86a-8b5a21e93d0e with scrape type 1
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 905a6193-a054-577a-a86a-8b5a21e93d0e
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8575%252F20468575%252Fexterior_front_driver-1774630413519.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8575/20468575/exterior_front_driver-1774630413519.jpg not downloaded yet
2026-03-29 20:13:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26cd00e7-47eb-5dc2-ba12-4b84f9fbbf5a with identifier: 19821442
2026-03-29 20:13:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26cd00e7-47eb-5dc2-ba12-4b84f9fbbf5a with scrape type 1
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 26cd00e7-47eb-5dc2-ba12-4b84f9fbbf5a
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1442%252F19821442%252Fexterior_front_driver-1773248304122.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1442/19821442/exterior_front_driver-1773248304122.jpg not downloaded yet
2026-03-29 20:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a81990>
2026-03-29 20:13:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dbc070e-a22e-5d3e-b8f4-ff6b0008a769/7dbc070e-a22e-5d3e-b8f4-ff6b0008a769_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0710%252F15910710%252Fexterior_front_driver-1774775225891.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0710/15910710/exterior_front_driver-1774775225891.jpg saved to cache
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7dbc070e-a22e-5d3e-b8f4-ff6b0008a769
2026-03-29 20:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6704/14816704/exterior_front_driver-1774709171930.jpg> (referer: None)
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1097%252F18011097%252Fexterior_front_passenger-1774702631419.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1097/18011097/exterior_front_passenger-1774702631419.jpg not downloaded yet
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8575%252F20468575%252Fexterior_rear_driver-1774630421301.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8575/20468575/exterior_rear_driver-1774630421301.jpg not downloaded yet
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1442%252F19821442%252Fexterior_rear_driver-1773248244691.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1442/19821442/exterior_rear_driver-1773248244691.jpg not downloaded yet
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1097%252F18011097%252Fexterior_rear_passenger-1774704594378.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1097/18011097/exterior_rear_passenger-1774704594378.jpg not downloaded yet
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8575%252F20468575%252Fexterior_front_passenger-1774630416965.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8575/20468575/exterior_front_passenger-1774630416965.jpg not downloaded yet
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1442%252F19821442%252Fexterior_front_passenger-1773248271783.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1442/19821442/exterior_front_passenger-1773248271783.jpg not downloaded yet
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1097%252F18011097%252Finterior_front_seats-1774704694204.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1097/18011097/interior_front_seats-1774704694204.jpg not downloaded yet
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8575%252F20468575%252Fexterior_rear_passenger-1774630420030.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8575/20468575/exterior_rear_passenger-1774630420030.jpg not downloaded yet
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1442%252F19821442%252Fexterior_rear_passenger-1773248257771.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1442/19821442/exterior_rear_passenger-1773248257771.jpg not downloaded yet
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1097%252F18011097%252Finterior_rear_seats-1774704652307.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1097/18011097/interior_rear_seats-1774704652307.jpg not downloaded yet
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8575%252F20468575%252Finterior_front_seats-1774630993430.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8575/20468575/interior_front_seats-1774630993430.jpg not downloaded yet
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1442%252F19821442%252Finterior_front_seats-1773410820675.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1442/19821442/interior_front_seats-1773410820675.jpg not downloaded yet
2026-03-29 20:13:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c57b90>
2026-03-29 20:13:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cf46345-9e5b-5dac-9ec3-54b298104bf4/6cf46345-9e5b-5dac-9ec3-54b298104bf4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6704%252F14816704%252Fexterior_front_driver-1774709171930.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6704/14816704/exterior_front_driver-1774709171930.jpg saved to cache
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6cf46345-9e5b-5dac-9ec3-54b298104bf4
2026-03-29 20:13:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0710/15910710/exterior_rear_driver-1774721581397.jpg> (referer: None)
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1097%252F18011097%252Finterior_dashboard-1774704640457.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1097/18011097/interior_dashboard-1774704640457.jpg not downloaded yet
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8575%252F20468575%252Finterior_rear_seats-1774630830552.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8575/20468575/interior_rear_seats-1774630830552.jpg not downloaded yet
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1442%252F19821442%252Finterior_rear_seats-1773410857415.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1442/19821442/interior_rear_seats-1773410857415.jpg not downloaded yet
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1097%252F18011097%252Finstrument_cluster-1774702923167.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1097/18011097/instrument_cluster-1774702923167.jpg not downloaded yet
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8575%252F20468575%252Finterior_dashboard-1774631017724.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8575/20468575/interior_dashboard-1774631017724.jpg not downloaded yet
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1442%252F19821442%252Finterior_dashboard-1773411211252.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1442/19821442/interior_dashboard-1773411211252.jpg not downloaded yet
2026-03-29 20:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6704/14816704/exterior_rear_driver-1774709153886.jpg> (referer: None)
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1097%252F18011097%252F18011097-interior_boot-modified-1774788342933.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1097/18011097/18011097-interior_boot-modified-1774788342933.jpeg not downloaded yet
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8575%252F20468575%252Finstrument_cluster-1774630919557.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8575/20468575/instrument_cluster-1774630919557.jpg not downloaded yet
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1442%252F19821442%252Finstrument_cluster-1773410745314.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1442/19821442/instrument_cluster-1773410745314.jpg not downloaded yet
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1097%252F18011097%252Fdocs_service_history-1774704400900.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D246522cb7d0d98162e110cd1da594cd9%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1097/18011097/docs_service_history-1774704400900.jpg?ixlib=js-3.8.0&auto=format&s=246522cb7d0d98162e110cd1da594cd9 not downloaded yet
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8575%252F20468575%252Finterior_boot-1774630834947.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8575/20468575/interior_boot-1774630834947.jpg not downloaded yet
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1442%252F19821442%252Finterior_boot-1773411253717.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1442/19821442/interior_boot-1773411253717.jpg not downloaded yet
2026-03-29 20:13:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8442/20488442/exterior_front_passenger-1774709913321.jpg> (referer: None)
2026-03-29 20:13:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6580f9b10>
2026-03-29 20:13:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dbc070e-a22e-5d3e-b8f4-ff6b0008a769/7dbc070e-a22e-5d3e-b8f4-ff6b0008a769_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0710%252F15910710%252Fexterior_rear_driver-1774721581397.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0710/15910710/exterior_rear_driver-1774721581397.jpg saved to cache
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7dbc070e-a22e-5d3e-b8f4-ff6b0008a769
2026-03-29 20:13:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7dbc070e-a22e-5d3e-b8f4-ff6b0008a769, skipping ID generation
2026-03-29 20:13:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dbc070e-a22e-5d3e-b8f4-ff6b0008a769 with scrape type 1
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7dbc070e-a22e-5d3e-b8f4-ff6b0008a769 sending to next pipeline
2026-03-29 20:13:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 7dbc070e-a22e-5d3e-b8f4-ff6b0008a769, identifier: 15910710
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8575%252F20468575%252Fdocs_service_history-1774630910771.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6f148e585f48a3b0516ada97809a2373%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8575/20468575/docs_service_history-1774630910771.jpg?ixlib=js-3.8.0&auto=format&s=6f148e585f48a3b0516ada97809a2373 not downloaded yet
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1442%252F19821442%252Fdocs_service_history-1774268850955.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D16e3d810566eb4c176f75230ae5b7ed3%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1442/19821442/docs_service_history-1774268850955.jpg?ixlib=js-3.8.0&auto=format&s=16e3d810566eb4c176f75230ae5b7ed3 not downloaded yet
2026-03-29 20:13:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7dbc070e-a22e-5d3e-b8f4-ff6b0008a769 with identifier: 15910710
2026-03-29 20:13:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7dbc070e-a22e-5d3e-b8f4-ff6b0008a769 with identifier: 15910710
2026-03-29 20:13:52 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7dbc070e-a22e-5d3e-b8f4-ff6b0008a769 with identifier: 15910710 to the API
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0710/15910710/exterior_rear_driver-1774721581397.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '7dbc070e-a22e-5d3e-b8f4-ff6b0008a769',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'HV73 OFS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/15910710',
'listing': 'auction',
'location': 'Surrey Leatherhead',
'make': 'BMW',
'model': '1 Series',
'odometer': 9810,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dbc070e-a22e-5d3e-b8f4-ff6b0008a769/7dbc070e-a22e-5d3e-b8f4-ff6b0008a769_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2249688,
'Height': 2540,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0710/15910710/exterior_front_driver-1774775225891.jpg',
'Width': 3387},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dbc070e-a22e-5d3e-b8f4-ff6b0008a769/7dbc070e-a22e-5d3e-b8f4-ff6b0008a769_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 979520,
'Height': 2244,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0710/15910710/exterior_rear_driver-1774721581397.jpg',
'Width': 2992},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dbc070e-a22e-5d3e-b8f4-ff6b0008a769/7dbc070e-a22e-5d3e-b8f4-ff6b0008a769_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2400927,
'Height': 2975,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0710/15910710/exterior_front_passenger-1774774960803.jpg',
'Width': 3966},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dbc070e-a22e-5d3e-b8f4-ff6b0008a769/7dbc070e-a22e-5d3e-b8f4-ff6b0008a769_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1525940,
'Height': 2259,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0710/15910710/exterior_rear_passenger-1774775294343.jpg',
'Width': 3012},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dbc070e-a22e-5d3e-b8f4-ff6b0008a769/7dbc070e-a22e-5d3e-b8f4-ff6b0008a769_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3050457,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0710/15910710/interior_front_seats-1774722223351.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dbc070e-a22e-5d3e-b8f4-ff6b0008a769/7dbc070e-a22e-5d3e-b8f4-ff6b0008a769_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2487141,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0710/15910710/interior_rear_seats-1774722236808.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dbc070e-a22e-5d3e-b8f4-ff6b0008a769/7dbc070e-a22e-5d3e-b8f4-ff6b0008a769_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2263398,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0710/15910710/interior_dashboard-1774776885609.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dbc070e-a22e-5d3e-b8f4-ff6b0008a769/7dbc070e-a22e-5d3e-b8f4-ff6b0008a769_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3354056,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0710/15910710/interior_boot-1774722276987.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dbc070e-a22e-5d3e-b8f4-ff6b0008a769/7dbc070e-a22e-5d3e-b8f4-ff6b0008a769_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1992447,
'Height': 2913,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0710/15910710/wheels_front_driver-1774721931121.jpg',
'Width': 3884},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dbc070e-a22e-5d3e-b8f4-ff6b0008a769/7dbc070e-a22e-5d3e-b8f4-ff6b0008a769_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2058858,
'Height': 2833,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0710/15910710/wheels_rear_driver-1774721940398.jpg',
'Width': 3777}],
'price': 20397,
'price_includes_vat': False,
'registration_date': '2023-12-15',
'seats_number': None,
'seller_name': None,
'title': 'BMW 118I M Sport Auto',
'transmission': 'automatic',
'trim': '118I M Sport Auto',
'vin': 'WBA7K320207N69511',
'year': 2023}
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715910710%27 HTTP/1.1" 200 None
2026-03-29 20:13:52 [motorway.uk] INFO: Saving data for 15910710: {'created_time': 1774815232.921526, 'last_price_update_time': 1774815232.92154, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='15910710') HTTP/1.1" 204 0
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e6f650>
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cf46345-9e5b-5dac-9ec3-54b298104bf4/6cf46345-9e5b-5dac-9ec3-54b298104bf4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6704%252F14816704%252Fexterior_rear_driver-1774709153886.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6704/14816704/exterior_rear_driver-1774709153886.jpg saved to cache
2026-03-29 20:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6cf46345-9e5b-5dac-9ec3-54b298104bf4
2026-03-29 20:13:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6cf46345-9e5b-5dac-9ec3-54b298104bf4, skipping ID generation
2026-03-29 20:13:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cf46345-9e5b-5dac-9ec3-54b298104bf4 with scrape type 1
2026-03-29 20:13:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6cf46345-9e5b-5dac-9ec3-54b298104bf4 sending to next pipeline
2026-03-29 20:13:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6cf46345-9e5b-5dac-9ec3-54b298104bf4, identifier: 14816704
2026-03-29 20:13:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6cf46345-9e5b-5dac-9ec3-54b298104bf4 with identifier: 14816704
2026-03-29 20:13:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6cf46345-9e5b-5dac-9ec3-54b298104bf4 with identifier: 14816704
2026-03-29 20:13:53 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6cf46345-9e5b-5dac-9ec3-54b298104bf4 with identifier: 14816704 to the API
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6704/14816704/exterior_rear_driver-1774709153886.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '6cf46345-9e5b-5dac-9ec3-54b298104bf4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EY69 VMU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/14816704',
'listing': 'auction',
'location': 'Hertfordshire Waltham Cross',
'make': 'Kia',
'model': 'Ceed',
'odometer': 95046,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 30,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cf46345-9e5b-5dac-9ec3-54b298104bf4/6cf46345-9e5b-5dac-9ec3-54b298104bf4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 947574,
'Height': 2094,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6704/14816704/exterior_front_driver-1774709171930.jpg',
'Width': 2792},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cf46345-9e5b-5dac-9ec3-54b298104bf4/6cf46345-9e5b-5dac-9ec3-54b298104bf4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1166293,
'Height': 2343,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6704/14816704/exterior_rear_driver-1774709153886.jpg',
'Width': 3124},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cf46345-9e5b-5dac-9ec3-54b298104bf4/6cf46345-9e5b-5dac-9ec3-54b298104bf4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2012794,
'Height': 2971,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6704/14816704/exterior_front_passenger-1774709128109.jpg',
'Width': 3961},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cf46345-9e5b-5dac-9ec3-54b298104bf4/6cf46345-9e5b-5dac-9ec3-54b298104bf4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1746376,
'Height': 2978,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6704/14816704/exterior_rear_passenger-1774709117002.jpg',
'Width': 3971},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cf46345-9e5b-5dac-9ec3-54b298104bf4/6cf46345-9e5b-5dac-9ec3-54b298104bf4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3600767,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6704/14816704/interior_front_seats-1774709769959.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cf46345-9e5b-5dac-9ec3-54b298104bf4/6cf46345-9e5b-5dac-9ec3-54b298104bf4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3233320,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6704/14816704/interior_rear_seats-1774709781994.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cf46345-9e5b-5dac-9ec3-54b298104bf4/6cf46345-9e5b-5dac-9ec3-54b298104bf4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1925053,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6704/14816704/interior_dashboard-1774709939817.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cf46345-9e5b-5dac-9ec3-54b298104bf4/6cf46345-9e5b-5dac-9ec3-54b298104bf4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1979138,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6704/14816704/instrument_cluster-1774709871633.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cf46345-9e5b-5dac-9ec3-54b298104bf4/6cf46345-9e5b-5dac-9ec3-54b298104bf4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3492071,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6704/14816704/interior_boot-1774709848730.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cf46345-9e5b-5dac-9ec3-54b298104bf4/6cf46345-9e5b-5dac-9ec3-54b298104bf4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1292631,
'Height': 2570,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/6704/14816704/docs_service_history-1774712476401.jpg?ixlib=js-3.8.0&auto=format&s=adcca7cf4a1c3250e5f310a1a39e48d9',
'Width': 3427}],
'price': 5682,
'price_includes_vat': False,
'registration_date': '2019-09-26',
'seats_number': None,
'seller_name': None,
'title': "Kia c'eed 3 CRDI ISG S-A",
'transmission': 'automatic',
'trim': "c'eed 3 CRDI ISG S-A",
'vin': 'U5YH5819VKL044241',
'year': 2019}
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714816704%27 HTTP/1.1" 200 None
2026-03-29 20:13:53 [motorway.uk] INFO: Saving data for 14816704: {'created_time': 1774815233.590171, 'last_price_update_time': 1774815233.590181, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='14816704') HTTP/1.1" 204 0
2026-03-29 20:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=648&page=18&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f25210>
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61f4b41e-afa0-593d-a54d-2b31994ad274/61f4b41e-afa0-593d-a54d-2b31994ad274_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8442%252F20488442%252Fexterior_front_passenger-1774709913321.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8442/20488442/exterior_front_passenger-1774709913321.jpg saved to cache
2026-03-29 20:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 61f4b41e-afa0-593d-a54d-2b31994ad274
2026-03-29 20:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8442/20488442/exterior_rear_driver-1774709877200.jpg> (referer: None)
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 18832294
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 20381843
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 20258462
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 18895198
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718895198%27 HTTP/1.1" 200 None
2026-03-29 20:13:53 [motorway.uk] INFO: Scrape type for 18895198: 1
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 20482892
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 20403490
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 16057618
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716057618%27 HTTP/1.1" 200 None
2026-03-29 20:13:53 [motorway.uk] INFO: Scrape type for 16057618: 1
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 17828032
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 19514884
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 20140691
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 20484845
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 20376881
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720376881%27 HTTP/1.1" 200 None
2026-03-29 20:13:53 [motorway.uk] INFO: Scrape type for 20376881: 1
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 20297983
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 20488223
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 20471931
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720471931%27 HTTP/1.1" 200 None
2026-03-29 20:13:53 [motorway.uk] INFO: Scrape type for 20471931: 1
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 20493721
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 20422784
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 3287660
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273287660%27 HTTP/1.1" 200 None
2026-03-29 20:13:53 [motorway.uk] INFO: Scrape type for 3287660: 1
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 16290111
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 14508639
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 18349158
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 5286387
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 17747789
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 20215364
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 20407647
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720407647%27 HTTP/1.1" 200 None
2026-03-29 20:13:53 [motorway.uk] INFO: Scrape type for 20407647: 1
2026-03-29 20:13:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7458/20387458/exterior_front_passenger-1774597021413.jpg> (referer: None)
2026-03-29 20:13:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 20115042
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 11558331
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 18342530
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 12851017
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 20248084
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 15064019
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 16160235
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 3081875
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 20429308
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 20485771
2026-03-29 20:13:53 [motorway.uk] INFO: Found listing with ID: 18505969
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658da4310>
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61f4b41e-afa0-593d-a54d-2b31994ad274/61f4b41e-afa0-593d-a54d-2b31994ad274_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8442%252F20488442%252Fexterior_rear_driver-1774709877200.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8442/20488442/exterior_rear_driver-1774709877200.jpg saved to cache
2026-03-29 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 61f4b41e-afa0-593d-a54d-2b31994ad274
2026-03-29 20:13:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7458/20387458/exterior_rear_passenger-1774597013817.jpg> (referer: None)
2026-03-29 20:13:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658557650>
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b50426-9aaa-5f41-8e71-68c60cfee6ab/d1b50426-9aaa-5f41-8e71-68c60cfee6ab_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7458%252F20387458%252Fexterior_front_passenger-1774597021413.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7458/20387458/exterior_front_passenger-1774597021413.jpg saved to cache
2026-03-29 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d1b50426-9aaa-5f41-8e71-68c60cfee6ab
2026-03-29 20:13:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7458/20387458/interior_rear_seats-1774597503646.jpg> (referer: None)
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599f0f10>
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b50426-9aaa-5f41-8e71-68c60cfee6ab/d1b50426-9aaa-5f41-8e71-68c60cfee6ab_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7458%252F20387458%252Fexterior_rear_passenger-1774597013817.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7458/20387458/exterior_rear_passenger-1774597013817.jpg saved to cache
2026-03-29 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d1b50426-9aaa-5f41-8e71-68c60cfee6ab
2026-03-29 20:13:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8442/20488442/exterior_front_driver-1774709857098.jpg> (referer: None)
2026-03-29 20:13:54 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (17776587) larger than download warn size (10485760) in request <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1442/19821442/docs_service_history-1774268850955.jpg?ixlib=js-3.8.0&auto=format&s=16e3d810566eb4c176f75230ae5b7ed3>.
2026-03-29 20:13:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf37bd0>
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b50426-9aaa-5f41-8e71-68c60cfee6ab/d1b50426-9aaa-5f41-8e71-68c60cfee6ab_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7458%252F20387458%252Finterior_rear_seats-1774597503646.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7458/20387458/interior_rear_seats-1774597503646.jpg saved to cache
2026-03-29 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d1b50426-9aaa-5f41-8e71-68c60cfee6ab
2026-03-29 20:13:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1442/19821442/exterior_front_driver-1773248304122.jpg> (referer: None)
2026-03-29 20:13:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7458/20387458/interior_front_seats-1774597362141.jpg> (referer: None)
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658355150>
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61f4b41e-afa0-593d-a54d-2b31994ad274/61f4b41e-afa0-593d-a54d-2b31994ad274_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8442%252F20488442%252Fexterior_front_driver-1774709857098.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8442/20488442/exterior_front_driver-1774709857098.jpg saved to cache
2026-03-29 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 61f4b41e-afa0-593d-a54d-2b31994ad274
2026-03-29 20:13:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 61f4b41e-afa0-593d-a54d-2b31994ad274, skipping ID generation
2026-03-29 20:13:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61f4b41e-afa0-593d-a54d-2b31994ad274 with scrape type 1
2026-03-29 20:13:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 61f4b41e-afa0-593d-a54d-2b31994ad274 sending to next pipeline
2026-03-29 20:13:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 61f4b41e-afa0-593d-a54d-2b31994ad274, identifier: 20488442
2026-03-29 20:13:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 61f4b41e-afa0-593d-a54d-2b31994ad274 with identifier: 20488442
2026-03-29 20:13:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 61f4b41e-afa0-593d-a54d-2b31994ad274 with identifier: 20488442
2026-03-29 20:13:54 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 61f4b41e-afa0-593d-a54d-2b31994ad274 with identifier: 20488442 to the API
2026-03-29 20:13:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:13:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8442/20488442/exterior_front_driver-1774709857098.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '61f4b41e-afa0-593d-a54d-2b31994ad274',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EA70 TVX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20488442',
'listing': 'auction',
'location': 'Bath and North East Somerset Bath',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 22768,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f4b41e-afa0-593d-a54d-2b31994ad274/61f4b41e-afa0-593d-a54d-2b31994ad274_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2546264,
'Height': 2818,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8442/20488442/exterior_front_driver-1774709857098.jpg',
'Width': 3757},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f4b41e-afa0-593d-a54d-2b31994ad274/61f4b41e-afa0-593d-a54d-2b31994ad274_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2086886,
'Height': 2591,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8442/20488442/exterior_rear_driver-1774709877200.jpg',
'Width': 3455},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f4b41e-afa0-593d-a54d-2b31994ad274/61f4b41e-afa0-593d-a54d-2b31994ad274_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1502565,
'Height': 2586,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8442/20488442/exterior_front_passenger-1774709913321.jpg',
'Width': 3448},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f4b41e-afa0-593d-a54d-2b31994ad274/61f4b41e-afa0-593d-a54d-2b31994ad274_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2357807,
'Height': 2710,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8442/20488442/exterior_rear_passenger-1774709893389.jpg',
'Width': 3613},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f4b41e-afa0-593d-a54d-2b31994ad274/61f4b41e-afa0-593d-a54d-2b31994ad274_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3777254,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8442/20488442/interior_front_seats-1774710416168.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f4b41e-afa0-593d-a54d-2b31994ad274/61f4b41e-afa0-593d-a54d-2b31994ad274_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4132907,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8442/20488442/interior_rear_seats-1774710439287.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f4b41e-afa0-593d-a54d-2b31994ad274/61f4b41e-afa0-593d-a54d-2b31994ad274_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1814662,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8442/20488442/interior_dashboard-1774710479224.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f4b41e-afa0-593d-a54d-2b31994ad274/61f4b41e-afa0-593d-a54d-2b31994ad274_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2811157,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8442/20488442/instrument_cluster-1774710614837.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f4b41e-afa0-593d-a54d-2b31994ad274/61f4b41e-afa0-593d-a54d-2b31994ad274_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5002903,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8442/20488442/interior_boot-1774710482858.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61f4b41e-afa0-593d-a54d-2b31994ad274/61f4b41e-afa0-593d-a54d-2b31994ad274_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 12730028,
'Height': 4284,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8442/20488442/docs_service_history-1774711051659.jpg?ixlib=js-3.8.0&auto=format&s=000e46333b7b740d97c3014f8582b0cd',
'Width': 5712}],
'price': 11081,
'price_includes_vat': False,
'registration_date': '2020-11-14',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Polo Match EVO',
'transmission': 'manual',
'trim': 'Match EVO',
'vin': 'WVWZZZAWZMU005077',
'year': 2020}
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488442%27 HTTP/1.1" 200 None
2026-03-29 20:13:55 [motorway.uk] INFO: Saving data for 20488442: {'created_time': 1774815235.152144, 'last_price_update_time': 1774815235.152154, 'auction_closing_time': 1774884600.0}
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20488442') HTTP/1.1" 204 0
2026-03-29 20:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20106291.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ca7d90>
2026-03-29 20:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26cd00e7-47eb-5dc2-ba12-4b84f9fbbf5a/26cd00e7-47eb-5dc2-ba12-4b84f9fbbf5a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1442%252F19821442%252Fexterior_front_driver-1773248304122.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1442/19821442/exterior_front_driver-1773248304122.jpg saved to cache
2026-03-29 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26cd00e7-47eb-5dc2-ba12-4b84f9fbbf5a
2026-03-29 20:13:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:13:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584dccd0>
2026-03-29 20:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1b50426-9aaa-5f41-8e71-68c60cfee6ab/d1b50426-9aaa-5f41-8e71-68c60cfee6ab_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7458%252F20387458%252Finterior_front_seats-1774597362141.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7458/20387458/interior_front_seats-1774597362141.jpg saved to cache
2026-03-29 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d1b50426-9aaa-5f41-8e71-68c60cfee6ab
2026-03-29 20:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20357594.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18846555.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cf47741-afa0-53f2-9f99-c2890a9f0c37 with identifier: 20106291
2026-03-29 20:13:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cf47741-afa0-53f2-9f99-c2890a9f0c37 with scrape type 1
2026-03-29 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4cf47741-afa0-53f2-9f99-c2890a9f0c37
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6291%252F20106291%252Fexterior_front_driver-1774713037602.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6291/20106291/exterior_front_driver-1774713037602.jpg not downloaded yet
2026-03-29 20:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8575/20468575/docs_service_history-1774630910771.jpg?ixlib=js-3.8.0&auto=format&s=6f148e585f48a3b0516ada97809a2373> (referer: None)
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6291%252F20106291%252Fexterior_rear_driver-1774712578493.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6291/20106291/exterior_rear_driver-1774712578493.jpg not downloaded yet
2026-03-29 20:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1442/19821442/interior_front_seats-1773410820675.jpg> (referer: None)
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6291%252F20106291%252Fexterior_front_passenger-1774712426686.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6291/20106291/exterior_front_passenger-1774712426686.jpg not downloaded yet
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6291%252F20106291%252Fexterior_rear_passenger-1774712491983.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6291/20106291/exterior_rear_passenger-1774712491983.jpg not downloaded yet
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6291%252F20106291%252Finterior_front_seats-1774713175495.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6291/20106291/interior_front_seats-1774713175495.jpg not downloaded yet
2026-03-29 20:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1442/19821442/interior_dashboard-1773411211252.jpg> (referer: None)
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6291%252F20106291%252Finterior_rear_seats-1774713181954.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6291/20106291/interior_rear_seats-1774713181954.jpg not downloaded yet
2026-03-29 20:13:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71934f95-f800-5156-805b-967ba21c6845 with identifier: 20357594
2026-03-29 20:13:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71934f95-f800-5156-805b-967ba21c6845 with scrape type 1
2026-03-29 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 71934f95-f800-5156-805b-967ba21c6845
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7594%252F20357594%252Fexterior_front_driver-1774110666602.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7594/20357594/exterior_front_driver-1774110666602.jpg not downloaded yet
2026-03-29 20:13:55 [motorway.uk] ERROR: Error parsing details
Traceback (most recent call last):
File "/usr/src/app/crawlers/spiders/motorway.py", line 262, in parse_details
item = self._extract_listing_item(detail_data, auction_type)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/motorway.py", line 290, in _extract_listing_item
trim = self._extract_trim(detail_data)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/motorway.py", line 476, in _extract_trim
.replace(model, "")
^^^^^^^^^^^^^^^^^^
TypeError: replace() argument 1 must be str, not None
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6291%252F20106291%252Finterior_dashboard-1774713209040.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6291/20106291/interior_dashboard-1774713209040.jpg not downloaded yet
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7594%252F20357594%252Fexterior_rear_driver-1774110829620.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7594/20357594/exterior_rear_driver-1774110829620.jpg not downloaded yet
2026-03-29 20:13:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599ed8d0>
2026-03-29 20:13:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_905a6193-a054-577a-a86a-8b5a21e93d0e/905a6193-a054-577a-a86a-8b5a21e93d0e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8575%252F20468575%252Fdocs_service_history-1774630910771.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6f148e585f48a3b0516ada97809a2373') HTTP/1.1" 204 0
2026-03-29 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8575/20468575/docs_service_history-1774630910771.jpg?ixlib=js-3.8.0&auto=format&s=6f148e585f48a3b0516ada97809a2373 saved to cache
2026-03-29 20:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 905a6193-a054-577a-a86a-8b5a21e93d0e
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6291%252F20106291%252Finstrument_cluster-1774713241619.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6291/20106291/instrument_cluster-1774713241619.jpg not downloaded yet
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7594%252F20357594%252Fexterior_front_passenger-1774111181433.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7594/20357594/exterior_front_passenger-1774111181433.jpg not downloaded yet
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6291%252F20106291%252Finterior_boot-1774713203575.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6291/20106291/interior_boot-1774713203575.jpg not downloaded yet
2026-03-29 20:13:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c4e850>
2026-03-29 20:13:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26cd00e7-47eb-5dc2-ba12-4b84f9fbbf5a/26cd00e7-47eb-5dc2-ba12-4b84f9fbbf5a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1442%252F19821442%252Finterior_front_seats-1773410820675.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1442/19821442/interior_front_seats-1773410820675.jpg saved to cache
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 26cd00e7-47eb-5dc2-ba12-4b84f9fbbf5a
2026-03-29 20:13:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ac2310>
2026-03-29 20:13:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26cd00e7-47eb-5dc2-ba12-4b84f9fbbf5a/26cd00e7-47eb-5dc2-ba12-4b84f9fbbf5a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1442%252F19821442%252Finterior_dashboard-1773411211252.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1442/19821442/interior_dashboard-1773411211252.jpg saved to cache
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 26cd00e7-47eb-5dc2-ba12-4b84f9fbbf5a
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7594%252F20357594%252Fexterior_rear_passenger-1774110871473.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7594/20357594/exterior_rear_passenger-1774110871473.jpg not downloaded yet
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6291%252F20106291%252Fdocs_service_history-1774713206307.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7e5d545fb10661ff894a71f154948afe%27 HTTP/1.1" 200 None
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6291/20106291/docs_service_history-1774713206307.jpg?ixlib=js-3.8.0&auto=format&s=7e5d545fb10661ff894a71f154948afe not downloaded yet
2026-03-29 20:13:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/8192755.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7594%252F20357594%252Finterior_front_seats-1774113464063.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7594/20357594/interior_front_seats-1774113464063.jpg not downloaded yet
2026-03-29 20:13:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7594%252F20357594%252Finterior_rear_seats-1774113494762.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7594/20357594/interior_rear_seats-1774113494762.jpg not downloaded yet
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7594%252F20357594%252Finterior_dashboard-1774113526967.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7594/20357594/interior_dashboard-1774113526967.jpg not downloaded yet
2026-03-29 20:13:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6291/20106291/exterior_front_driver-1774713037602.jpg> (referer: None)
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7594%252F20357594%252Finstrument_cluster-1774113556889.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7594/20357594/instrument_cluster-1774113556889.jpg not downloaded yet
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7594%252F20357594%252Finterior_boot-1774113541233.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7594/20357594/interior_boot-1774113541233.jpg not downloaded yet
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7594%252F20357594%252Fdocs_service_history-1774520944313.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D360b9959005475ca46df67068b2c6802%27 HTTP/1.1" 200 None
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7594/20357594/docs_service_history-1774520944313.jpg?ixlib=js-3.8.0&auto=format&s=360b9959005475ca46df67068b2c6802 not downloaded yet
2026-03-29 20:13:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2c78946-39a8-5f2a-835b-5aea64b4fb16 with identifier: 8192755
2026-03-29 20:13:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2c78946-39a8-5f2a-835b-5aea64b4fb16 with scrape type 1
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a2c78946-39a8-5f2a-835b-5aea64b4fb16
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2755%252F8192755%252Fexterior_front_driver-1774692027325.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2755/8192755/exterior_front_driver-1774692027325.jpg not downloaded yet
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2755%252F8192755%252Fexterior_rear_driver-1774692042006.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2755/8192755/exterior_rear_driver-1774692042006.jpg not downloaded yet
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2755%252F8192755%252Fexterior_front_passenger-1774692078581.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2755/8192755/exterior_front_passenger-1774692078581.jpg not downloaded yet
2026-03-29 20:13:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1442/19821442/interior_boot-1773411253717.jpg> (referer: None)
2026-03-29 20:13:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658547f10>
2026-03-29 20:13:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cf47741-afa0-53f2-9f99-c2890a9f0c37/4cf47741-afa0-53f2-9f99-c2890a9f0c37_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6291%252F20106291%252Fexterior_front_driver-1774713037602.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6291/20106291/exterior_front_driver-1774713037602.jpg saved to cache
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4cf47741-afa0-53f2-9f99-c2890a9f0c37
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2755%252F8192755%252Fexterior_rear_passenger-1774692063216.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2755/8192755/exterior_rear_passenger-1774692063216.jpg not downloaded yet
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2755%252F8192755%252Finterior_front_seats-1774693377379.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2755/8192755/interior_front_seats-1774693377379.jpg not downloaded yet
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2755%252F8192755%252Finterior_rear_seats-1774693229760.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2755/8192755/interior_rear_seats-1774693229760.jpg not downloaded yet
2026-03-29 20:13:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582c5c50>
2026-03-29 20:13:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26cd00e7-47eb-5dc2-ba12-4b84f9fbbf5a/26cd00e7-47eb-5dc2-ba12-4b84f9fbbf5a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1442%252F19821442%252Finterior_boot-1773411253717.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1442/19821442/interior_boot-1773411253717.jpg saved to cache
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 26cd00e7-47eb-5dc2-ba12-4b84f9fbbf5a
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2755%252F8192755%252Finterior_dashboard-1774693270565.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2755/8192755/interior_dashboard-1774693270565.jpg not downloaded yet
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2755%252F8192755%252Finstrument_cluster-1774693490594.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2755/8192755/instrument_cluster-1774693490594.jpg not downloaded yet
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2755%252F8192755%252Finterior_boot-1774693282057.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2755/8192755/interior_boot-1774693282057.jpg not downloaded yet
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2755%252F8192755%252Fdocs_service_history-1774693674683.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D35f9fc8fe94df0e3dbce6d4d1f862200%27 HTTP/1.1" 200 None
2026-03-29 20:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2755/8192755/docs_service_history-1774693674683.jpg?ixlib=js-3.8.0&auto=format&s=35f9fc8fe94df0e3dbce6d4d1f862200 not downloaded yet
2026-03-29 20:13:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8575/20468575/interior_boot-1774630834947.jpg> (referer: None)
2026-03-29 20:13:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1097/18011097/docs_service_history-1774704400900.jpg?ixlib=js-3.8.0&auto=format&s=246522cb7d0d98162e110cd1da594cd9> (referer: None)
2026-03-29 20:13:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7594/20357594/interior_dashboard-1774113526967.jpg> (referer: None)
2026-03-29 20:13:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7594/20357594/exterior_rear_passenger-1774110871473.jpg> (referer: None)
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658476390>
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_905a6193-a054-577a-a86a-8b5a21e93d0e/905a6193-a054-577a-a86a-8b5a21e93d0e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8575%252F20468575%252Finterior_boot-1774630834947.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8575/20468575/interior_boot-1774630834947.jpg saved to cache
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 905a6193-a054-577a-a86a-8b5a21e93d0e
2026-03-29 20:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6291/20106291/docs_service_history-1774713206307.jpg?ixlib=js-3.8.0&auto=format&s=7e5d545fb10661ff894a71f154948afe> (referer: None)
2026-03-29 20:13:57 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1442/19821442/docs_service_history-1774268850955.jpg?ixlib=js-3.8.0&auto=format&s=16e3d810566eb4c176f75230ae5b7ed3>.
2026-03-29 20:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2755/8192755/docs_service_history-1774693674683.jpg?ixlib=js-3.8.0&auto=format&s=35f9fc8fe94df0e3dbce6d4d1f862200> (referer: None)
2026-03-29 20:13:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 146 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 154 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:57 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xe0'
2026-03-29 20:13:57 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 162 - value: b'DNP-NX9\x00'
2026-03-29 20:13:57 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xe8'
2026-03-29 20:13:57 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 82 - Data Location: 170 - value: b'HONOR\x00'
2026-03-29 20:13:57 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xc4'
2026-03-29 20:13:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:13:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:57 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 142 - Data Location: 176 - value: b'2026:03:28 13:24:32\x00'
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589f72d0>
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2851fe8f-d19d-546d-8fe9-952486cc669b/2851fe8f-d19d-546d-8fe9-952486cc669b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1097%252F18011097%252Fdocs_service_history-1774704400900.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D246522cb7d0d98162e110cd1da594cd9') HTTP/1.1" 204 0
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1097/18011097/docs_service_history-1774704400900.jpg?ixlib=js-3.8.0&auto=format&s=246522cb7d0d98162e110cd1da594cd9 saved to cache
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2851fe8f-d19d-546d-8fe9-952486cc669b
2026-03-29 20:13:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587c1610>
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71934f95-f800-5156-805b-967ba21c6845/71934f95-f800-5156-805b-967ba21c6845_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7594%252F20357594%252Finterior_dashboard-1774113526967.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7594/20357594/interior_dashboard-1774113526967.jpg saved to cache
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 71934f95-f800-5156-805b-967ba21c6845
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658438610>
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71934f95-f800-5156-805b-967ba21c6845/71934f95-f800-5156-805b-967ba21c6845_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7594%252F20357594%252Fexterior_rear_passenger-1774110871473.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7594/20357594/exterior_rear_passenger-1774110871473.jpg saved to cache
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 71934f95-f800-5156-805b-967ba21c6845
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bd94d0>
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cf47741-afa0-53f2-9f99-c2890a9f0c37/4cf47741-afa0-53f2-9f99-c2890a9f0c37_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6291%252F20106291%252Fdocs_service_history-1774713206307.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7e5d545fb10661ff894a71f154948afe') HTTP/1.1" 204 0
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6291/20106291/docs_service_history-1774713206307.jpg?ixlib=js-3.8.0&auto=format&s=7e5d545fb10661ff894a71f154948afe saved to cache
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4cf47741-afa0-53f2-9f99-c2890a9f0c37
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65857a1d0>
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2c78946-39a8-5f2a-835b-5aea64b4fb16/a2c78946-39a8-5f2a-835b-5aea64b4fb16_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2755%252F8192755%252Fdocs_service_history-1774693674683.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D35f9fc8fe94df0e3dbce6d4d1f862200') HTTP/1.1" 204 0
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2755/8192755/docs_service_history-1774693674683.jpg?ixlib=js-3.8.0&auto=format&s=35f9fc8fe94df0e3dbce6d4d1f862200 saved to cache
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a2c78946-39a8-5f2a-835b-5aea64b4fb16
2026-03-29 20:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2755/8192755/exterior_rear_passenger-1774692063216.jpg> (referer: None)
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cc1150>
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2c78946-39a8-5f2a-835b-5aea64b4fb16/a2c78946-39a8-5f2a-835b-5aea64b4fb16_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2755%252F8192755%252Fexterior_rear_passenger-1774692063216.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2755/8192755/exterior_rear_passenger-1774692063216.jpg saved to cache
2026-03-29 20:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a2c78946-39a8-5f2a-835b-5aea64b4fb16
2026-03-29 20:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20469292.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2755/8192755/interior_dashboard-1774693270565.jpg> (referer: None)
2026-03-29 20:13:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2755/8192755/instrument_cluster-1774693490594.jpg> (referer: None)
2026-03-29 20:13:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3408a86-1e7c-54a6-8ccc-b4b3b566323c with identifier: 20469292
2026-03-29 20:13:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3408a86-1e7c-54a6-8ccc-b4b3b566323c with scrape type 1
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f3408a86-1e7c-54a6-8ccc-b4b3b566323c
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9292%252F20469292%252Fexterior_front_driver-1774710829984.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9292/20469292/exterior_front_driver-1774710829984.jpg not downloaded yet
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9292%252F20469292%252Fexterior_rear_driver-1774710773699.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9292/20469292/exterior_rear_driver-1774710773699.jpg not downloaded yet
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9292%252F20469292%252Fexterior_front_passenger-1774716176101.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9292/20469292/exterior_front_passenger-1774716176101.jpg not downloaded yet
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9292%252F20469292%252Fexterior_rear_passenger-1774710799283.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9292/20469292/exterior_rear_passenger-1774710799283.jpg not downloaded yet
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9292%252F20469292%252Finterior_front_seats-1774712315880.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9292/20469292/interior_front_seats-1774712315880.jpg not downloaded yet
2026-03-29 20:13:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1442/19821442/docs_service_history-1774268850955.jpg?ixlib=js-3.8.0&auto=format&s=16e3d810566eb4c176f75230ae5b7ed3> (referer: None)
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e5cbd0>
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2c78946-39a8-5f2a-835b-5aea64b4fb16/a2c78946-39a8-5f2a-835b-5aea64b4fb16_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2755%252F8192755%252Finterior_dashboard-1774693270565.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2755/8192755/interior_dashboard-1774693270565.jpg saved to cache
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a2c78946-39a8-5f2a-835b-5aea64b4fb16
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9292%252F20469292%252Finterior_rear_seats-1774712336257.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9292/20469292/interior_rear_seats-1774712336257.jpg not downloaded yet
2026-03-29 20:13:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2755/8192755/exterior_front_passenger-1774692078581.jpg> (referer: None)
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c32810>
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2c78946-39a8-5f2a-835b-5aea64b4fb16/a2c78946-39a8-5f2a-835b-5aea64b4fb16_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2755%252F8192755%252Finstrument_cluster-1774693490594.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2755/8192755/instrument_cluster-1774693490594.jpg saved to cache
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a2c78946-39a8-5f2a-835b-5aea64b4fb16
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9292%252F20469292%252Finterior_dashboard-1774712384223.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9292/20469292/interior_dashboard-1774712384223.jpg not downloaded yet
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9292%252F20469292%252Finstrument_cluster-1774712928174.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9292/20469292/instrument_cluster-1774712928174.jpg not downloaded yet
2026-03-29 20:13:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:58 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f275d0>
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26cd00e7-47eb-5dc2-ba12-4b84f9fbbf5a/26cd00e7-47eb-5dc2-ba12-4b84f9fbbf5a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1442%252F19821442%252Fdocs_service_history-1774268850955.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D16e3d810566eb4c176f75230ae5b7ed3') HTTP/1.1" 204 0
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1442/19821442/docs_service_history-1774268850955.jpg?ixlib=js-3.8.0&auto=format&s=16e3d810566eb4c176f75230ae5b7ed3 saved to cache
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 26cd00e7-47eb-5dc2-ba12-4b84f9fbbf5a
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9292%252F20469292%252Finterior_boot-1774712672554.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9292/20469292/interior_boot-1774712672554.jpg not downloaded yet
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e04850>
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2c78946-39a8-5f2a-835b-5aea64b4fb16/a2c78946-39a8-5f2a-835b-5aea64b4fb16_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2755%252F8192755%252Fexterior_front_passenger-1774692078581.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2755/8192755/exterior_front_passenger-1774692078581.jpg saved to cache
2026-03-29 20:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a2c78946-39a8-5f2a-835b-5aea64b4fb16
2026-03-29 20:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9292%252F20469292%252Fdocs_service_history-1774715973033.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df45307e6a2fece656cd662f77060a601%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9292/20469292/docs_service_history-1774715973033.jpg?ixlib=js-3.8.0&auto=format&s=f45307e6a2fece656cd662f77060a601 not downloaded yet
2026-03-29 20:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6291/20106291/interior_boot-1774713203575.jpg> (referer: None)
2026-03-29 20:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2755/8192755/exterior_rear_driver-1774692042006.jpg> (referer: None)
2026-03-29 20:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2755/8192755/interior_front_seats-1774693377379.jpg> (referer: None)
2026-03-29 20:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2755/8192755/interior_boot-1774693282057.jpg> (referer: None)
2026-03-29 20:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7594/20357594/docs_service_history-1774520944313.jpg?ixlib=js-3.8.0&auto=format&s=360b9959005475ca46df67068b2c6802> (referer: None)
2026-03-29 20:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/3287660.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:13:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659bd8510>
2026-03-29 20:13:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4cf47741-afa0-53f2-9f99-c2890a9f0c37/4cf47741-afa0-53f2-9f99-c2890a9f0c37_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6291%252F20106291%252Finterior_boot-1774713203575.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6291/20106291/interior_boot-1774713203575.jpg saved to cache
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4cf47741-afa0-53f2-9f99-c2890a9f0c37
2026-03-29 20:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2755/8192755/exterior_front_driver-1774692027325.jpg> (referer: None)
2026-03-29 20:13:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659bd8290>
2026-03-29 20:13:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2c78946-39a8-5f2a-835b-5aea64b4fb16/a2c78946-39a8-5f2a-835b-5aea64b4fb16_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2755%252F8192755%252Fexterior_rear_driver-1774692042006.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2755/8192755/exterior_rear_driver-1774692042006.jpg saved to cache
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a2c78946-39a8-5f2a-835b-5aea64b4fb16
2026-03-29 20:13:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584d60d0>
2026-03-29 20:13:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2c78946-39a8-5f2a-835b-5aea64b4fb16/a2c78946-39a8-5f2a-835b-5aea64b4fb16_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2755%252F8192755%252Finterior_front_seats-1774693377379.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2755/8192755/interior_front_seats-1774693377379.jpg saved to cache
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a2c78946-39a8-5f2a-835b-5aea64b4fb16
2026-03-29 20:13:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589c5990>
2026-03-29 20:13:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2c78946-39a8-5f2a-835b-5aea64b4fb16/a2c78946-39a8-5f2a-835b-5aea64b4fb16_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2755%252F8192755%252Finterior_boot-1774693282057.jpg') HTTP/1.1" 204 0
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2755/8192755/interior_boot-1774693282057.jpg saved to cache
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a2c78946-39a8-5f2a-835b-5aea64b4fb16
2026-03-29 20:13:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:13:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:13:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:13:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:13:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:13:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658504790>
2026-03-29 20:13:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:13:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71934f95-f800-5156-805b-967ba21c6845/71934f95-f800-5156-805b-967ba21c6845_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7594%252F20357594%252Fdocs_service_history-1774520944313.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D360b9959005475ca46df67068b2c6802') HTTP/1.1" 204 0
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7594/20357594/docs_service_history-1774520944313.jpg?ixlib=js-3.8.0&auto=format&s=360b9959005475ca46df67068b2c6802 saved to cache
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 71934f95-f800-5156-805b-967ba21c6845
2026-03-29 20:13:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31950006-3595-5fbb-8acb-8a3b622eaff6 with identifier: 3287660
2026-03-29 20:13:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31950006-3595-5fbb-8acb-8a3b622eaff6 with scrape type 1
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 31950006-3595-5fbb-8acb-8a3b622eaff6
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7660%252F3287660%252Fexterior_front_driver-1774696758318.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7660/3287660/exterior_front_driver-1774696758318.jpg not downloaded yet
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7660%252F3287660%252Fexterior_rear_driver-1774696819075.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7660/3287660/exterior_rear_driver-1774696819075.jpg not downloaded yet
2026-03-29 20:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18895198.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589c5750>
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2c78946-39a8-5f2a-835b-5aea64b4fb16/a2c78946-39a8-5f2a-835b-5aea64b4fb16_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2755%252F8192755%252Fexterior_front_driver-1774692027325.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2755/8192755/exterior_front_driver-1774692027325.jpg saved to cache
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2c78946-39a8-5f2a-835b-5aea64b4fb16
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7660%252F3287660%252Fexterior_front_passenger-1774696876114.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7660/3287660/exterior_front_passenger-1774696876114.jpg not downloaded yet
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7660%252F3287660%252Fexterior_rear_passenger-1774696830765.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7660/3287660/exterior_rear_passenger-1774696830765.jpg not downloaded yet
2026-03-29 20:14:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 150e2786-d5e3-543d-9bf5-4b9b12cb2c97 with identifier: 18895198
2026-03-29 20:14:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 150e2786-d5e3-543d-9bf5-4b9b12cb2c97 with scrape type 1
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 150e2786-d5e3-543d-9bf5-4b9b12cb2c97
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5198%252F18895198%252Fexterior_front_driver-1774708366448.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5198/18895198/exterior_front_driver-1774708366448.jpg not downloaded yet
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7660%252F3287660%252Finterior_front_seats-1774703025632.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7660/3287660/interior_front_seats-1774703025632.jpg not downloaded yet
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5198%252F18895198%252Fexterior_rear_driver-1774710260787.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5198/18895198/exterior_rear_driver-1774710260787.jpg not downloaded yet
2026-03-29 20:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/9292/20469292/docs_service_history-1774715973033.jpg?ixlib=js-3.8.0&auto=format&s=f45307e6a2fece656cd662f77060a601> (referer: None)
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7660%252F3287660%252Finterior_rear_seats-1774703001684.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7660/3287660/interior_rear_seats-1774703001684.jpg not downloaded yet
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5198%252F18895198%252Fexterior_front_passenger-1774708367140.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5198/18895198/exterior_front_passenger-1774708367140.jpg not downloaded yet
2026-03-29 20:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20407647.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7660%252F3287660%252Finterior_dashboard-1774710658412.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7660/3287660/interior_dashboard-1774710658412.jpg not downloaded yet
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5198%252F18895198%252Fexterior_rear_passenger-1774710273669.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5198/18895198/exterior_rear_passenger-1774710273669.jpg not downloaded yet
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7660%252F3287660%252Finstrument_cluster-1774702942597.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7660/3287660/instrument_cluster-1774702942597.jpg not downloaded yet
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5198%252F18895198%252Finterior_front_seats-1774708769113.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5198/18895198/interior_front_seats-1774708769113.jpg not downloaded yet
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7660%252F3287660%252Finterior_boot-1774710671404.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7660/3287660/interior_boot-1774710671404.jpg not downloaded yet
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5198%252F18895198%252Finterior_rear_seats-1774708766524.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5198/18895198/interior_rear_seats-1774708766524.jpg not downloaded yet
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d35490>
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3408a86-1e7c-54a6-8ccc-b4b3b566323c/f3408a86-1e7c-54a6-8ccc-b4b3b566323c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9292%252F20469292%252Fdocs_service_history-1774715973033.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df45307e6a2fece656cd662f77060a601') HTTP/1.1" 204 0
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9292/20469292/docs_service_history-1774715973033.jpg?ixlib=js-3.8.0&auto=format&s=f45307e6a2fece656cd662f77060a601 saved to cache
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f3408a86-1e7c-54a6-8ccc-b4b3b566323c
2026-03-29 20:14:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 232e8351-b6d6-5588-899f-3b450c963437 with identifier: 20407647
2026-03-29 20:14:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 232e8351-b6d6-5588-899f-3b450c963437 with scrape type 1
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 232e8351-b6d6-5588-899f-3b450c963437
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7647%252F20407647%252Fexterior_front_driver-1774781359890.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7647/20407647/exterior_front_driver-1774781359890.jpg not downloaded yet
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7660%252F3287660%252Fdocs_service_history-1774704080088.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9c79a92b0601fab9d34c05d78e11d549%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7660/3287660/docs_service_history-1774704080088.jpg?ixlib=js-3.8.0&auto=format&s=9c79a92b0601fab9d34c05d78e11d549 not downloaded yet
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5198%252F18895198%252Finterior_dashboard-1774710291537.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5198/18895198/interior_dashboard-1774710291537.jpg not downloaded yet
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7647%252F20407647%252Fexterior_rear_driver-1774783086976.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7647/20407647/exterior_rear_driver-1774783086976.jpg not downloaded yet
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5198%252F18895198%252Finstrument_cluster-1774708800555.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5198/18895198/instrument_cluster-1774708800555.jpg not downloaded yet
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7647%252F20407647%252Fexterior_front_passenger-1774781354661.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7647/20407647/exterior_front_passenger-1774781354661.jpg not downloaded yet
2026-03-29 20:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20471931.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5198%252F18895198%252Finterior_boot-1774710304966.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5198/18895198/interior_boot-1774710304966.jpg not downloaded yet
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7647%252F20407647%252Fexterior_rear_passenger-1774783098141.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7647/20407647/exterior_rear_passenger-1774783098141.jpg not downloaded yet
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5198%252F18895198%252Fwheels_front_driver-1774708486540.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5198/18895198/wheels_front_driver-1774708486540.jpg not downloaded yet
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7647%252F20407647%252Finterior_front_seats-1774782050364.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7647/20407647/interior_front_seats-1774782050364.jpg not downloaded yet
2026-03-29 20:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5198/18895198/exterior_front_passenger-1774708367140.jpg> (referer: None)
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7647%252F20407647%252Finterior_rear_seats-1774781843725.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7647/20407647/interior_rear_seats-1774781843725.jpg not downloaded yet
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7647%252F20407647%252Finterior_dashboard-1774782899418.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7647/20407647/interior_dashboard-1774782899418.jpg not downloaded yet
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7647%252F20407647%252Finterior_boot-1774782911986.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7647/20407647/interior_boot-1774782911986.jpg not downloaded yet
2026-03-29 20:14:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36715a92-cdbf-5362-b517-d479cadc8f08 with identifier: 20471931
2026-03-29 20:14:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36715a92-cdbf-5362-b517-d479cadc8f08 with scrape type 1
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 36715a92-cdbf-5362-b517-d479cadc8f08
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1931%252F20471931%252Fexterior_front_driver-1774630056494.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1931/20471931/exterior_front_driver-1774630056494.jpg not downloaded yet
2026-03-29 20:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9292/20469292/instrument_cluster-1774712928174.jpg> (referer: None)
2026-03-29 20:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7660/3287660/exterior_front_driver-1774696758318.jpg> (referer: None)
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7647%252F20407647%252Fdamage_scratches-1774781478427.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7647/20407647/damage_scratches-1774781478427.jpg not downloaded yet
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1931%252F20471931%252Fexterior_rear_driver-1774630986714.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1931/20471931/exterior_rear_driver-1774630986714.jpg not downloaded yet
2026-03-29 20:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5198/18895198/exterior_rear_driver-1774710260787.jpg> (referer: None)
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7647%252F20407647%252Fdamage_scratches-1774781518566.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7647/20407647/damage_scratches-1774781518566.jpg not downloaded yet
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1931%252F20471931%252Fexterior_front_passenger-1774630024654.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1931/20471931/exterior_front_passenger-1774630024654.jpg not downloaded yet
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658787150>
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_150e2786-d5e3-543d-9bf5-4b9b12cb2c97/150e2786-d5e3-543d-9bf5-4b9b12cb2c97_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5198%252F18895198%252Fexterior_front_passenger-1774708367140.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5198/18895198/exterior_front_passenger-1774708367140.jpg saved to cache
2026-03-29 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 150e2786-d5e3-543d-9bf5-4b9b12cb2c97
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1931%252F20471931%252Fexterior_rear_passenger-1774630079642.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1931/20471931/exterior_rear_passenger-1774630079642.jpg not downloaded yet
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1931%252F20471931%252Finterior_front_seats-1774630483760.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1931/20471931/interior_front_seats-1774630483760.jpg not downloaded yet
2026-03-29 20:14:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a26210>
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3408a86-1e7c-54a6-8ccc-b4b3b566323c/f3408a86-1e7c-54a6-8ccc-b4b3b566323c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9292%252F20469292%252Finstrument_cluster-1774712928174.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9292/20469292/instrument_cluster-1774712928174.jpg saved to cache
2026-03-29 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f3408a86-1e7c-54a6-8ccc-b4b3b566323c
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587aab50>
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31950006-3595-5fbb-8acb-8a3b622eaff6/31950006-3595-5fbb-8acb-8a3b622eaff6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7660%252F3287660%252Fexterior_front_driver-1774696758318.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7660/3287660/exterior_front_driver-1774696758318.jpg saved to cache
2026-03-29 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31950006-3595-5fbb-8acb-8a3b622eaff6
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659991890>
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_150e2786-d5e3-543d-9bf5-4b9b12cb2c97/150e2786-d5e3-543d-9bf5-4b9b12cb2c97_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5198%252F18895198%252Fexterior_rear_driver-1774710260787.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5198/18895198/exterior_rear_driver-1774710260787.jpg saved to cache
2026-03-29 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 150e2786-d5e3-543d-9bf5-4b9b12cb2c97
2026-03-29 20:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9292/20469292/exterior_front_passenger-1774716176101.jpg> (referer: None)
2026-03-29 20:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9292/20469292/exterior_rear_driver-1774710773699.jpg> (referer: None)
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1931%252F20471931%252Finterior_rear_seats-1774630592984.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1931/20471931/interior_rear_seats-1774630592984.jpg not downloaded yet
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1931%252F20471931%252Finterior_dashboard-1774630659968.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1931/20471931/interior_dashboard-1774630659968.jpg not downloaded yet
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1931%252F20471931%252Finterior_boot-1774630487208.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1931/20471931/interior_boot-1774630487208.jpg not downloaded yet
2026-03-29 20:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9292/20469292/exterior_rear_passenger-1774710799283.jpg> (referer: None)
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1931%252F20471931%252Fdocs_service_history-1774630818206.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D96c490358019d1cf6ed39ee27a22e661%27 HTTP/1.1" 200 None
2026-03-29 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1931/20471931/docs_service_history-1774630818206.jpg?ixlib=js-3.8.0&auto=format&s=96c490358019d1cf6ed39ee27a22e661 not downloaded yet
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1931%252F20471931%252Fwheels_front_driver-1774630197150.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1931/20471931/wheels_front_driver-1774630197150.jpg not downloaded yet
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6580fb810>
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3408a86-1e7c-54a6-8ccc-b4b3b566323c/f3408a86-1e7c-54a6-8ccc-b4b3b566323c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9292%252F20469292%252Fexterior_front_passenger-1774716176101.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9292/20469292/exterior_front_passenger-1774716176101.jpg saved to cache
2026-03-29 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f3408a86-1e7c-54a6-8ccc-b4b3b566323c
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6580f8c90>
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3408a86-1e7c-54a6-8ccc-b4b3b566323c/f3408a86-1e7c-54a6-8ccc-b4b3b566323c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9292%252F20469292%252Fexterior_rear_driver-1774710773699.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9292/20469292/exterior_rear_driver-1774710773699.jpg saved to cache
2026-03-29 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f3408a86-1e7c-54a6-8ccc-b4b3b566323c
2026-03-29 20:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16057618.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9292/20469292/interior_boot-1774712672554.jpg> (referer: None)
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658797a10>
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3408a86-1e7c-54a6-8ccc-b4b3b566323c/f3408a86-1e7c-54a6-8ccc-b4b3b566323c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9292%252F20469292%252Fexterior_rear_passenger-1774710799283.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9292/20469292/exterior_rear_passenger-1774710799283.jpg saved to cache
2026-03-29 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f3408a86-1e7c-54a6-8ccc-b4b3b566323c
2026-03-29 20:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9292/20469292/interior_dashboard-1774712384223.jpg> (referer: None)
2026-03-29 20:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2755/8192755/interior_rear_seats-1774693229760.jpg> (referer: None)
2026-03-29 20:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7647/20407647/interior_front_seats-1774782050364.jpg> (referer: None)
2026-03-29 20:14:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c3dedab-8c46-5bdc-8e04-c2b360ff25ec with identifier: 16057618
2026-03-29 20:14:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c3dedab-8c46-5bdc-8e04-c2b360ff25ec with scrape type 1
2026-03-29 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8c3dedab-8c46-5bdc-8e04-c2b360ff25ec
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7618%252F16057618%252Fexterior_front_driver-1774609656102.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7618/16057618/exterior_front_driver-1774609656102.jpeg not downloaded yet
2026-03-29 20:14:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a5fe10>
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3408a86-1e7c-54a6-8ccc-b4b3b566323c/f3408a86-1e7c-54a6-8ccc-b4b3b566323c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9292%252F20469292%252Finterior_boot-1774712672554.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9292/20469292/interior_boot-1774712672554.jpg saved to cache
2026-03-29 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f3408a86-1e7c-54a6-8ccc-b4b3b566323c
2026-03-29 20:14:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5198/18895198/instrument_cluster-1774708800555.jpg> (referer: None)
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7618%252F16057618%252Fexterior_rear_driver-1774609705412.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7618/16057618/exterior_rear_driver-1774609705412.jpeg not downloaded yet
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7618%252F16057618%252Fexterior_front_passenger-1774609683109.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7618/16057618/exterior_front_passenger-1774609683109.jpeg not downloaded yet
2026-03-29 20:14:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d743d0>
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3408a86-1e7c-54a6-8ccc-b4b3b566323c/f3408a86-1e7c-54a6-8ccc-b4b3b566323c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9292%252F20469292%252Finterior_dashboard-1774712384223.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9292/20469292/interior_dashboard-1774712384223.jpg saved to cache
2026-03-29 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f3408a86-1e7c-54a6-8ccc-b4b3b566323c
2026-03-29 20:14:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65881f5d0>
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2c78946-39a8-5f2a-835b-5aea64b4fb16/a2c78946-39a8-5f2a-835b-5aea64b4fb16_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2755%252F8192755%252Finterior_rear_seats-1774693229760.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2755/8192755/interior_rear_seats-1774693229760.jpg saved to cache
2026-03-29 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a2c78946-39a8-5f2a-835b-5aea64b4fb16
2026-03-29 20:14:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2c78946-39a8-5f2a-835b-5aea64b4fb16, skipping ID generation
2026-03-29 20:14:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2c78946-39a8-5f2a-835b-5aea64b4fb16 with scrape type 1
2026-03-29 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2c78946-39a8-5f2a-835b-5aea64b4fb16 sending to next pipeline
2026-03-29 20:14:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a2c78946-39a8-5f2a-835b-5aea64b4fb16, identifier: 8192755
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf43150>
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_232e8351-b6d6-5588-899f-3b450c963437/232e8351-b6d6-5588-899f-3b450c963437_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7647%252F20407647%252Finterior_front_seats-1774782050364.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7647/20407647/interior_front_seats-1774782050364.jpg saved to cache
2026-03-29 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 232e8351-b6d6-5588-899f-3b450c963437
2026-03-29 20:14:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7647/20407647/damage_scratches-1774781518566.jpg> (referer: None)
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7618%252F16057618%252Fexterior_rear_passenger-1774609700339.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7618/16057618/exterior_rear_passenger-1774609700339.jpeg not downloaded yet
2026-03-29 20:14:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a2c78946-39a8-5f2a-835b-5aea64b4fb16 with identifier: 8192755
2026-03-29 20:14:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a2c78946-39a8-5f2a-835b-5aea64b4fb16 with identifier: 8192755
2026-03-29 20:14:03 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a2c78946-39a8-5f2a-835b-5aea64b4fb16 with identifier: 8192755 to the API
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/2755/8192755/interior_rear_seats-1774693229760.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'a2c78946-39a8-5f2a-835b-5aea64b4fb16',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'RJ23 CHD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/8192755',
'listing': 'auction',
'location': 'Berkshire Crowthorne',
'make': 'BMW',
'model': 'M1',
'odometer': 16400,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2c78946-39a8-5f2a-835b-5aea64b4fb16/a2c78946-39a8-5f2a-835b-5aea64b4fb16_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2364107,
'Height': 2869,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2755/8192755/exterior_front_driver-1774692027325.jpg',
'Width': 3825},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2c78946-39a8-5f2a-835b-5aea64b4fb16/a2c78946-39a8-5f2a-835b-5aea64b4fb16_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1678813,
'Height': 2565,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2755/8192755/exterior_rear_driver-1774692042006.jpg',
'Width': 3420},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2c78946-39a8-5f2a-835b-5aea64b4fb16/a2c78946-39a8-5f2a-835b-5aea64b4fb16_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2146263,
'Height': 2855,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2755/8192755/exterior_front_passenger-1774692078581.jpg',
'Width': 3807},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2c78946-39a8-5f2a-835b-5aea64b4fb16/a2c78946-39a8-5f2a-835b-5aea64b4fb16_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2360755,
'Height': 2924,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2755/8192755/exterior_rear_passenger-1774692063216.jpg',
'Width': 3899},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2c78946-39a8-5f2a-835b-5aea64b4fb16/a2c78946-39a8-5f2a-835b-5aea64b4fb16_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2949212,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2755/8192755/interior_front_seats-1774693377379.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2c78946-39a8-5f2a-835b-5aea64b4fb16/a2c78946-39a8-5f2a-835b-5aea64b4fb16_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3514020,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2755/8192755/interior_rear_seats-1774693229760.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2c78946-39a8-5f2a-835b-5aea64b4fb16/a2c78946-39a8-5f2a-835b-5aea64b4fb16_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1602810,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2755/8192755/interior_dashboard-1774693270565.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2c78946-39a8-5f2a-835b-5aea64b4fb16/a2c78946-39a8-5f2a-835b-5aea64b4fb16_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1447973,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2755/8192755/instrument_cluster-1774693490594.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2c78946-39a8-5f2a-835b-5aea64b4fb16/a2c78946-39a8-5f2a-835b-5aea64b4fb16_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3763710,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2755/8192755/interior_boot-1774693282057.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2c78946-39a8-5f2a-835b-5aea64b4fb16/a2c78946-39a8-5f2a-835b-5aea64b4fb16_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 673027,
'Height': 2780,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2755/8192755/docs_service_history-1774693674683.jpg?ixlib=js-3.8.0&auto=format&s=35f9fc8fe94df0e3dbce6d4d1f862200',
'Width': 2009}],
'price': 26921,
'price_includes_vat': False,
'registration_date': '2023-07-26',
'seats_number': None,
'seller_name': None,
'title': 'BMW M135i xDrive Auto',
'transmission': 'automatic',
'trim': '35i xDrive Auto',
'vin': 'WBA7L120507M83806',
'year': 2023}
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278192755%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [motorway.uk] INFO: Saving data for 8192755: {'created_time': 1774815243.319036, 'last_price_update_time': 1774815243.319046, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='8192755') HTTP/1.1" 204 0
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7618%252F16057618%252Finterior_front_seats-1774609769291.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7618/16057618/interior_front_seats-1774609769291.jpeg not downloaded yet
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7618%252F16057618%252Finterior_rear_seats-1774609824667.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7618/16057618/interior_rear_seats-1774609824667.jpeg not downloaded yet
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a264d0>
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_150e2786-d5e3-543d-9bf5-4b9b12cb2c97/150e2786-d5e3-543d-9bf5-4b9b12cb2c97_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5198%252F18895198%252Finstrument_cluster-1774708800555.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5198/18895198/instrument_cluster-1774708800555.jpg saved to cache
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 150e2786-d5e3-543d-9bf5-4b9b12cb2c97
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582d5590>
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_232e8351-b6d6-5588-899f-3b450c963437/232e8351-b6d6-5588-899f-3b450c963437_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7647%252F20407647%252Fdamage_scratches-1774781518566.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7647/20407647/damage_scratches-1774781518566.jpg saved to cache
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 232e8351-b6d6-5588-899f-3b450c963437
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7618%252F16057618%252Finterior_dashboard-1774609858256.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7618/16057618/interior_dashboard-1774609858256.jpeg not downloaded yet
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7618%252F16057618%252Finterior_boot-1774609893580.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7618/16057618/interior_boot-1774609893580.jpeg not downloaded yet
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7618%252F16057618%252F16057618-docs_service_history-modified-1774611626274.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd1ff1db88bc4f161a1c0f6471e76396f%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7618/16057618/16057618-docs_service_history-modified-1774611626274.jpeg?ixlib=js-3.8.0&auto=format&s=d1ff1db88bc4f161a1c0f6471e76396f not downloaded yet
2026-03-29 20:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9292/20469292/interior_rear_seats-1774712336257.jpg> (referer: None)
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7618%252F16057618%252F16057618-damage_windscreen-modified-1774611720427.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7618/16057618/16057618-damage_windscreen-modified-1774611720427.jpeg not downloaded yet
2026-03-29 20:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9292/20469292/interior_front_seats-1774712315880.jpg> (referer: None)
2026-03-29 20:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1931/20471931/exterior_rear_passenger-1774630079642.jpg> (referer: None)
2026-03-29 20:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1931/20471931/wheels_front_driver-1774630197150.jpg> (referer: None)
2026-03-29 20:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1931/20471931/exterior_front_passenger-1774630024654.jpg> (referer: None)
2026-03-29 20:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1931/20471931/interior_rear_seats-1774630592984.jpg> (referer: None)
2026-03-29 20:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1931/20471931/docs_service_history-1774630818206.jpg?ixlib=js-3.8.0&auto=format&s=96c490358019d1cf6ed39ee27a22e661> (referer: None)
2026-03-29 20:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1931/20471931/interior_front_seats-1774630483760.jpg> (referer: None)
2026-03-29 20:14:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a42910>
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3408a86-1e7c-54a6-8ccc-b4b3b566323c/f3408a86-1e7c-54a6-8ccc-b4b3b566323c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9292%252F20469292%252Finterior_rear_seats-1774712336257.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9292/20469292/interior_rear_seats-1774712336257.jpg saved to cache
2026-03-29 20:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f3408a86-1e7c-54a6-8ccc-b4b3b566323c
2026-03-29 20:14:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65846e750>
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f3408a86-1e7c-54a6-8ccc-b4b3b566323c/f3408a86-1e7c-54a6-8ccc-b4b3b566323c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9292%252F20469292%252Finterior_front_seats-1774712315880.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9292/20469292/interior_front_seats-1774712315880.jpg saved to cache
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f3408a86-1e7c-54a6-8ccc-b4b3b566323c
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587bab50>
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36715a92-cdbf-5362-b517-d479cadc8f08/36715a92-cdbf-5362-b517-d479cadc8f08_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1931%252F20471931%252Fexterior_rear_passenger-1774630079642.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1931/20471931/exterior_rear_passenger-1774630079642.jpg saved to cache
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36715a92-cdbf-5362-b517-d479cadc8f08
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659beb610>
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36715a92-cdbf-5362-b517-d479cadc8f08/36715a92-cdbf-5362-b517-d479cadc8f08_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1931%252F20471931%252Fwheels_front_driver-1774630197150.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1931/20471931/wheels_front_driver-1774630197150.jpg saved to cache
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 36715a92-cdbf-5362-b517-d479cadc8f08
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659beab50>
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36715a92-cdbf-5362-b517-d479cadc8f08/36715a92-cdbf-5362-b517-d479cadc8f08_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1931%252F20471931%252Fexterior_front_passenger-1774630024654.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1931/20471931/exterior_front_passenger-1774630024654.jpg saved to cache
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36715a92-cdbf-5362-b517-d479cadc8f08
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589eb090>
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36715a92-cdbf-5362-b517-d479cadc8f08/36715a92-cdbf-5362-b517-d479cadc8f08_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1931%252F20471931%252Finterior_rear_seats-1774630592984.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1931/20471931/interior_rear_seats-1774630592984.jpg saved to cache
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 36715a92-cdbf-5362-b517-d479cadc8f08
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ec7990>
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36715a92-cdbf-5362-b517-d479cadc8f08/36715a92-cdbf-5362-b517-d479cadc8f08_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1931%252F20471931%252Fdocs_service_history-1774630818206.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D96c490358019d1cf6ed39ee27a22e661') HTTP/1.1" 204 0
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1931/20471931/docs_service_history-1774630818206.jpg?ixlib=js-3.8.0&auto=format&s=96c490358019d1cf6ed39ee27a22e661 saved to cache
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 36715a92-cdbf-5362-b517-d479cadc8f08
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589e9150>
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36715a92-cdbf-5362-b517-d479cadc8f08/36715a92-cdbf-5362-b517-d479cadc8f08_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1931%252F20471931%252Finterior_front_seats-1774630483760.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1931/20471931/interior_front_seats-1774630483760.jpg saved to cache
2026-03-29 20:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36715a92-cdbf-5362-b517-d479cadc8f08
2026-03-29 20:14:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=684&page=19&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7618/16057618/exterior_front_driver-1774609656102.jpeg> (referer: None)
2026-03-29 20:14:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7618/16057618/exterior_rear_driver-1774609705412.jpeg> (referer: None)
2026-03-29 20:14:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7618/16057618/exterior_front_passenger-1774609683109.jpeg> (referer: None)
2026-03-29 20:14:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7618/16057618/exterior_rear_passenger-1774609700339.jpeg> (referer: None)
2026-03-29 20:14:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1931/20471931/interior_boot-1774630487208.jpg> (referer: None)
2026-03-29 20:14:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7618/16057618/interior_front_seats-1774609769291.jpeg> (referer: None)
2026-03-29 20:14:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7618/16057618/interior_boot-1774609893580.jpeg> (referer: None)
2026-03-29 20:14:04 [motorway.uk] INFO: Found listing with ID: 19564729
2026-03-29 20:14:04 [motorway.uk] INFO: Found listing with ID: 6226570
2026-03-29 20:14:04 [motorway.uk] INFO: Found listing with ID: 16486995
2026-03-29 20:14:04 [motorway.uk] INFO: Found listing with ID: 20460973
2026-03-29 20:14:04 [motorway.uk] INFO: Found listing with ID: 20487463
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487463%27 HTTP/1.1" 200 None
2026-03-29 20:14:04 [motorway.uk] INFO: Scrape type for 20487463: 1
2026-03-29 20:14:04 [motorway.uk] INFO: Found listing with ID: 20111851
2026-03-29 20:14:04 [motorway.uk] INFO: Found listing with ID: 20098217
2026-03-29 20:14:04 [motorway.uk] INFO: Found listing with ID: 19569480
2026-03-29 20:14:04 [motorway.uk] INFO: Found listing with ID: 20468681
2026-03-29 20:14:04 [motorway.uk] INFO: Found listing with ID: 14866645
2026-03-29 20:14:04 [motorway.uk] INFO: Found listing with ID: 13203122
2026-03-29 20:14:04 [motorway.uk] INFO: Found listing with ID: 15371876
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715371876%27 HTTP/1.1" 200 None
2026-03-29 20:14:04 [motorway.uk] INFO: Scrape type for 15371876: 1
2026-03-29 20:14:04 [motorway.uk] INFO: Found listing with ID: 17858829
2026-03-29 20:14:04 [motorway.uk] INFO: Found listing with ID: 8664899
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278664899%27 HTTP/1.1" 200 None
2026-03-29 20:14:04 [motorway.uk] INFO: Scrape type for 8664899: 1
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589e8150>
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c3dedab-8c46-5bdc-8e04-c2b360ff25ec/8c3dedab-8c46-5bdc-8e04-c2b360ff25ec_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7618%252F16057618%252Fexterior_front_driver-1774609656102.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7618/16057618/exterior_front_driver-1774609656102.jpeg saved to cache
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c3dedab-8c46-5bdc-8e04-c2b360ff25ec
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ca2f90>
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c3dedab-8c46-5bdc-8e04-c2b360ff25ec/8c3dedab-8c46-5bdc-8e04-c2b360ff25ec_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7618%252F16057618%252Fexterior_rear_driver-1774609705412.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7618/16057618/exterior_rear_driver-1774609705412.jpeg saved to cache
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c3dedab-8c46-5bdc-8e04-c2b360ff25ec
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 14729168
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 13365584
2026-03-29 20:14:05 [motorway.uk] INFO: Found listing with ID: 19518797
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719518797%27 HTTP/1.1" 200 None
2026-03-29 20:14:05 [motorway.uk] INFO: Scrape type for 19518797: 1
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658315c10>
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c3dedab-8c46-5bdc-8e04-c2b360ff25ec/8c3dedab-8c46-5bdc-8e04-c2b360ff25ec_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7618%252F16057618%252Fexterior_front_passenger-1774609683109.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7618/16057618/exterior_front_passenger-1774609683109.jpeg saved to cache
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c3dedab-8c46-5bdc-8e04-c2b360ff25ec
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c961d0>
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c3dedab-8c46-5bdc-8e04-c2b360ff25ec/8c3dedab-8c46-5bdc-8e04-c2b360ff25ec_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7618%252F16057618%252Fexterior_rear_passenger-1774609700339.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7618/16057618/exterior_rear_passenger-1774609700339.jpeg saved to cache
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c3dedab-8c46-5bdc-8e04-c2b360ff25ec
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c94e50>
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36715a92-cdbf-5362-b517-d479cadc8f08/36715a92-cdbf-5362-b517-d479cadc8f08_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1931%252F20471931%252Finterior_boot-1774630487208.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1931/20471931/interior_boot-1774630487208.jpg saved to cache
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 36715a92-cdbf-5362-b517-d479cadc8f08
2026-03-29 20:14:05 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:14:05 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:14:05 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00+\xf6\x9f\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x89$\x00+\xec\xad\x00\x00\x00\x00'
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586cded0>
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c3dedab-8c46-5bdc-8e04-c2b360ff25ec/8c3dedab-8c46-5bdc-8e04-c2b360ff25ec_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7618%252F16057618%252Finterior_front_seats-1774609769291.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7618/16057618/interior_front_seats-1774609769291.jpeg saved to cache
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c3dedab-8c46-5bdc-8e04-c2b360ff25ec
2026-03-29 20:14:05 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:14:05 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:14:05 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00;kq\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xae2\x00;a\x7f\x00\x00\x00\x00'
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf51850>
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c3dedab-8c46-5bdc-8e04-c2b360ff25ec/8c3dedab-8c46-5bdc-8e04-c2b360ff25ec_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7618%252F16057618%252Finterior_boot-1774609893580.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7618/16057618/interior_boot-1774609893580.jpeg saved to cache
2026-03-29 20:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8c3dedab-8c46-5bdc-8e04-c2b360ff25ec
2026-03-29 20:14:06 [scrapy.extensions.logstats] INFO: Crawled 164 pages (at 45 pages/min), scraped 76 items (at 23 items/min)
2026-03-29 20:14:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 258MiB
2026-03-29 20:14:06 [motorway.uk] INFO: Found listing with ID: 19781742
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719781742%27 HTTP/1.1" 200 None
2026-03-29 20:14:06 [motorway.uk] INFO: Scrape type for 19781742: 1
2026-03-29 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7618/16057618/16057618-damage_windscreen-modified-1774611720427.jpeg> (referer: None)
2026-03-29 20:14:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:06 [motorway.uk] INFO: Found listing with ID: 18114762
2026-03-29 20:14:06 [motorway.uk] INFO: Found listing with ID: 20484591
2026-03-29 20:14:06 [motorway.uk] INFO: Found listing with ID: 4393703
2026-03-29 20:14:06 [motorway.uk] INFO: Found listing with ID: 19625865
2026-03-29 20:14:06 [motorway.uk] INFO: Found listing with ID: 20021655
2026-03-29 20:14:06 [motorway.uk] INFO: Found listing with ID: 4895685
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%274895685%27 HTTP/1.1" 200 None
2026-03-29 20:14:06 [motorway.uk] INFO: Scrape type for 4895685: 1
2026-03-29 20:14:06 [motorway.uk] INFO: Found listing with ID: 20426345
2026-03-29 20:14:06 [motorway.uk] INFO: Found listing with ID: 15364589
2026-03-29 20:14:06 [motorway.uk] INFO: Found listing with ID: 20450018
2026-03-29 20:14:06 [motorway.uk] INFO: Found listing with ID: 17809359
2026-03-29 20:14:06 [motorway.uk] INFO: Found listing with ID: 20487947
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487947%27 HTTP/1.1" 200 None
2026-03-29 20:14:06 [motorway.uk] INFO: Scrape type for 20487947: 1
2026-03-29 20:14:06 [motorway.uk] INFO: Found listing with ID: 20346112
2026-03-29 20:14:06 [motorway.uk] INFO: Found listing with ID: 15189137
2026-03-29 20:14:06 [motorway.uk] INFO: Found listing with ID: 20366507
2026-03-29 20:14:06 [motorway.uk] INFO: Found listing with ID: 13105341
2026-03-29 20:14:06 [motorway.uk] INFO: Found listing with ID: 19925177
2026-03-29 20:14:06 [motorway.uk] INFO: Found listing with ID: 19729177
2026-03-29 20:14:06 [motorway.uk] INFO: Found listing with ID: 20387159
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720387159%27 HTTP/1.1" 200 None
2026-03-29 20:14:06 [motorway.uk] INFO: Scrape type for 20387159: 1
2026-03-29 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1931/20471931/exterior_rear_driver-1774630986714.jpg> (referer: None)
2026-03-29 20:14:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7647/20407647/damage_scratches-1774781478427.jpg> (referer: None)
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586cc810>
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c3dedab-8c46-5bdc-8e04-c2b360ff25ec/8c3dedab-8c46-5bdc-8e04-c2b360ff25ec_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7618%252F16057618%252F16057618-damage_windscreen-modified-1774611720427.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7618/16057618/16057618-damage_windscreen-modified-1774611720427.jpeg saved to cache
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8c3dedab-8c46-5bdc-8e04-c2b360ff25ec
2026-03-29 20:14:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7647/20407647/interior_boot-1774782911986.jpg> (referer: None)
2026-03-29 20:14:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1931/20471931/exterior_front_driver-1774630056494.jpg> (referer: None)
2026-03-29 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7647/20407647/interior_dashboard-1774782899418.jpg> (referer: None)
2026-03-29 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1931/20471931/interior_dashboard-1774630659968.jpg> (referer: None)
2026-03-29 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/7618/16057618/16057618-docs_service_history-modified-1774611626274.jpeg?ixlib=js-3.8.0&auto=format&s=d1ff1db88bc4f161a1c0f6471e76396f> (referer: None)
2026-03-29 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7618/16057618/interior_rear_seats-1774609824667.jpeg> (referer: None)
2026-03-29 20:14:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7618/16057618/interior_dashboard-1774609858256.jpeg> (referer: None)
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a78d90>
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36715a92-cdbf-5362-b517-d479cadc8f08/36715a92-cdbf-5362-b517-d479cadc8f08_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1931%252F20471931%252Fexterior_rear_driver-1774630986714.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1931/20471931/exterior_rear_driver-1774630986714.jpg saved to cache
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36715a92-cdbf-5362-b517-d479cadc8f08
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584c8c50>
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_232e8351-b6d6-5588-899f-3b450c963437/232e8351-b6d6-5588-899f-3b450c963437_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7647%252F20407647%252Fdamage_scratches-1774781478427.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7647/20407647/damage_scratches-1774781478427.jpg saved to cache
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 232e8351-b6d6-5588-899f-3b450c963437
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658524c90>
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_232e8351-b6d6-5588-899f-3b450c963437/232e8351-b6d6-5588-899f-3b450c963437_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7647%252F20407647%252Finterior_boot-1774782911986.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7647/20407647/interior_boot-1774782911986.jpg saved to cache
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 232e8351-b6d6-5588-899f-3b450c963437
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ce26d0>
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36715a92-cdbf-5362-b517-d479cadc8f08/36715a92-cdbf-5362-b517-d479cadc8f08_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1931%252F20471931%252Fexterior_front_driver-1774630056494.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1931/20471931/exterior_front_driver-1774630056494.jpg saved to cache
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36715a92-cdbf-5362-b517-d479cadc8f08
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a48a10>
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_232e8351-b6d6-5588-899f-3b450c963437/232e8351-b6d6-5588-899f-3b450c963437_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7647%252F20407647%252Finterior_dashboard-1774782899418.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7647/20407647/interior_dashboard-1774782899418.jpg saved to cache
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 232e8351-b6d6-5588-899f-3b450c963437
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ce1890>
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36715a92-cdbf-5362-b517-d479cadc8f08/36715a92-cdbf-5362-b517-d479cadc8f08_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1931%252F20471931%252Finterior_dashboard-1774630659968.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1931/20471931/interior_dashboard-1774630659968.jpg saved to cache
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 36715a92-cdbf-5362-b517-d479cadc8f08
2026-03-29 20:14:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36715a92-cdbf-5362-b517-d479cadc8f08, skipping ID generation
2026-03-29 20:14:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36715a92-cdbf-5362-b517-d479cadc8f08 with scrape type 1
2026-03-29 20:14:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36715a92-cdbf-5362-b517-d479cadc8f08 sending to next pipeline
2026-03-29 20:14:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 36715a92-cdbf-5362-b517-d479cadc8f08, identifier: 20471931
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c94ad0>
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c3dedab-8c46-5bdc-8e04-c2b360ff25ec/8c3dedab-8c46-5bdc-8e04-c2b360ff25ec_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7618%252F16057618%252F16057618-docs_service_history-modified-1774611626274.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd1ff1db88bc4f161a1c0f6471e76396f') HTTP/1.1" 204 0
2026-03-29 20:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7618/16057618/16057618-docs_service_history-modified-1774611626274.jpeg?ixlib=js-3.8.0&auto=format&s=d1ff1db88bc4f161a1c0f6471e76396f saved to cache
2026-03-29 20:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8c3dedab-8c46-5bdc-8e04-c2b360ff25ec
2026-03-29 20:14:07 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:14:07 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:14:07 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00*\x9fl\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\xd9\xce\x00*\x95z\x00\x00\x00\x00'
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf52a90>
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c3dedab-8c46-5bdc-8e04-c2b360ff25ec/8c3dedab-8c46-5bdc-8e04-c2b360ff25ec_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7618%252F16057618%252Finterior_rear_seats-1774609824667.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7618/16057618/interior_rear_seats-1774609824667.jpeg saved to cache
2026-03-29 20:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c3dedab-8c46-5bdc-8e04-c2b360ff25ec
2026-03-29 20:14:07 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:14:07 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:14:07 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00+\x8e\xd5\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03Y\xae\x00+\x84\xe3\x00\x00\x00\x00'
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582d82d0>
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c3dedab-8c46-5bdc-8e04-c2b360ff25ec/8c3dedab-8c46-5bdc-8e04-c2b360ff25ec_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7618%252F16057618%252Finterior_dashboard-1774609858256.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7618/16057618/interior_dashboard-1774609858256.jpeg saved to cache
2026-03-29 20:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8c3dedab-8c46-5bdc-8e04-c2b360ff25ec
2026-03-29 20:14:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c3dedab-8c46-5bdc-8e04-c2b360ff25ec, skipping ID generation
2026-03-29 20:14:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c3dedab-8c46-5bdc-8e04-c2b360ff25ec with scrape type 1
2026-03-29 20:14:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c3dedab-8c46-5bdc-8e04-c2b360ff25ec sending to next pipeline
2026-03-29 20:14:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8c3dedab-8c46-5bdc-8e04-c2b360ff25ec, identifier: 16057618
2026-03-29 20:14:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 36715a92-cdbf-5362-b517-d479cadc8f08 with identifier: 20471931
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Yellow HTTP/1.1" 200 None
2026-03-29 20:14:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:14:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 36715a92-cdbf-5362-b517-d479cadc8f08 with identifier: 20471931
2026-03-29 20:14:07 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 36715a92-cdbf-5362-b517-d479cadc8f08 with identifier: 20471931 to the API
2026-03-29 20:14:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1931/20471931/interior_dashboard-1774630659968.jpg>
{'auction_title': '',
'category': None,
'color': 'Yellow',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '36715a92-cdbf-5362-b517-d479cadc8f08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PJ73 XAW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20471931',
'listing': 'auction',
'location': 'South Yorkshire Doncaster',
'make': 'Kia',
'model': 'Sportage',
'odometer': 15000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36715a92-cdbf-5362-b517-d479cadc8f08/36715a92-cdbf-5362-b517-d479cadc8f08_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1730884,
'Height': 2630,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1931/20471931/exterior_front_driver-1774630056494.jpg',
'Width': 3506},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36715a92-cdbf-5362-b517-d479cadc8f08/36715a92-cdbf-5362-b517-d479cadc8f08_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1016750,
'Height': 2648,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1931/20471931/exterior_rear_driver-1774630986714.jpg',
'Width': 3531},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36715a92-cdbf-5362-b517-d479cadc8f08/36715a92-cdbf-5362-b517-d479cadc8f08_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2145904,
'Height': 2842,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1931/20471931/exterior_front_passenger-1774630024654.jpg',
'Width': 3789},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36715a92-cdbf-5362-b517-d479cadc8f08/36715a92-cdbf-5362-b517-d479cadc8f08_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1620674,
'Height': 2567,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1931/20471931/exterior_rear_passenger-1774630079642.jpg',
'Width': 3423},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36715a92-cdbf-5362-b517-d479cadc8f08/36715a92-cdbf-5362-b517-d479cadc8f08_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2035174,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1931/20471931/interior_front_seats-1774630483760.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36715a92-cdbf-5362-b517-d479cadc8f08/36715a92-cdbf-5362-b517-d479cadc8f08_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2046003,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1931/20471931/interior_rear_seats-1774630592984.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36715a92-cdbf-5362-b517-d479cadc8f08/36715a92-cdbf-5362-b517-d479cadc8f08_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1765686,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1931/20471931/interior_dashboard-1774630659968.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36715a92-cdbf-5362-b517-d479cadc8f08/36715a92-cdbf-5362-b517-d479cadc8f08_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2673395,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1931/20471931/interior_boot-1774630487208.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36715a92-cdbf-5362-b517-d479cadc8f08/36715a92-cdbf-5362-b517-d479cadc8f08_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1659689,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1931/20471931/docs_service_history-1774630818206.jpg?ixlib=js-3.8.0&auto=format&s=96c490358019d1cf6ed39ee27a22e661',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36715a92-cdbf-5362-b517-d479cadc8f08/36715a92-cdbf-5362-b517-d479cadc8f08_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1438598,
'Height': 2665,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1931/20471931/wheels_front_driver-1774630197150.jpg',
'Width': 3553}],
'price': 22225,
'price_includes_vat': False,
'registration_date': '2023-09-30',
'seats_number': None,
'seller_name': None,
'title': 'Kia Sportage 3 PHEV 4X4 Auto',
'transmission': 'automatic',
'trim': '3 PHEV 4X4 Auto',
'vin': 'U5YPV81HSPL118117',
'year': 2023}
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720471931%27 HTTP/1.1" 200 None
2026-03-29 20:14:08 [motorway.uk] INFO: Saving data for 20471931: {'created_time': 1774815248.326075, 'last_price_update_time': 1774815248.326084, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20471931') HTTP/1.1" 204 0
2026-03-29 20:14:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8c3dedab-8c46-5bdc-8e04-c2b360ff25ec with identifier: 16057618
2026-03-29 20:14:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8c3dedab-8c46-5bdc-8e04-c2b360ff25ec with identifier: 16057618
2026-03-29 20:14:08 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8c3dedab-8c46-5bdc-8e04-c2b360ff25ec with identifier: 16057618 to the API
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7618/16057618/interior_dashboard-1774609858256.jpeg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '8c3dedab-8c46-5bdc-8e04-c2b360ff25ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'KE72 BBO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/16057618',
'listing': 'auction',
'location': 'Cambridgeshire Cambridge',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 26800,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c3dedab-8c46-5bdc-8e04-c2b360ff25ec/8c3dedab-8c46-5bdc-8e04-c2b360ff25ec_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1709333,
'Height': 2507,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7618/16057618/exterior_front_driver-1774609656102.jpeg',
'Width': 3343},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c3dedab-8c46-5bdc-8e04-c2b360ff25ec/8c3dedab-8c46-5bdc-8e04-c2b360ff25ec_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1556641,
'Height': 2447,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7618/16057618/exterior_rear_driver-1774609705412.jpeg',
'Width': 3263},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c3dedab-8c46-5bdc-8e04-c2b360ff25ec/8c3dedab-8c46-5bdc-8e04-c2b360ff25ec_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1821426,
'Height': 2550,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7618/16057618/exterior_front_passenger-1774609683109.jpeg',
'Width': 3400},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c3dedab-8c46-5bdc-8e04-c2b360ff25ec/8c3dedab-8c46-5bdc-8e04-c2b360ff25ec_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2073858,
'Height': 2696,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7618/16057618/exterior_rear_passenger-1774609700339.jpeg',
'Width': 3595},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c3dedab-8c46-5bdc-8e04-c2b360ff25ec/8c3dedab-8c46-5bdc-8e04-c2b360ff25ec_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3047363,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7618/16057618/interior_front_seats-1774609769291.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c3dedab-8c46-5bdc-8e04-c2b360ff25ec/8c3dedab-8c46-5bdc-8e04-c2b360ff25ec_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2849082,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7618/16057618/interior_rear_seats-1774609824667.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c3dedab-8c46-5bdc-8e04-c2b360ff25ec/8c3dedab-8c46-5bdc-8e04-c2b360ff25ec_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3074179,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7618/16057618/interior_dashboard-1774609858256.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c3dedab-8c46-5bdc-8e04-c2b360ff25ec/8c3dedab-8c46-5bdc-8e04-c2b360ff25ec_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4069795,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7618/16057618/interior_boot-1774609893580.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c3dedab-8c46-5bdc-8e04-c2b360ff25ec/8c3dedab-8c46-5bdc-8e04-c2b360ff25ec_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1926695,
'Height': 2691,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/7618/16057618/16057618-docs_service_history-modified-1774611626274.jpeg?ixlib=js-3.8.0&auto=format&s=d1ff1db88bc4f161a1c0f6471e76396f',
'Width': 3588},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c3dedab-8c46-5bdc-8e04-c2b360ff25ec/8c3dedab-8c46-5bdc-8e04-c2b360ff25ec_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217479,
'Height': 869,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7618/16057618/16057618-damage_windscreen-modified-1774611720427.jpeg',
'Width': 1159}],
'price': 20450,
'price_includes_vat': False,
'registration_date': '2023-02-22',
'seats_number': None,
'seller_name': None,
'title': 'Hyundai Tucson N Line T-GDi MHEV S-A',
'transmission': 'automatic',
'trim': 'N Line T-GDi MHEV S-A',
'vin': 'TMAJA81BVNJ297098',
'year': 2023}
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716057618%27 HTTP/1.1" 200 None
2026-03-29 20:14:08 [motorway.uk] INFO: Saving data for 16057618: {'created_time': 1774815248.808733, 'last_price_update_time': 1774815248.808746, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='16057618') HTTP/1.1" 204 0
2026-03-29 20:14:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5198/18895198/wheels_front_driver-1774708486540.jpg> (referer: None)
2026-03-29 20:14:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7647/20407647/interior_rear_seats-1774781843725.jpg> (referer: None)
2026-03-29 20:14:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658433f90>
2026-03-29 20:14:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_150e2786-d5e3-543d-9bf5-4b9b12cb2c97/150e2786-d5e3-543d-9bf5-4b9b12cb2c97_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5198%252F18895198%252Fwheels_front_driver-1774708486540.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5198/18895198/wheels_front_driver-1774708486540.jpg saved to cache
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 150e2786-d5e3-543d-9bf5-4b9b12cb2c97
2026-03-29 20:14:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6580fbad0>
2026-03-29 20:14:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_232e8351-b6d6-5588-899f-3b450c963437/232e8351-b6d6-5588-899f-3b450c963437_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7647%252F20407647%252Finterior_rear_seats-1774781843725.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7647/20407647/interior_rear_seats-1774781843725.jpg saved to cache
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 232e8351-b6d6-5588-899f-3b450c963437
2026-03-29 20:14:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19518797.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7647/20407647/exterior_front_passenger-1774781354661.jpg> (referer: None)
2026-03-29 20:14:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5198/18895198/interior_boot-1774710304966.jpg> (referer: None)
2026-03-29 20:14:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7660/3287660/docs_service_history-1774704080088.jpg?ixlib=js-3.8.0&auto=format&s=9c79a92b0601fab9d34c05d78e11d549> (referer: None)
2026-03-29 20:14:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7647/20407647/exterior_rear_driver-1774783086976.jpg> (referer: None)
2026-03-29 20:14:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5198/18895198/interior_dashboard-1774710291537.jpg> (referer: None)
2026-03-29 20:14:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3db80a95-5e81-59d2-a41b-efd233fd7ecc with identifier: 19518797
2026-03-29 20:14:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3db80a95-5e81-59d2-a41b-efd233fd7ecc with scrape type 1
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3db80a95-5e81-59d2-a41b-efd233fd7ecc
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8797%252F19518797%252Fexterior_front_driver-1774094931873.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8797/19518797/exterior_front_driver-1774094931873.jpg not downloaded yet
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8797%252F19518797%252Fexterior_rear_driver-1774094954578.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8797/19518797/exterior_rear_driver-1774094954578.jpg not downloaded yet
2026-03-29 20:14:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7647/20407647/exterior_front_driver-1774781359890.jpg> (referer: None)
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8797%252F19518797%252Fexterior_front_passenger-1774095231739.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8797/19518797/exterior_front_passenger-1774095231739.jpg not downloaded yet
2026-03-29 20:14:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20487463.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a40890>
2026-03-29 20:14:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_232e8351-b6d6-5588-899f-3b450c963437/232e8351-b6d6-5588-899f-3b450c963437_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7647%252F20407647%252Fexterior_front_passenger-1774781354661.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7647/20407647/exterior_front_passenger-1774781354661.jpg saved to cache
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 232e8351-b6d6-5588-899f-3b450c963437
2026-03-29 20:14:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a78310>
2026-03-29 20:14:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_150e2786-d5e3-543d-9bf5-4b9b12cb2c97/150e2786-d5e3-543d-9bf5-4b9b12cb2c97_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5198%252F18895198%252Finterior_boot-1774710304966.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5198/18895198/interior_boot-1774710304966.jpg saved to cache
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 150e2786-d5e3-543d-9bf5-4b9b12cb2c97
2026-03-29 20:14:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599a6090>
2026-03-29 20:14:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31950006-3595-5fbb-8acb-8a3b622eaff6/31950006-3595-5fbb-8acb-8a3b622eaff6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7660%252F3287660%252Fdocs_service_history-1774704080088.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9c79a92b0601fab9d34c05d78e11d549') HTTP/1.1" 204 0
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7660/3287660/docs_service_history-1774704080088.jpg?ixlib=js-3.8.0&auto=format&s=9c79a92b0601fab9d34c05d78e11d549 saved to cache
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 31950006-3595-5fbb-8acb-8a3b622eaff6
2026-03-29 20:14:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ca3810>
2026-03-29 20:14:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_232e8351-b6d6-5588-899f-3b450c963437/232e8351-b6d6-5588-899f-3b450c963437_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7647%252F20407647%252Fexterior_rear_driver-1774783086976.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7647/20407647/exterior_rear_driver-1774783086976.jpg saved to cache
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 232e8351-b6d6-5588-899f-3b450c963437
2026-03-29 20:14:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8797%252F19518797%252Fexterior_rear_passenger-1774095228299.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8797/19518797/exterior_rear_passenger-1774095228299.jpg not downloaded yet
2026-03-29 20:14:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658524c10>
2026-03-29 20:14:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_150e2786-d5e3-543d-9bf5-4b9b12cb2c97/150e2786-d5e3-543d-9bf5-4b9b12cb2c97_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5198%252F18895198%252Finterior_dashboard-1774710291537.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5198/18895198/interior_dashboard-1774710291537.jpg saved to cache
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 150e2786-d5e3-543d-9bf5-4b9b12cb2c97
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8797%252F19518797%252Finterior_front_seats-1774096842267.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8797/19518797/interior_front_seats-1774096842267.jpg not downloaded yet
2026-03-29 20:14:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ae0450>
2026-03-29 20:14:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_232e8351-b6d6-5588-899f-3b450c963437/232e8351-b6d6-5588-899f-3b450c963437_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7647%252F20407647%252Fexterior_front_driver-1774781359890.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7647/20407647/exterior_front_driver-1774781359890.jpg saved to cache
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 232e8351-b6d6-5588-899f-3b450c963437
2026-03-29 20:14:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f244a0d-a0e1-5fcd-8823-21579403745a with identifier: 20487463
2026-03-29 20:14:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f244a0d-a0e1-5fcd-8823-21579403745a with scrape type 1
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8f244a0d-a0e1-5fcd-8823-21579403745a
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7463%252F20487463%252Fexterior_front_driver-1774710979544.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7463/20487463/exterior_front_driver-1774710979544.jpg not downloaded yet
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8797%252F19518797%252Finterior_rear_seats-1774096842978.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8797/19518797/interior_rear_seats-1774096842978.jpg not downloaded yet
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7463%252F20487463%252Fexterior_rear_driver-1774711019863.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7463/20487463/exterior_rear_driver-1774711019863.jpg not downloaded yet
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8797%252F19518797%252Finterior_dashboard-1774779095827.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8797/19518797/interior_dashboard-1774779095827.jpg not downloaded yet
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7463%252F20487463%252Fexterior_front_passenger-1774711060490.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7463/20487463/exterior_front_passenger-1774711060490.jpg not downloaded yet
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8797%252F19518797%252Finterior_boot-1774096844831.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8797/19518797/interior_boot-1774096844831.jpg not downloaded yet
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7463%252F20487463%252Fexterior_rear_passenger-1774711043281.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7463/20487463/exterior_rear_passenger-1774711043281.jpg not downloaded yet
2026-03-29 20:14:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7647/20407647/exterior_rear_passenger-1774783098141.jpg> (referer: None)
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8797%252F19518797%252Fdocs_service_history-1774097400962.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db06a64affb1e524b994d0ba3a294b56e%27 HTTP/1.1" 200 None
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8797/19518797/docs_service_history-1774097400962.jpg?ixlib=js-3.8.0&auto=format&s=b06a64affb1e524b994d0ba3a294b56e not downloaded yet
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7463%252F20487463%252Finterior_front_seats-1774712786197.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7463/20487463/interior_front_seats-1774712786197.jpg not downloaded yet
2026-03-29 20:14:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=720&page=20&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8797%252F19518797%252Fdocs_service_history-1774097407956.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D95388cf9771d4b0b70357199a14c74bf%27 HTTP/1.1" 200 None
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8797/19518797/docs_service_history-1774097407956.jpg?ixlib=js-3.8.0&auto=format&s=95388cf9771d4b0b70357199a14c74bf not downloaded yet
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7463%252F20487463%252Finterior_rear_seats-1774712942380.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7463/20487463/interior_rear_seats-1774712942380.jpg not downloaded yet
2026-03-29 20:14:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7660/3287660/interior_boot-1774710671404.jpg> (referer: None)
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7463%252F20487463%252Finterior_dashboard-1774715139269.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7463/20487463/interior_dashboard-1774715139269.jpg not downloaded yet
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7463%252F20487463%252Finstrument_cluster-1774712868149.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7463/20487463/instrument_cluster-1774712868149.jpg not downloaded yet
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7463%252F20487463%252Finterior_boot-1774712938917.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7463/20487463/interior_boot-1774712938917.jpg not downloaded yet
2026-03-29 20:14:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599a5a10>
2026-03-29 20:14:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_232e8351-b6d6-5588-899f-3b450c963437/232e8351-b6d6-5588-899f-3b450c963437_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7647%252F20407647%252Fexterior_rear_passenger-1774783098141.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7647/20407647/exterior_rear_passenger-1774783098141.jpg saved to cache
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 232e8351-b6d6-5588-899f-3b450c963437
2026-03-29 20:14:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 232e8351-b6d6-5588-899f-3b450c963437, skipping ID generation
2026-03-29 20:14:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 232e8351-b6d6-5588-899f-3b450c963437 with scrape type 1
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 232e8351-b6d6-5588-899f-3b450c963437 sending to next pipeline
2026-03-29 20:14:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 232e8351-b6d6-5588-899f-3b450c963437, identifier: 20407647
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7463%252F20487463%252Fdamage_missing_trims-1774715432301.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7463/20487463/damage_missing_trims-1774715432301.jpg not downloaded yet
2026-03-29 20:14:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 232e8351-b6d6-5588-899f-3b450c963437 with identifier: 20407647
2026-03-29 20:14:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 232e8351-b6d6-5588-899f-3b450c963437 with identifier: 20407647
2026-03-29 20:14:10 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 232e8351-b6d6-5588-899f-3b450c963437 with identifier: 20407647 to the API
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/7647/20407647/exterior_rear_passenger-1774783098141.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '232e8351-b6d6-5588-899f-3b450c963437',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YN19 DVE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20407647',
'listing': 'auction',
'location': 'South Yorkshire Doncaster',
'make': 'Mazda',
'model': 'CX-3',
'odometer': 20505,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_232e8351-b6d6-5588-899f-3b450c963437/232e8351-b6d6-5588-899f-3b450c963437_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1006401,
'Height': 2497,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7647/20407647/exterior_front_driver-1774781359890.jpg',
'Width': 3329},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_232e8351-b6d6-5588-899f-3b450c963437/232e8351-b6d6-5588-899f-3b450c963437_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1224997,
'Height': 2516,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7647/20407647/exterior_rear_driver-1774783086976.jpg',
'Width': 3355},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_232e8351-b6d6-5588-899f-3b450c963437/232e8351-b6d6-5588-899f-3b450c963437_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1013696,
'Height': 2474,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7647/20407647/exterior_front_passenger-1774781354661.jpg',
'Width': 3298},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_232e8351-b6d6-5588-899f-3b450c963437/232e8351-b6d6-5588-899f-3b450c963437_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 826289,
'Height': 2081,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7647/20407647/exterior_rear_passenger-1774783098141.jpg',
'Width': 2775},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_232e8351-b6d6-5588-899f-3b450c963437/232e8351-b6d6-5588-899f-3b450c963437_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1179138,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/7647/20407647/interior_front_seats-1774782050364.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_232e8351-b6d6-5588-899f-3b450c963437/232e8351-b6d6-5588-899f-3b450c963437_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1137022,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/7647/20407647/interior_rear_seats-1774781843725.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_232e8351-b6d6-5588-899f-3b450c963437/232e8351-b6d6-5588-899f-3b450c963437_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1488518,
'Height': 2891,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7647/20407647/interior_dashboard-1774782899418.jpg',
'Width': 3855},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_232e8351-b6d6-5588-899f-3b450c963437/232e8351-b6d6-5588-899f-3b450c963437_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1351804,
'Height': 2891,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7647/20407647/interior_boot-1774782911986.jpg',
'Width': 3855},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_232e8351-b6d6-5588-899f-3b450c963437/232e8351-b6d6-5588-899f-3b450c963437_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1113597,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/7647/20407647/damage_scratches-1774781478427.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_232e8351-b6d6-5588-899f-3b450c963437/232e8351-b6d6-5588-899f-3b450c963437_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 705179,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/7647/20407647/damage_scratches-1774781518566.jpg',
'Width': 3840}],
'price': 11085,
'price_includes_vat': False,
'registration_date': '2019-06-26',
'seats_number': None,
'seller_name': None,
'title': 'Mazda CX-3 SE-L NAV + Auto',
'transmission': 'automatic',
'trim': 'SE-L NAV + Auto',
'vin': 'MMZDK6W7A0W315241',
'year': 2019}
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720407647%27 HTTP/1.1" 200 None
2026-03-29 20:14:11 [motorway.uk] INFO: Saving data for 20407647: {'created_time': 1774815251.066027, 'last_price_update_time': 1774815251.06604, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20407647') HTTP/1.1" 204 0
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 19584822
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 19981352
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 14405517
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 20490426
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 20420305
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 20257737
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 18590519
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718590519%27 HTTP/1.1" 200 None
2026-03-29 20:14:11 [motorway.uk] INFO: Scrape type for 18590519: 1
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfbd410>
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31950006-3595-5fbb-8acb-8a3b622eaff6/31950006-3595-5fbb-8acb-8a3b622eaff6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7660%252F3287660%252Finterior_boot-1774710671404.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7660/3287660/interior_boot-1774710671404.jpg saved to cache
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 31950006-3595-5fbb-8acb-8a3b622eaff6
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 18378231
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718378231%27 HTTP/1.1" 200 None
2026-03-29 20:14:11 [motorway.uk] INFO: Scrape type for 18378231: 1
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 20357052
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 20469592
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 19514188
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 19747758
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719747758%27 HTTP/1.1" 200 None
2026-03-29 20:14:11 [motorway.uk] INFO: Scrape type for 19747758: 1
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 15938519
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 20215486
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 20230861
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 15219874
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 20429518
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 14732982
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714732982%27 HTTP/1.1" 200 None
2026-03-29 20:14:11 [motorway.uk] INFO: Scrape type for 14732982: 1
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 7660198
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 13648117
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 17991269
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 20487024
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487024%27 HTTP/1.1" 200 None
2026-03-29 20:14:11 [motorway.uk] INFO: Scrape type for 20487024: 1
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 3181281
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273181281%27 HTTP/1.1" 200 None
2026-03-29 20:14:11 [motorway.uk] INFO: Scrape type for 3181281: 1
2026-03-29 20:14:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7660/3287660/instrument_cluster-1774702942597.jpg> (referer: None)
2026-03-29 20:14:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8797/19518797/exterior_front_driver-1774094931873.jpg> (referer: None)
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 18078915
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718078915%27 HTTP/1.1" 200 None
2026-03-29 20:14:11 [motorway.uk] INFO: Scrape type for 18078915: 1
2026-03-29 20:14:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 20470010
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 19430237
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 20422292
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 20373984
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 20471256
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 20283277
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 20363739
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 19842807
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719842807%27 HTTP/1.1" 200 None
2026-03-29 20:14:11 [motorway.uk] INFO: Scrape type for 19842807: 1
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 3792457
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 20423510
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 19452760
2026-03-29 20:14:11 [motorway.uk] INFO: Found listing with ID: 19601308
2026-03-29 20:14:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8797/19518797/exterior_front_passenger-1774095231739.jpg> (referer: None)
2026-03-29 20:14:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5198/18895198/interior_rear_seats-1774708766524.jpg> (referer: None)
2026-03-29 20:14:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5198/18895198/interior_front_seats-1774708769113.jpg> (referer: None)
2026-03-29 20:14:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7463/20487463/exterior_front_passenger-1774711060490.jpg> (referer: None)
2026-03-29 20:14:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8797/19518797/exterior_rear_driver-1774094954578.jpg> (referer: None)
2026-03-29 20:14:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7463/20487463/interior_rear_seats-1774712942380.jpg> (referer: None)
2026-03-29 20:14:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7463/20487463/interior_front_seats-1774712786197.jpg> (referer: None)
2026-03-29 20:14:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65815b0d0>
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31950006-3595-5fbb-8acb-8a3b622eaff6/31950006-3595-5fbb-8acb-8a3b622eaff6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7660%252F3287660%252Finstrument_cluster-1774702942597.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7660/3287660/instrument_cluster-1774702942597.jpg saved to cache
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 31950006-3595-5fbb-8acb-8a3b622eaff6
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c2ead0>
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3db80a95-5e81-59d2-a41b-efd233fd7ecc/3db80a95-5e81-59d2-a41b-efd233fd7ecc_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8797%252F19518797%252Fexterior_front_driver-1774094931873.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8797/19518797/exterior_front_driver-1774094931873.jpg saved to cache
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3db80a95-5e81-59d2-a41b-efd233fd7ecc
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a3b190>
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3db80a95-5e81-59d2-a41b-efd233fd7ecc/3db80a95-5e81-59d2-a41b-efd233fd7ecc_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8797%252F19518797%252Fexterior_front_passenger-1774095231739.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8797/19518797/exterior_front_passenger-1774095231739.jpg saved to cache
2026-03-29 20:14:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3db80a95-5e81-59d2-a41b-efd233fd7ecc
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65850f750>
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_150e2786-d5e3-543d-9bf5-4b9b12cb2c97/150e2786-d5e3-543d-9bf5-4b9b12cb2c97_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5198%252F18895198%252Finterior_rear_seats-1774708766524.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5198/18895198/interior_rear_seats-1774708766524.jpg saved to cache
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 150e2786-d5e3-543d-9bf5-4b9b12cb2c97
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586fb510>
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_150e2786-d5e3-543d-9bf5-4b9b12cb2c97/150e2786-d5e3-543d-9bf5-4b9b12cb2c97_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5198%252F18895198%252Finterior_front_seats-1774708769113.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5198/18895198/interior_front_seats-1774708769113.jpg saved to cache
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 150e2786-d5e3-543d-9bf5-4b9b12cb2c97
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65850d390>
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f244a0d-a0e1-5fcd-8823-21579403745a/8f244a0d-a0e1-5fcd-8823-21579403745a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7463%252F20487463%252Fexterior_front_passenger-1774711060490.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7463/20487463/exterior_front_passenger-1774711060490.jpg saved to cache
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f244a0d-a0e1-5fcd-8823-21579403745a
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658785e10>
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3db80a95-5e81-59d2-a41b-efd233fd7ecc/3db80a95-5e81-59d2-a41b-efd233fd7ecc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8797%252F19518797%252Fexterior_rear_driver-1774094954578.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8797/19518797/exterior_rear_driver-1774094954578.jpg saved to cache
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3db80a95-5e81-59d2-a41b-efd233fd7ecc
2026-03-29 20:14:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65850dd50>
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f244a0d-a0e1-5fcd-8823-21579403745a/8f244a0d-a0e1-5fcd-8823-21579403745a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7463%252F20487463%252Finterior_rear_seats-1774712942380.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7463/20487463/interior_rear_seats-1774712942380.jpg saved to cache
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8f244a0d-a0e1-5fcd-8823-21579403745a
2026-03-29 20:14:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65850e7d0>
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f244a0d-a0e1-5fcd-8823-21579403745a/8f244a0d-a0e1-5fcd-8823-21579403745a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7463%252F20487463%252Finterior_front_seats-1774712786197.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7463/20487463/interior_front_seats-1774712786197.jpg saved to cache
2026-03-29 20:14:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f244a0d-a0e1-5fcd-8823-21579403745a
2026-03-29 20:14:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20387159.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7d626a2-1432-538a-a52e-493a1f251867 with identifier: 20387159
2026-03-29 20:14:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7d626a2-1432-538a-a52e-493a1f251867 with scrape type 1
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f7d626a2-1432-538a-a52e-493a1f251867
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7159%252F20387159%252Fexterior_front_driver-1774701525915.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7159/20387159/exterior_front_driver-1774701525915.jpg not downloaded yet
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7159%252F20387159%252Fexterior_rear_driver-1774701539627.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7159/20387159/exterior_rear_driver-1774701539627.jpg not downloaded yet
2026-03-29 20:14:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7463/20487463/damage_missing_trims-1774715432301.jpg> (referer: None)
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7159%252F20387159%252Fexterior_front_passenger-1774699786438.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7159/20387159/exterior_front_passenger-1774699786438.jpg not downloaded yet
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7159%252F20387159%252Fexterior_rear_passenger-1774699766364.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7159/20387159/exterior_rear_passenger-1774699766364.jpg not downloaded yet
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7159%252F20387159%252Finterior_front_seats-1774701572768.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7159/20387159/interior_front_seats-1774701572768.jpg not downloaded yet
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7159%252F20387159%252Finterior_rear_seats-1774700149390.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7159/20387159/interior_rear_seats-1774700149390.jpg not downloaded yet
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7159%252F20387159%252Finterior_dashboard-1774701584892.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7159/20387159/interior_dashboard-1774701584892.jpg not downloaded yet
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7159%252F20387159%252Finterior_boot-1774700194524.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7159/20387159/interior_boot-1774700194524.jpg not downloaded yet
2026-03-29 20:14:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d31050>
2026-03-29 20:14:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f244a0d-a0e1-5fcd-8823-21579403745a/8f244a0d-a0e1-5fcd-8823-21579403745a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7463%252F20487463%252Fdamage_missing_trims-1774715432301.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7463/20487463/damage_missing_trims-1774715432301.jpg saved to cache
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8f244a0d-a0e1-5fcd-8823-21579403745a
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7159%252F20387159%252Fdocs_service_history-1774700469184.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D24604851da64c11e48db86261ace19a9%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7159/20387159/docs_service_history-1774700469184.jpg?ixlib=js-3.8.0&auto=format&s=24604851da64c11e48db86261ace19a9 not downloaded yet
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7159%252F20387159%252Fdocs_service_history-1774700477744.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Deda2532cb1eb5e302ed556980383395a%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7159/20387159/docs_service_history-1774700477744.jpg?ixlib=js-3.8.0&auto=format&s=eda2532cb1eb5e302ed556980383395a not downloaded yet
2026-03-29 20:14:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7159/20387159/exterior_front_driver-1774701525915.jpg> (referer: None)
2026-03-29 20:14:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/4895685.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582bf050>
2026-03-29 20:14:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7d626a2-1432-538a-a52e-493a1f251867/f7d626a2-1432-538a-a52e-493a1f251867_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7159%252F20387159%252Fexterior_front_driver-1774701525915.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7159/20387159/exterior_front_driver-1774701525915.jpg saved to cache
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f7d626a2-1432-538a-a52e-493a1f251867
2026-03-29 20:14:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e5f7c7d-b59e-51f0-8e52-a226a7e4fa92 with identifier: 4895685
2026-03-29 20:14:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e5f7c7d-b59e-51f0-8e52-a226a7e4fa92 with scrape type 1
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5e5f7c7d-b59e-51f0-8e52-a226a7e4fa92
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5685%252F4895685%252Fexterior_front_driver-1774081589193.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5685/4895685/exterior_front_driver-1774081589193.jpg already downloaded
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5685%252F4895685%252Fexterior_rear_driver-1774081630028.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5685/4895685/exterior_rear_driver-1774081630028.jpg already downloaded
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5685%252F4895685%252Fexterior_front_passenger-1774081672875.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5685/4895685/exterior_front_passenger-1774081672875.jpg already downloaded
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5685%252F4895685%252Fexterior_rear_passenger-1774081651592.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5685/4895685/exterior_rear_passenger-1774081651592.jpg already downloaded
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5685%252F4895685%252Finterior_front_seats-1774082243734.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5685/4895685/interior_front_seats-1774082243734.jpg already downloaded
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5685%252F4895685%252Finterior_rear_seats-1774081990062.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5685/4895685/interior_rear_seats-1774081990062.jpg already downloaded
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5685%252F4895685%252Finterior_dashboard-1774082016436.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5685/4895685/interior_dashboard-1774082016436.jpg already downloaded
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5685%252F4895685%252Finterior_boot-1774082028461.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5685/4895685/interior_boot-1774082028461.jpg already downloaded
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5685%252F4895685%252Fdocs_service_history-1774082119001.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfbe995036b01fb3056353a55c568d2c6%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5685/4895685/docs_service_history-1774082119001.jpg?ixlib=js-3.8.0&auto=format&s=fbe995036b01fb3056353a55c568d2c6 already downloaded
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5685%252F4895685%252Fdamage_scratches-1774081717363.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5685/4895685/damage_scratches-1774081717363.jpg already downloaded
2026-03-29 20:14:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5e5f7c7d-b59e-51f0-8e52-a226a7e4fa92, identifier: 4895685
2026-03-29 20:14:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5e5f7c7d-b59e-51f0-8e52-a226a7e4fa92 with identifier: 4895685
2026-03-29 20:14:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5e5f7c7d-b59e-51f0-8e52-a226a7e4fa92 with identifier: 4895685
2026-03-29 20:14:14 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5e5f7c7d-b59e-51f0-8e52-a226a7e4fa92 with identifier: 4895685 to the API
2026-03-29 20:14:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/4895685.json>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '5e5f7c7d-b59e-51f0-8e52-a226a7e4fa92',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'WH69 HPV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/4895685',
'listing': 'auction',
'location': 'Poole Poole',
'make': 'MINI',
'model': 'Cooper',
'odometer': 34650,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/5685/4895685/exterior_front_driver-1774081589193.jpg',
'https://motorway-photos-redacted.imgix.net/5685/4895685/exterior_rear_driver-1774081630028.jpg',
'https://motorway-photos-redacted.imgix.net/5685/4895685/exterior_front_passenger-1774081672875.jpg',
'https://motorway-photos-redacted.imgix.net/5685/4895685/exterior_rear_passenger-1774081651592.jpg',
'https://motorway-photos.imgix.net/5685/4895685/interior_front_seats-1774082243734.jpg',
'https://motorway-photos.imgix.net/5685/4895685/interior_rear_seats-1774081990062.jpg',
'https://motorway-photos-redacted.imgix.net/5685/4895685/interior_dashboard-1774082016436.jpg',
'https://motorway-photos.imgix.net/5685/4895685/interior_boot-1774082028461.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/5685/4895685/docs_service_history-1774082119001.jpg?ixlib=js-3.8.0&auto=format&s=fbe995036b01fb3056353a55c568d2c6',
'https://motorway-photos.imgix.net/5685/4895685/damage_scratches-1774081717363.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b782e643-723f-51f0-8853-84383f16635d/b782e643-723f-51f0-8853-84383f16635d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1268582,
'Height': 2219,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5685/4895685/exterior_front_driver-1774081589193.jpg',
'Width': 2958},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b782e643-723f-51f0-8853-84383f16635d/b782e643-723f-51f0-8853-84383f16635d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1636717,
'Height': 2435,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5685/4895685/exterior_rear_driver-1774081630028.jpg',
'Width': 3246},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b782e643-723f-51f0-8853-84383f16635d/b782e643-723f-51f0-8853-84383f16635d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2275036,
'Height': 2851,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5685/4895685/exterior_front_passenger-1774081672875.jpg',
'Width': 3801},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b782e643-723f-51f0-8853-84383f16635d/b782e643-723f-51f0-8853-84383f16635d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1915047,
'Height': 2588,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5685/4895685/exterior_rear_passenger-1774081651592.jpg',
'Width': 3450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b782e643-723f-51f0-8853-84383f16635d/b782e643-723f-51f0-8853-84383f16635d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3853887,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5685/4895685/interior_front_seats-1774082243734.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b782e643-723f-51f0-8853-84383f16635d/b782e643-723f-51f0-8853-84383f16635d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2901728,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5685/4895685/interior_rear_seats-1774081990062.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b782e643-723f-51f0-8853-84383f16635d/b782e643-723f-51f0-8853-84383f16635d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3307079,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5685/4895685/interior_dashboard-1774082016436.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b782e643-723f-51f0-8853-84383f16635d/b782e643-723f-51f0-8853-84383f16635d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4637337,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5685/4895685/interior_boot-1774082028461.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b782e643-723f-51f0-8853-84383f16635d/b782e643-723f-51f0-8853-84383f16635d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1824213,
'Height': 1280,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5685/4895685/docs_service_history-1774082119001.jpg?ixlib=js-3.8.0&auto=format&s=fbe995036b01fb3056353a55c568d2c6',
'Width': 1849},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b782e643-723f-51f0-8853-84383f16635d/b782e643-723f-51f0-8853-84383f16635d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1912601,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5685/4895685/damage_scratches-1774081717363.jpg',
'Width': 4032}],
'price': 14203,
'price_includes_vat': False,
'registration_date': '2019-11-27',
'seats_number': None,
'seller_name': None,
'title': 'MINI Cooper S Sport Auto',
'transmission': 'automatic',
'trim': 'S Sport Auto',
'vin': 'WMWXU920102M28617',
'year': 2019}
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%274895685%27 HTTP/1.1" 200 None
2026-03-29 20:14:16 [motorway.uk] INFO: Saving data for 4895685: {'created_time': 1774815256.151728, 'last_price_update_time': 1774815256.15174, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='4895685') HTTP/1.1" 204 0
2026-03-29 20:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19781742.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7159/20387159/docs_service_history-1774700477744.jpg?ixlib=js-3.8.0&auto=format&s=eda2532cb1eb5e302ed556980383395a> (referer: None)
2026-03-29 20:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7159/20387159/docs_service_history-1774700469184.jpg?ixlib=js-3.8.0&auto=format&s=24604851da64c11e48db86261ace19a9> (referer: None)
2026-03-29 20:14:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c74c789-5cc9-51b0-9e51-462608de842f with identifier: 19781742
2026-03-29 20:14:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c74c789-5cc9-51b0-9e51-462608de842f with scrape type 1
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c74c789-5cc9-51b0-9e51-462608de842f
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1742%252F19781742%252Fexterior_front_driver-1774695652394.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1742/19781742/exterior_front_driver-1774695652394.jpg not downloaded yet
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1742%252F19781742%252Fexterior_rear_driver-1774695648814.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1742/19781742/exterior_rear_driver-1774695648814.jpg not downloaded yet
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1742%252F19781742%252Fexterior_front_passenger-1774695679202.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1742/19781742/exterior_front_passenger-1774695679202.jpg not downloaded yet
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf3d350>
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7d626a2-1432-538a-a52e-493a1f251867/f7d626a2-1432-538a-a52e-493a1f251867_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7159%252F20387159%252Fdocs_service_history-1774700477744.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Deda2532cb1eb5e302ed556980383395a') HTTP/1.1" 204 0
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7159/20387159/docs_service_history-1774700477744.jpg?ixlib=js-3.8.0&auto=format&s=eda2532cb1eb5e302ed556980383395a saved to cache
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f7d626a2-1432-538a-a52e-493a1f251867
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584dca50>
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7d626a2-1432-538a-a52e-493a1f251867/f7d626a2-1432-538a-a52e-493a1f251867_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7159%252F20387159%252Fdocs_service_history-1774700469184.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D24604851da64c11e48db86261ace19a9') HTTP/1.1" 204 0
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7159/20387159/docs_service_history-1774700469184.jpg?ixlib=js-3.8.0&auto=format&s=24604851da64c11e48db86261ace19a9 saved to cache
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f7d626a2-1432-538a-a52e-493a1f251867
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1742%252F19781742%252Fexterior_rear_passenger-1774695656333.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1742/19781742/exterior_rear_passenger-1774695656333.jpg not downloaded yet
2026-03-29 20:14:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20487024.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1742%252F19781742%252Finterior_front_seats-1774696424142.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1742/19781742/interior_front_seats-1774696424142.jpg not downloaded yet
2026-03-29 20:14:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1742%252F19781742%252Finterior_rear_seats-1774696432033.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1742/19781742/interior_rear_seats-1774696432033.jpg not downloaded yet
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1742%252F19781742%252Finterior_dashboard-1774696513061.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1742/19781742/interior_dashboard-1774696513061.jpg not downloaded yet
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1742%252F19781742%252Finterior_boot-1774696430207.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1742/19781742/interior_boot-1774696430207.jpg not downloaded yet
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1742%252F19781742%252Fdocs_service_history-1774696781136.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1d09390d5b80e8cad4c6cc16b6c8573b%27 HTTP/1.1" 200 None
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1742/19781742/docs_service_history-1774696781136.jpg?ixlib=js-3.8.0&auto=format&s=1d09390d5b80e8cad4c6cc16b6c8573b not downloaded yet
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1742%252F19781742%252Fdocs_service_history-1774696794906.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D59c9a229bbef66a8ed4910bc36ea968e%27 HTTP/1.1" 200 None
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1742/19781742/docs_service_history-1774696794906.jpg?ixlib=js-3.8.0&auto=format&s=59c9a229bbef66a8ed4910bc36ea968e not downloaded yet
2026-03-29 20:14:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb1f3110-f978-5672-a6d4-4279437565b7 with identifier: 20487024
2026-03-29 20:14:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb1f3110-f978-5672-a6d4-4279437565b7 with scrape type 1
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb1f3110-f978-5672-a6d4-4279437565b7
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7024%252F20487024%252Fexterior_front_driver-1774705378405.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7024/20487024/exterior_front_driver-1774705378405.jpg not downloaded yet
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7024%252F20487024%252Fexterior_rear_driver-1774706983429.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7024/20487024/exterior_rear_driver-1774706983429.jpg not downloaded yet
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7024%252F20487024%252Fexterior_front_passenger-1774705385975.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7024/20487024/exterior_front_passenger-1774705385975.jpg not downloaded yet
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7024%252F20487024%252Fexterior_rear_passenger-1774705390013.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7024/20487024/exterior_rear_passenger-1774705390013.jpg not downloaded yet
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7024%252F20487024%252Finterior_front_seats-1774705519262.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7024/20487024/interior_front_seats-1774705519262.jpg not downloaded yet
2026-03-29 20:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7024%252F20487024%252Finterior_rear_seats-1774705407660.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7024/20487024/interior_rear_seats-1774705407660.jpg not downloaded yet
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7024%252F20487024%252Finterior_dashboard-1774706997115.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7024/20487024/interior_dashboard-1774706997115.jpg not downloaded yet
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7024%252F20487024%252Finstrument_cluster-1774705523108.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7024/20487024/instrument_cluster-1774705523108.jpg not downloaded yet
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7024%252F20487024%252Finterior_boot-1774705546585.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7024/20487024/interior_boot-1774705546585.jpg not downloaded yet
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7024%252F20487024%252Fdocs_service_history-1774705182767.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D369b0fc6b34e393b1ec8c2f7c080bc29%27 HTTP/1.1" 200 None
2026-03-29 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7024/20487024/docs_service_history-1774705182767.jpg?ixlib=js-3.8.0&auto=format&s=369b0fc6b34e393b1ec8c2f7c080bc29 not downloaded yet
2026-03-29 20:14:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7159/20387159/interior_dashboard-1774701584892.jpg> (referer: None)
2026-03-29 20:14:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7159/20387159/interior_boot-1774700194524.jpg> (referer: None)
2026-03-29 20:14:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1742/19781742/exterior_front_passenger-1774695679202.jpg> (referer: None)
2026-03-29 20:14:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65850cc90>
2026-03-29 20:14:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7d626a2-1432-538a-a52e-493a1f251867/f7d626a2-1432-538a-a52e-493a1f251867_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7159%252F20387159%252Finterior_dashboard-1774701584892.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7159/20387159/interior_dashboard-1774701584892.jpg saved to cache
2026-03-29 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f7d626a2-1432-538a-a52e-493a1f251867
2026-03-29 20:14:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599b8550>
2026-03-29 20:14:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7d626a2-1432-538a-a52e-493a1f251867/f7d626a2-1432-538a-a52e-493a1f251867_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7159%252F20387159%252Finterior_boot-1774700194524.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7159/20387159/interior_boot-1774700194524.jpg saved to cache
2026-03-29 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f7d626a2-1432-538a-a52e-493a1f251867
2026-03-29 20:14:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658339b50>
2026-03-29 20:14:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c74c789-5cc9-51b0-9e51-462608de842f/2c74c789-5cc9-51b0-9e51-462608de842f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1742%252F19781742%252Fexterior_front_passenger-1774695679202.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1742/19781742/exterior_front_passenger-1774695679202.jpg saved to cache
2026-03-29 20:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c74c789-5cc9-51b0-9e51-462608de842f
2026-03-29 20:14:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=756&page=21&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 19444118
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 20486974
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 20486509
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 14040355
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 17809843
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 20270906
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720270906%27 HTTP/1.1" 200 None
2026-03-29 20:14:17 [motorway.uk] INFO: Scrape type for 20270906: 1
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 9667311
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 19797838
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 20486919
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 20406062
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 18135215
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 20348082
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 19815321
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 18899297
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 20382953
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 15048808
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715048808%27 HTTP/1.1" 200 None
2026-03-29 20:14:17 [motorway.uk] INFO: Scrape type for 15048808: 1
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 20376604
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720376604%27 HTTP/1.1" 200 None
2026-03-29 20:14:17 [motorway.uk] INFO: Scrape type for 20376604: 1
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 19669683
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 16614089
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 20281844
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720281844%27 HTTP/1.1" 200 None
2026-03-29 20:14:17 [motorway.uk] INFO: Scrape type for 20281844: 1
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 20472398
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 20463285
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 10521418
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 20325744
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720325744%27 HTTP/1.1" 200 None
2026-03-29 20:14:17 [motorway.uk] INFO: Scrape type for 20325744: 1
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 7322331
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277322331%27 HTTP/1.1" 200 None
2026-03-29 20:14:17 [motorway.uk] INFO: Scrape type for 7322331: 1
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 6590662
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 12561164
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 20346563
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 18746892
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 18935928
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 11445648
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 20471200
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 20259315
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 18569454
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 19681726
2026-03-29 20:14:17 [motorway.uk] INFO: Found listing with ID: 20483853
2026-03-29 20:14:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7024/20487024/docs_service_history-1774705182767.jpg?ixlib=js-3.8.0&auto=format&s=369b0fc6b34e393b1ec8c2f7c080bc29> (referer: None)
2026-03-29 20:14:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a76ad0>
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb1f3110-f978-5672-a6d4-4279437565b7/cb1f3110-f978-5672-a6d4-4279437565b7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7024%252F20487024%252Fdocs_service_history-1774705182767.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D369b0fc6b34e393b1ec8c2f7c080bc29') HTTP/1.1" 204 0
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7024/20487024/docs_service_history-1774705182767.jpg?ixlib=js-3.8.0&auto=format&s=369b0fc6b34e393b1ec8c2f7c080bc29 saved to cache
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cb1f3110-f978-5672-a6d4-4279437565b7
2026-03-29 20:14:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7024/20487024/interior_boot-1774705546585.jpg> (referer: None)
2026-03-29 20:14:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7024/20487024/instrument_cluster-1774705523108.jpg> (referer: None)
2026-03-29 20:14:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7024/20487024/interior_dashboard-1774706997115.jpg> (referer: None)
2026-03-29 20:14:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599b8a10>
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb1f3110-f978-5672-a6d4-4279437565b7/cb1f3110-f978-5672-a6d4-4279437565b7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7024%252F20487024%252Finterior_boot-1774705546585.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7024/20487024/interior_boot-1774705546585.jpg saved to cache
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cb1f3110-f978-5672-a6d4-4279437565b7
2026-03-29 20:14:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1742/19781742/exterior_rear_passenger-1774695656333.jpg> (referer: None)
2026-03-29 20:14:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a24ed0>
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb1f3110-f978-5672-a6d4-4279437565b7/cb1f3110-f978-5672-a6d4-4279437565b7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7024%252F20487024%252Finstrument_cluster-1774705523108.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7024/20487024/instrument_cluster-1774705523108.jpg saved to cache
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb1f3110-f978-5672-a6d4-4279437565b7
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f27350>
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb1f3110-f978-5672-a6d4-4279437565b7/cb1f3110-f978-5672-a6d4-4279437565b7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7024%252F20487024%252Finterior_dashboard-1774706997115.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7024/20487024/interior_dashboard-1774706997115.jpg saved to cache
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb1f3110-f978-5672-a6d4-4279437565b7
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c611d0>
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c74c789-5cc9-51b0-9e51-462608de842f/2c74c789-5cc9-51b0-9e51-462608de842f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1742%252F19781742%252Fexterior_rear_passenger-1774695656333.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1742/19781742/exterior_rear_passenger-1774695656333.jpg saved to cache
2026-03-29 20:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c74c789-5cc9-51b0-9e51-462608de842f
2026-03-29 20:14:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18078915.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ca25687-0488-5d71-aa4a-882011fb386b with identifier: 18078915
2026-03-29 20:14:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ca25687-0488-5d71-aa4a-882011fb386b with scrape type 1
2026-03-29 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0ca25687-0488-5d71-aa4a-882011fb386b
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8915%252F18078915%252Fexterior_front_driver-1771932381904.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8915/18078915/exterior_front_driver-1771932381904.jpeg already downloaded
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8915%252F18078915%252F18078915-exterior_rear_driver-modified-1771940111465.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8915/18078915/18078915-exterior_rear_driver-modified-1771940111465.jpeg already downloaded
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8915%252F18078915%252Fexterior_front_passenger-1771932390663.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8915/18078915/exterior_front_passenger-1771932390663.jpeg already downloaded
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8915%252F18078915%252F18078915-exterior_rear_passenger-modified-1771940132651.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8915/18078915/18078915-exterior_rear_passenger-modified-1771940132651.jpeg already downloaded
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8915%252F18078915%252Finterior_front_seats-1771932676761.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8915/18078915/interior_front_seats-1771932676761.jpeg already downloaded
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8915%252F18078915%252Finterior_rear_seats-1771932764468.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8915/18078915/interior_rear_seats-1771932764468.jpeg already downloaded
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8915%252F18078915%252F18078915-interior_dashboard-modified-1771940148604.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8915/18078915/18078915-interior_dashboard-modified-1771940148604.jpeg already downloaded
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8915%252F18078915%252F18078915-instrument_cluster-default-1774779475689.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8915/18078915/18078915-instrument_cluster-default-1774779475689.jpg not downloaded yet
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8915%252F18078915%252Finterior_boot-1771932847007.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8915/18078915/interior_boot-1771932847007.jpeg already downloaded
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F8915%252F18078915%252Fdocs_service_history-1771937393986.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da775ed3b7bdf5f243404afaf0f206775%27 HTTP/1.1" 200 None
2026-03-29 20:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/8915/18078915/docs_service_history-1771937393986.jpeg?ixlib=js-3.8.0&auto=format&s=a775ed3b7bdf5f243404afaf0f206775 already downloaded
2026-03-29 20:14:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15371876.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87ed19c7-3066-5c65-827b-d3b1a2562094 with identifier: 15371876
2026-03-29 20:14:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87ed19c7-3066-5c65-827b-d3b1a2562094 with scrape type 1
2026-03-29 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 87ed19c7-3066-5c65-827b-d3b1a2562094
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1876%252F15371876%252Fexterior_front_driver-1772723412879.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1876/15371876/exterior_front_driver-1772723412879.jpeg not downloaded yet
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1876%252F15371876%252Fexterior_rear_driver-1772723478911.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1876/15371876/exterior_rear_driver-1772723478911.jpeg not downloaded yet
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1876%252F15371876%252Fexterior_front_passenger-1772723425481.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1876/15371876/exterior_front_passenger-1772723425481.jpeg not downloaded yet
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1876%252F15371876%252Fexterior_rear_passenger-1772723464323.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1876/15371876/exterior_rear_passenger-1772723464323.jpeg not downloaded yet
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1876%252F15371876%252Finterior_front_seats-1772723582454.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1876/15371876/interior_front_seats-1772723582454.jpeg not downloaded yet
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1876%252F15371876%252Finterior_rear_seats-1772723678097.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1876/15371876/interior_rear_seats-1772723678097.jpeg not downloaded yet
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1876%252F15371876%252Finterior_dashboard-1772723901306.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1876/15371876/interior_dashboard-1772723901306.jpeg not downloaded yet
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1876%252F15371876%252Finstrument_cluster-1772723798693.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1876/15371876/instrument_cluster-1772723798693.jpeg not downloaded yet
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1876%252F15371876%252Finterior_boot-1772807593864.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1876/15371876/interior_boot-1772807593864.jpeg not downloaded yet
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1876%252F15371876%252Fdocs_service_history-1773136220967.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4d6bdff7c885f5efc8115b0890754344%27 HTTP/1.1" 200 None
2026-03-29 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1876/15371876/docs_service_history-1773136220967.jpeg?ixlib=js-3.8.0&auto=format&s=4d6bdff7c885f5efc8115b0890754344 not downloaded yet
2026-03-29 20:14:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8915/18078915/18078915-instrument_cluster-default-1774779475689.jpg> (referer: None)
2026-03-29 20:14:20 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:14:20 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:14:20 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x1f2M\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03\xa0\xe2\x00\x1f\x0c\xc0\x00\x00\x00\x00'
2026-03-29 20:14:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659bca750>
2026-03-29 20:14:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ca25687-0488-5d71-aa4a-882011fb386b/0ca25687-0488-5d71-aa4a-882011fb386b_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8915%252F18078915%252F18078915-instrument_cluster-default-1774779475689.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8915/18078915/18078915-instrument_cluster-default-1774779475689.jpg saved to cache
2026-03-29 20:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0ca25687-0488-5d71-aa4a-882011fb386b
2026-03-29 20:14:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0ca25687-0488-5d71-aa4a-882011fb386b, skipping ID generation
2026-03-29 20:14:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ca25687-0488-5d71-aa4a-882011fb386b with scrape type 1
2026-03-29 20:14:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0ca25687-0488-5d71-aa4a-882011fb386b sending to next pipeline
2026-03-29 20:14:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 0ca25687-0488-5d71-aa4a-882011fb386b, identifier: 18078915
2026-03-29 20:14:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 0ca25687-0488-5d71-aa4a-882011fb386b with identifier: 18078915
2026-03-29 20:14:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 0ca25687-0488-5d71-aa4a-882011fb386b with identifier: 18078915
2026-03-29 20:14:21 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 0ca25687-0488-5d71-aa4a-882011fb386b with identifier: 18078915 to the API
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8915/18078915/18078915-instrument_cluster-default-1774779475689.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '0ca25687-0488-5d71-aa4a-882011fb386b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FP70 NCC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18078915',
'listing': 'auction',
'location': 'Leicestershire Swadlincote',
'make': 'Audi',
'model': 'A3',
'odometer': 61400,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ab4874-b0ae-5583-8d80-bff784c1356e/82ab4874-b0ae-5583-8d80-bff784c1356e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2359059,
'Height': 3001,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8915/18078915/exterior_front_driver-1771932381904.jpeg',
'Width': 4001},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ab4874-b0ae-5583-8d80-bff784c1356e/82ab4874-b0ae-5583-8d80-bff784c1356e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2802173,
'Height': 2807,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8915/18078915/18078915-exterior_rear_driver-modified-1771940111465.jpeg',
'Width': 3743},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ab4874-b0ae-5583-8d80-bff784c1356e/82ab4874-b0ae-5583-8d80-bff784c1356e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2417770,
'Height': 2825,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8915/18078915/exterior_front_passenger-1771932390663.jpeg',
'Width': 3766},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ab4874-b0ae-5583-8d80-bff784c1356e/82ab4874-b0ae-5583-8d80-bff784c1356e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2630815,
'Height': 2730,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8915/18078915/18078915-exterior_rear_passenger-modified-1771940132651.jpeg',
'Width': 3640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ab4874-b0ae-5583-8d80-bff784c1356e/82ab4874-b0ae-5583-8d80-bff784c1356e_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3756451,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8915/18078915/interior_front_seats-1771932676761.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ab4874-b0ae-5583-8d80-bff784c1356e/82ab4874-b0ae-5583-8d80-bff784c1356e_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2543830,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8915/18078915/interior_rear_seats-1771932764468.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ab4874-b0ae-5583-8d80-bff784c1356e/82ab4874-b0ae-5583-8d80-bff784c1356e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2208375,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8915/18078915/18078915-interior_dashboard-modified-1771940148604.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ca25687-0488-5d71-aa4a-882011fb386b/0ca25687-0488-5d71-aa4a-882011fb386b_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2282287,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8915/18078915/18078915-instrument_cluster-default-1774779475689.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ab4874-b0ae-5583-8d80-bff784c1356e/82ab4874-b0ae-5583-8d80-bff784c1356e_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3803167,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8915/18078915/interior_boot-1771932847007.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82ab4874-b0ae-5583-8d80-bff784c1356e/82ab4874-b0ae-5583-8d80-bff784c1356e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3180984,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/8915/18078915/docs_service_history-1771937393986.jpeg?ixlib=js-3.8.0&auto=format&s=a775ed3b7bdf5f243404afaf0f206775',
'Width': 4032}],
'price': 14742,
'price_includes_vat': False,
'registration_date': '2020-11-19',
'seats_number': None,
'seller_name': None,
'title': 'Audi A3 S Line 35 TDI S-A',
'transmission': 'automatic',
'trim': 'S Line 35 TDI S-A',
'vin': 'WAUZZZGY7MA022040',
'year': 2020}
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718078915%27 HTTP/1.1" 200 None
2026-03-29 20:14:21 [motorway.uk] INFO: Saving data for 18078915: {'created_time': 1774815261.654444, 'last_price_update_time': 1774815261.654457, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18078915') HTTP/1.1" 204 0
2026-03-29 20:14:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1876/15371876/docs_service_history-1773136220967.jpeg?ixlib=js-3.8.0&auto=format&s=4d6bdff7c885f5efc8115b0890754344> (referer: None)
2026-03-29 20:14:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:14:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:21 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:14:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599f93d0>
2026-03-29 20:14:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87ed19c7-3066-5c65-827b-d3b1a2562094/87ed19c7-3066-5c65-827b-d3b1a2562094_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1876%252F15371876%252Fdocs_service_history-1773136220967.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4d6bdff7c885f5efc8115b0890754344') HTTP/1.1" 204 0
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1876/15371876/docs_service_history-1773136220967.jpeg?ixlib=js-3.8.0&auto=format&s=4d6bdff7c885f5efc8115b0890754344 saved to cache
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 87ed19c7-3066-5c65-827b-d3b1a2562094
2026-03-29 20:14:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19747758.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14732982.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f9d1f9d-650a-59d6-b8ac-9f3c97509a75 with identifier: 19747758
2026-03-29 20:14:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f9d1f9d-650a-59d6-b8ac-9f3c97509a75 with scrape type 1
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8f9d1f9d-650a-59d6-b8ac-9f3c97509a75
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7758%252F19747758%252Fexterior_front_driver-1774695883231.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7758/19747758/exterior_front_driver-1774695883231.jpg not downloaded yet
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7758%252F19747758%252Fexterior_rear_driver-1774695891615.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7758/19747758/exterior_rear_driver-1774695891615.jpg not downloaded yet
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7758%252F19747758%252Fexterior_front_passenger-1774695921355.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7758/19747758/exterior_front_passenger-1774695921355.jpg not downloaded yet
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7758%252F19747758%252Fexterior_rear_passenger-1774695908673.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7758/19747758/exterior_rear_passenger-1774695908673.jpg not downloaded yet
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7758%252F19747758%252Finterior_front_seats-1774778422796.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7758/19747758/interior_front_seats-1774778422796.jpg not downloaded yet
2026-03-29 20:14:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc90212f-33fc-564b-915c-f107120f2398 with identifier: 14732982
2026-03-29 20:14:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc90212f-33fc-564b-915c-f107120f2398 with scrape type 1
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cc90212f-33fc-564b-915c-f107120f2398
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2982%252F14732982%252Fexterior_front_driver-1774773484180.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2982/14732982/exterior_front_driver-1774773484180.jpg not downloaded yet
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7758%252F19747758%252Finterior_rear_seats-1774778432082.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7758/19747758/interior_rear_seats-1774778432082.jpg not downloaded yet
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2982%252F14732982%252Fexterior_rear_driver-1774693076047.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2982/14732982/exterior_rear_driver-1774693076047.jpg not downloaded yet
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7758%252F19747758%252Finterior_dashboard-1774778239959.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7758/19747758/interior_dashboard-1774778239959.jpg not downloaded yet
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2982%252F14732982%252Fexterior_front_passenger-1774693105924.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2982/14732982/exterior_front_passenger-1774693105924.jpg not downloaded yet
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7758%252F19747758%252Finstrument_cluster-1774778368681.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7758/19747758/instrument_cluster-1774778368681.jpg not downloaded yet
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2982%252F14732982%252Fexterior_rear_passenger-1774693088916.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2982/14732982/exterior_rear_passenger-1774693088916.jpg not downloaded yet
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7758%252F19747758%252Finterior_boot-1774780225267.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7758/19747758/interior_boot-1774780225267.jpg not downloaded yet
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2982%252F14732982%252Finterior_front_seats-1774693374892.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2982/14732982/interior_front_seats-1774693374892.jpg not downloaded yet
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7758%252F19747758%252Fdocs_service_history-1774778224889.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8e159a7a6a55a31c236a8cbd4251c372%27 HTTP/1.1" 200 None
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7758/19747758/docs_service_history-1774778224889.jpg?ixlib=js-3.8.0&auto=format&s=8e159a7a6a55a31c236a8cbd4251c372 not downloaded yet
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2982%252F14732982%252Finterior_rear_seats-1774700467634.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2982/14732982/interior_rear_seats-1774700467634.jpg not downloaded yet
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2982%252F14732982%252Finterior_dashboard-1774774030223.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2982/14732982/interior_dashboard-1774774030223.jpg not downloaded yet
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2982%252F14732982%252Finstrument_cluster-1774693482531.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2982/14732982/instrument_cluster-1774693482531.jpg not downloaded yet
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2982%252F14732982%252Finterior_boot-1774774048785.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2982/14732982/interior_boot-1774774048785.jpg not downloaded yet
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2982%252F14732982%252Fdocs_service_history-1774727889257.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7de8911f7ccfa82e51ed1385f52c1397%27 HTTP/1.1" 200 None
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2982/14732982/docs_service_history-1774727889257.jpg?ixlib=js-3.8.0&auto=format&s=7de8911f7ccfa82e51ed1385f52c1397 not downloaded yet
2026-03-29 20:14:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1876/15371876/interior_dashboard-1772723901306.jpeg> (referer: None)
2026-03-29 20:14:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1876/15371876/instrument_cluster-1772723798693.jpeg> (referer: None)
2026-03-29 20:14:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1876/15371876/interior_boot-1772807593864.jpeg> (referer: None)
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b55090>
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87ed19c7-3066-5c65-827b-d3b1a2562094/87ed19c7-3066-5c65-827b-d3b1a2562094_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1876%252F15371876%252Finterior_dashboard-1772723901306.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1876/15371876/interior_dashboard-1772723901306.jpeg saved to cache
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 87ed19c7-3066-5c65-827b-d3b1a2562094
2026-03-29 20:14:22 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:14:22 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:14:22 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00(|\xdb\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xa5\xc2\x00(r\xed\x00\x00\x00\x00'
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65813c9d0>
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87ed19c7-3066-5c65-827b-d3b1a2562094/87ed19c7-3066-5c65-827b-d3b1a2562094_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1876%252F15371876%252Finstrument_cluster-1772723798693.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1876/15371876/instrument_cluster-1772723798693.jpeg saved to cache
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 87ed19c7-3066-5c65-827b-d3b1a2562094
2026-03-29 20:14:22 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:14:22 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:14:22 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00;\x15\xf3\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03\xa6\xeb\x00;\x0b\xbd\x00\x00\x00\x00'
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658522a50>
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87ed19c7-3066-5c65-827b-d3b1a2562094/87ed19c7-3066-5c65-827b-d3b1a2562094_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1876%252F15371876%252Finterior_boot-1772807593864.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1876/15371876/interior_boot-1772807593864.jpeg saved to cache
2026-03-29 20:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 87ed19c7-3066-5c65-827b-d3b1a2562094
2026-03-29 20:14:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2982/14732982/interior_boot-1774774048785.jpg> (referer: None)
2026-03-29 20:14:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c39110>
2026-03-29 20:14:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc90212f-33fc-564b-915c-f107120f2398/cc90212f-33fc-564b-915c-f107120f2398_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2982%252F14732982%252Finterior_boot-1774774048785.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2982/14732982/interior_boot-1774774048785.jpg saved to cache
2026-03-29 20:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cc90212f-33fc-564b-915c-f107120f2398
2026-03-29 20:14:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2982/14732982/interior_dashboard-1774774030223.jpg> (referer: None)
2026-03-29 20:14:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2982/14732982/instrument_cluster-1774693482531.jpg> (referer: None)
2026-03-29 20:14:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2982/14732982/docs_service_history-1774727889257.jpg?ixlib=js-3.8.0&auto=format&s=7de8911f7ccfa82e51ed1385f52c1397> (referer: None)
2026-03-29 20:14:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65882d2d0>
2026-03-29 20:14:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc90212f-33fc-564b-915c-f107120f2398/cc90212f-33fc-564b-915c-f107120f2398_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2982%252F14732982%252Finterior_dashboard-1774774030223.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2982/14732982/interior_dashboard-1774774030223.jpg saved to cache
2026-03-29 20:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cc90212f-33fc-564b-915c-f107120f2398
2026-03-29 20:14:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cc6650>
2026-03-29 20:14:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc90212f-33fc-564b-915c-f107120f2398/cc90212f-33fc-564b-915c-f107120f2398_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2982%252F14732982%252Finstrument_cluster-1774693482531.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2982/14732982/instrument_cluster-1774693482531.jpg saved to cache
2026-03-29 20:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cc90212f-33fc-564b-915c-f107120f2398
2026-03-29 20:14:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b67410>
2026-03-29 20:14:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc90212f-33fc-564b-915c-f107120f2398/cc90212f-33fc-564b-915c-f107120f2398_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2982%252F14732982%252Fdocs_service_history-1774727889257.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7de8911f7ccfa82e51ed1385f52c1397') HTTP/1.1" 204 0
2026-03-29 20:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2982/14732982/docs_service_history-1774727889257.jpg?ixlib=js-3.8.0&auto=format&s=7de8911f7ccfa82e51ed1385f52c1397 saved to cache
2026-03-29 20:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cc90212f-33fc-564b-915c-f107120f2398
2026-03-29 20:14:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/7758/19747758/docs_service_history-1774778224889.jpg?ixlib=js-3.8.0&auto=format&s=8e159a7a6a55a31c236a8cbd4251c372> (referer: None)
2026-03-29 20:14:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=792&page=22&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2982/14732982/interior_rear_seats-1774700467634.jpg> (referer: None)
2026-03-29 20:14:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bf8490>
2026-03-29 20:14:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f9d1f9d-650a-59d6-b8ac-9f3c97509a75/8f9d1f9d-650a-59d6-b8ac-9f3c97509a75_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7758%252F19747758%252Fdocs_service_history-1774778224889.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8e159a7a6a55a31c236a8cbd4251c372') HTTP/1.1" 204 0
2026-03-29 20:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7758/19747758/docs_service_history-1774778224889.jpg?ixlib=js-3.8.0&auto=format&s=8e159a7a6a55a31c236a8cbd4251c372 saved to cache
2026-03-29 20:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8f9d1f9d-650a-59d6-b8ac-9f3c97509a75
2026-03-29 20:14:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7758/19747758/instrument_cluster-1774778368681.jpg> (referer: None)
2026-03-29 20:14:23 [motorway.uk] INFO: Found listing with ID: 20385482
2026-03-29 20:14:23 [motorway.uk] INFO: Found listing with ID: 14497960
2026-03-29 20:14:23 [motorway.uk] INFO: Found listing with ID: 20393358
2026-03-29 20:14:23 [motorway.uk] INFO: Found listing with ID: 20217991
2026-03-29 20:14:23 [motorway.uk] INFO: Found listing with ID: 20383556
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720383556%27 HTTP/1.1" 200 None
2026-03-29 20:14:24 [motorway.uk] INFO: Scrape type for 20383556: 1
2026-03-29 20:14:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658430050>
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc90212f-33fc-564b-915c-f107120f2398/cc90212f-33fc-564b-915c-f107120f2398_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2982%252F14732982%252Finterior_rear_seats-1774700467634.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2982/14732982/interior_rear_seats-1774700467634.jpg saved to cache
2026-03-29 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cc90212f-33fc-564b-915c-f107120f2398
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 20485756
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 19413267
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 19288331
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719288331%27 HTTP/1.1" 200 None
2026-03-29 20:14:24 [motorway.uk] INFO: Scrape type for 19288331: 1
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 20462610
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 20490179
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720490179%27 HTTP/1.1" 200 None
2026-03-29 20:14:24 [motorway.uk] INFO: Scrape type for 20490179: 1
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658415150>
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f9d1f9d-650a-59d6-b8ac-9f3c97509a75/8f9d1f9d-650a-59d6-b8ac-9f3c97509a75_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7758%252F19747758%252Finstrument_cluster-1774778368681.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7758/19747758/instrument_cluster-1774778368681.jpg saved to cache
2026-03-29 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8f9d1f9d-650a-59d6-b8ac-9f3c97509a75
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 20486724
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 20489344
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720489344%27 HTTP/1.1" 200 None
2026-03-29 20:14:24 [motorway.uk] INFO: Scrape type for 20489344: 1
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 20348979
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 14956280
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 18941047
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 13723227
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713723227%27 HTTP/1.1" 200 None
2026-03-29 20:14:24 [motorway.uk] INFO: Scrape type for 13723227: 1
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 20423398
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 20464480
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 20471522
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 8915220
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 20476962
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 17749520
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 15294916
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 20018421
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 20405344
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 20465616
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 12468788
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 20416075
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720416075%27 HTTP/1.1" 200 None
2026-03-29 20:14:24 [motorway.uk] INFO: Scrape type for 20416075: 1
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 20337017
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 5750587
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 20426574
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 20428130
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720428130%27 HTTP/1.1" 200 None
2026-03-29 20:14:24 [motorway.uk] INFO: Scrape type for 20428130: 1
2026-03-29 20:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2982/14732982/exterior_rear_passenger-1774693088916.jpg> (referer: None)
2026-03-29 20:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2982/14732982/exterior_front_passenger-1774693105924.jpg> (referer: None)
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 20480796
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 20477490
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 20165932
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720165932%27 HTTP/1.1" 200 None
2026-03-29 20:14:24 [motorway.uk] INFO: Scrape type for 20165932: 1
2026-03-29 20:14:24 [motorway.uk] INFO: Found listing with ID: 19570678
2026-03-29 20:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7758/19747758/interior_boot-1774780225267.jpg> (referer: None)
2026-03-29 20:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2982/14732982/interior_front_seats-1774693374892.jpg> (referer: None)
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65843f950>
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc90212f-33fc-564b-915c-f107120f2398/cc90212f-33fc-564b-915c-f107120f2398_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2982%252F14732982%252Fexterior_rear_passenger-1774693088916.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2982/14732982/exterior_rear_passenger-1774693088916.jpg saved to cache
2026-03-29 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cc90212f-33fc-564b-915c-f107120f2398
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c0f250>
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc90212f-33fc-564b-915c-f107120f2398/cc90212f-33fc-564b-915c-f107120f2398_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2982%252F14732982%252Fexterior_front_passenger-1774693105924.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2982/14732982/exterior_front_passenger-1774693105924.jpg saved to cache
2026-03-29 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cc90212f-33fc-564b-915c-f107120f2398
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d00950>
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f9d1f9d-650a-59d6-b8ac-9f3c97509a75/8f9d1f9d-650a-59d6-b8ac-9f3c97509a75_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7758%252F19747758%252Finterior_boot-1774780225267.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7758/19747758/interior_boot-1774780225267.jpg saved to cache
2026-03-29 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8f9d1f9d-650a-59d6-b8ac-9f3c97509a75
2026-03-29 20:14:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c084d0>
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc90212f-33fc-564b-915c-f107120f2398/cc90212f-33fc-564b-915c-f107120f2398_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2982%252F14732982%252Finterior_front_seats-1774693374892.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2982/14732982/interior_front_seats-1774693374892.jpg saved to cache
2026-03-29 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cc90212f-33fc-564b-915c-f107120f2398
2026-03-29 20:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19842807.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/8664899.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8529270-ca53-5180-9787-f26a4e649748 with identifier: 19842807
2026-03-29 20:14:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8529270-ca53-5180-9787-f26a4e649748 with scrape type 1
2026-03-29 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8529270-ca53-5180-9787-f26a4e649748
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2807%252F19842807%252Fexterior_front_driver-1774784929380.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2807/19842807/exterior_front_driver-1774784929380.jpg not downloaded yet
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2807%252F19842807%252Fexterior_rear_driver-1774698412789.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2807/19842807/exterior_rear_driver-1774698412789.jpg not downloaded yet
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2807%252F19842807%252Fexterior_front_passenger-1774698463178.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2807/19842807/exterior_front_passenger-1774698463178.jpg not downloaded yet
2026-03-29 20:14:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0276316-b09e-5ba8-a3d2-1fac588cf19d with identifier: 8664899
2026-03-29 20:14:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0276316-b09e-5ba8-a3d2-1fac588cf19d with scrape type 1
2026-03-29 20:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e0276316-b09e-5ba8-a3d2-1fac588cf19d
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4899%252F8664899%252Fexterior_front_driver-1772639606297.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4899/8664899/exterior_front_driver-1772639606297.jpg already downloaded
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4899%252F8664899%252Fexterior_rear_driver-1772639611195.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4899/8664899/exterior_rear_driver-1772639611195.jpg already downloaded
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4899%252F8664899%252Fexterior_front_passenger-1772639609197.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4899/8664899/exterior_front_passenger-1772639609197.jpg already downloaded
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4899%252F8664899%252Fexterior_rear_passenger-1772639605995.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4899/8664899/exterior_rear_passenger-1772639605995.jpg already downloaded
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4899%252F8664899%252Finterior_front_seats-1772641998638.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4899/8664899/interior_front_seats-1772641998638.jpg already downloaded
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4899%252F8664899%252Finterior_rear_seats-1772641881898.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4899/8664899/interior_rear_seats-1772641881898.jpg already downloaded
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4899%252F8664899%252Finterior_dashboard-1772641816644.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4899/8664899/interior_dashboard-1772641816644.jpg already downloaded
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4899%252F8664899%252Finterior_boot-1772643721998.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4899/8664899/interior_boot-1772643721998.jpg already downloaded
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4899%252F8664899%252Fdocs_service_history-1772643361360.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da2d0c7f27eafd84637bd71fc626f63aa%27 HTTP/1.1" 200 None
2026-03-29 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4899/8664899/docs_service_history-1772643361360.jpg?ixlib=js-3.8.0&auto=format&s=a2d0c7f27eafd84637bd71fc626f63aa already downloaded
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4899%252F8664899%252Fdocs_service_history-1772645971382.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9361c0c90a4d6c729478110c22094470%27 HTTP/1.1" 200 None
2026-03-29 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4899/8664899/docs_service_history-1772645971382.jpg?ixlib=js-3.8.0&auto=format&s=9361c0c90a4d6c729478110c22094470 already downloaded
2026-03-29 20:14:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e0276316-b09e-5ba8-a3d2-1fac588cf19d, identifier: 8664899
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2807%252F19842807%252Fexterior_rear_passenger-1774698442835.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2807/19842807/exterior_rear_passenger-1774698442835.jpg not downloaded yet
2026-03-29 20:14:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e0276316-b09e-5ba8-a3d2-1fac588cf19d with identifier: 8664899
2026-03-29 20:14:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e0276316-b09e-5ba8-a3d2-1fac588cf19d with identifier: 8664899
2026-03-29 20:14:25 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e0276316-b09e-5ba8-a3d2-1fac588cf19d with identifier: 8664899 to the API
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/8664899.json>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '4.1L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'e0276316-b09e-5ba8-a3d2-1fac588cf19d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MS51 PKS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/8664899',
'listing': 'auction',
'location': 'West Midlands Birmingham',
'make': 'Porsche',
'model': 'Cayenne',
'odometer': 93437,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/4899/8664899/exterior_front_driver-1772639606297.jpg',
'https://motorway-photos-redacted.imgix.net/4899/8664899/exterior_rear_driver-1772639611195.jpg',
'https://motorway-photos-redacted.imgix.net/4899/8664899/exterior_front_passenger-1772639609197.jpg',
'https://motorway-photos-redacted.imgix.net/4899/8664899/exterior_rear_passenger-1772639605995.jpg',
'https://motorway-photos.imgix.net/4899/8664899/interior_front_seats-1772641998638.jpg',
'https://motorway-photos.imgix.net/4899/8664899/interior_rear_seats-1772641881898.jpg',
'https://motorway-photos-redacted.imgix.net/4899/8664899/interior_dashboard-1772641816644.jpg',
'https://motorway-photos-modified.imgix.net/4899/8664899/interior_boot-1772643721998.jpg',
'https://motorway-service-history-photos.imgix.net/modified/4899/8664899/docs_service_history-1772643361360.jpg?ixlib=js-3.8.0&auto=format&s=a2d0c7f27eafd84637bd71fc626f63aa',
'https://motorway-service-history-photos.imgix.net/modified/4899/8664899/docs_service_history-1772645971382.jpg?ixlib=js-3.8.0&auto=format&s=9361c0c90a4d6c729478110c22094470'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c4bd6b0-aef0-562c-bdea-4bedb44d1292/9c4bd6b0-aef0-562c-bdea-4bedb44d1292_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 945833,
'Height': 2023,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4899/8664899/exterior_front_driver-1772639606297.jpg',
'Width': 2697},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c4bd6b0-aef0-562c-bdea-4bedb44d1292/9c4bd6b0-aef0-562c-bdea-4bedb44d1292_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1266591,
'Height': 2192,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4899/8664899/exterior_rear_driver-1772639611195.jpg',
'Width': 2923},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c4bd6b0-aef0-562c-bdea-4bedb44d1292/9c4bd6b0-aef0-562c-bdea-4bedb44d1292_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1094973,
'Height': 2136,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4899/8664899/exterior_front_passenger-1772639609197.jpg',
'Width': 2848},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c4bd6b0-aef0-562c-bdea-4bedb44d1292/9c4bd6b0-aef0-562c-bdea-4bedb44d1292_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1070686,
'Height': 1993,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4899/8664899/exterior_rear_passenger-1772639605995.jpg',
'Width': 2657},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c4bd6b0-aef0-562c-bdea-4bedb44d1292/9c4bd6b0-aef0-562c-bdea-4bedb44d1292_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6235738,
'Height': 3000,
'OriginUrl': 'https://motorway-photos.imgix.net/4899/8664899/interior_front_seats-1772641998638.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c4bd6b0-aef0-562c-bdea-4bedb44d1292/9c4bd6b0-aef0-562c-bdea-4bedb44d1292_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5754090,
'Height': 3000,
'OriginUrl': 'https://motorway-photos.imgix.net/4899/8664899/interior_rear_seats-1772641881898.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c4bd6b0-aef0-562c-bdea-4bedb44d1292/9c4bd6b0-aef0-562c-bdea-4bedb44d1292_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6133304,
'Height': 3000,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4899/8664899/interior_dashboard-1772641816644.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c4bd6b0-aef0-562c-bdea-4bedb44d1292/9c4bd6b0-aef0-562c-bdea-4bedb44d1292_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1052503,
'Height': 2244,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4899/8664899/interior_boot-1772643721998.jpg',
'Width': 2992},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c4bd6b0-aef0-562c-bdea-4bedb44d1292/9c4bd6b0-aef0-562c-bdea-4bedb44d1292_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1034637,
'Height': 2213,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/4899/8664899/docs_service_history-1772643361360.jpg?ixlib=js-3.8.0&auto=format&s=a2d0c7f27eafd84637bd71fc626f63aa',
'Width': 2950},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c4bd6b0-aef0-562c-bdea-4bedb44d1292/9c4bd6b0-aef0-562c-bdea-4bedb44d1292_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1916659,
'Height': 2250,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/4899/8664899/docs_service_history-1772645971382.jpg?ixlib=js-3.8.0&auto=format&s=9361c0c90a4d6c729478110c22094470',
'Width': 3000}],
'price': 17607,
'price_includes_vat': False,
'registration_date': '2017-04-27',
'seats_number': None,
'seller_name': None,
'title': 'Porsche Cayenne V8 D S Tiptronic S A',
'transmission': 'automatic',
'trim': 'V8 D S Tiptronic S A',
'vin': 'WP1ZZZ92ZHLA62810',
'year': 2017}
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278664899%27 HTTP/1.1" 200 None
2026-03-29 20:14:25 [motorway.uk] INFO: Saving data for 8664899: {'created_time': 1774815265.869979, 'last_price_update_time': 1774815265.86999, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='8664899') HTTP/1.1" 204 0
2026-03-29 20:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18590519.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2807%252F19842807%252Finterior_front_seats-1774699255936.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2807/19842807/interior_front_seats-1774699255936.jpg not downloaded yet
2026-03-29 20:14:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2807%252F19842807%252Finterior_rear_seats-1774699266954.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2807/19842807/interior_rear_seats-1774699266954.jpg not downloaded yet
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2807%252F19842807%252Finterior_dashboard-1774699338302.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2807/19842807/interior_dashboard-1774699338302.jpg not downloaded yet
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2807%252F19842807%252Finterior_boot-1774699183610.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2807/19842807/interior_boot-1774699183610.jpg not downloaded yet
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2807%252F19842807%252Fdocs_service_history-1774784462463.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da72c14763903330dee341aed00f674a4%27 HTTP/1.1" 200 None
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2807/19842807/docs_service_history-1774784462463.jpg?ixlib=js-3.8.0&auto=format&s=a72c14763903330dee341aed00f674a4 not downloaded yet
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2807%252F19842807%252Fdocs_service_history-1774784468240.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7ad2d0ffa19889c7b8c79a6056c78e7d%27 HTTP/1.1" 200 None
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2807/19842807/docs_service_history-1774784468240.jpg?ixlib=js-3.8.0&auto=format&s=7ad2d0ffa19889c7b8c79a6056c78e7d not downloaded yet
2026-03-29 20:14:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f4067a2-30b7-5eac-a796-c944ea298788 with identifier: 18590519
2026-03-29 20:14:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f4067a2-30b7-5eac-a796-c944ea298788 with scrape type 1
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1f4067a2-30b7-5eac-a796-c944ea298788
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0519%252F18590519%252Fexterior_front_driver-1771674358982.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0519/18590519/exterior_front_driver-1771674358982.jpg already downloaded
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0519%252F18590519%252Fexterior_rear_driver-1771674375060.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0519/18590519/exterior_rear_driver-1771674375060.jpg already downloaded
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0519%252F18590519%252Fexterior_front_passenger-1771674402700.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0519/18590519/exterior_front_passenger-1771674402700.jpg already downloaded
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0519%252F18590519%252Fexterior_rear_passenger-1771674381072.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0519/18590519/exterior_rear_passenger-1771674381072.jpg already downloaded
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0519%252F18590519%252Finterior_front_seats-1771674748751.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0519/18590519/interior_front_seats-1771674748751.jpg already downloaded
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0519%252F18590519%252Finterior_rear_seats-1771677093723.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0519/18590519/interior_rear_seats-1771677093723.jpg already downloaded
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0519%252F18590519%252Finterior_dashboard-1771674898655.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0519/18590519/interior_dashboard-1771674898655.jpg already downloaded
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0519%252F18590519%252Finstrument_cluster-1771674703311.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0519/18590519/instrument_cluster-1771674703311.jpg already downloaded
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0519%252F18590519%252Finterior_boot-1771676924418.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0519/18590519/interior_boot-1771676924418.jpg already downloaded
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F0519%252F18590519%252Fdocs_service_history-1771677398301.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5b4edb50b3ff01754559e1ca5ba27f96%27 HTTP/1.1" 200 None
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/0519/18590519/docs_service_history-1771677398301.jpg?ixlib=js-3.8.0&auto=format&s=5b4edb50b3ff01754559e1ca5ba27f96 already downloaded
2026-03-29 20:14:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 1f4067a2-30b7-5eac-a796-c944ea298788, identifier: 18590519
2026-03-29 20:14:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 1f4067a2-30b7-5eac-a796-c944ea298788 with identifier: 18590519
2026-03-29 20:14:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 1f4067a2-30b7-5eac-a796-c944ea298788 with identifier: 18590519
2026-03-29 20:14:26 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 1f4067a2-30b7-5eac-a796-c944ea298788 with identifier: 18590519 to the API
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18590519.json>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '1f4067a2-30b7-5eac-a796-c944ea298788',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GX70 EKO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18590519',
'listing': 'auction',
'location': 'Derbyshire Matlock',
'make': 'Audi',
'model': 'A6',
'odometer': 36549,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/0519/18590519/exterior_front_driver-1771674358982.jpg',
'https://motorway-photos-redacted.imgix.net/0519/18590519/exterior_rear_driver-1771674375060.jpg',
'https://motorway-photos-redacted.imgix.net/0519/18590519/exterior_front_passenger-1771674402700.jpg',
'https://motorway-photos-redacted.imgix.net/0519/18590519/exterior_rear_passenger-1771674381072.jpg',
'https://motorway-photos.imgix.net/0519/18590519/interior_front_seats-1771674748751.jpg',
'https://motorway-photos.imgix.net/0519/18590519/interior_rear_seats-1771677093723.jpg',
'https://motorway-photos-redacted.imgix.net/0519/18590519/interior_dashboard-1771674898655.jpg',
'https://motorway-photos.imgix.net/0519/18590519/instrument_cluster-1771674703311.jpg',
'https://motorway-photos.imgix.net/0519/18590519/interior_boot-1771676924418.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/0519/18590519/docs_service_history-1771677398301.jpg?ixlib=js-3.8.0&auto=format&s=5b4edb50b3ff01754559e1ca5ba27f96'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f4067a2-30b7-5eac-a796-c944ea298788/1f4067a2-30b7-5eac-a796-c944ea298788_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1857496,
'Height': 2360,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0519/18590519/exterior_front_driver-1771674358982.jpg',
'Width': 3146},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f4067a2-30b7-5eac-a796-c944ea298788/1f4067a2-30b7-5eac-a796-c944ea298788_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1883255,
'Height': 2507,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0519/18590519/exterior_rear_driver-1771674375060.jpg',
'Width': 3342},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f4067a2-30b7-5eac-a796-c944ea298788/1f4067a2-30b7-5eac-a796-c944ea298788_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1964089,
'Height': 2399,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0519/18590519/exterior_front_passenger-1771674402700.jpg',
'Width': 3198},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f4067a2-30b7-5eac-a796-c944ea298788/1f4067a2-30b7-5eac-a796-c944ea298788_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1677252,
'Height': 2420,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0519/18590519/exterior_rear_passenger-1771674381072.jpg',
'Width': 3226},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f4067a2-30b7-5eac-a796-c944ea298788/1f4067a2-30b7-5eac-a796-c944ea298788_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4084646,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0519/18590519/interior_front_seats-1771674748751.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f4067a2-30b7-5eac-a796-c944ea298788/1f4067a2-30b7-5eac-a796-c944ea298788_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3773502,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0519/18590519/interior_rear_seats-1771677093723.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f4067a2-30b7-5eac-a796-c944ea298788/1f4067a2-30b7-5eac-a796-c944ea298788_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1572132,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0519/18590519/interior_dashboard-1771674898655.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f4067a2-30b7-5eac-a796-c944ea298788/1f4067a2-30b7-5eac-a796-c944ea298788_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2679927,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0519/18590519/instrument_cluster-1771674703311.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f4067a2-30b7-5eac-a796-c944ea298788/1f4067a2-30b7-5eac-a796-c944ea298788_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4419806,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0519/18590519/interior_boot-1771676924418.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f4067a2-30b7-5eac-a796-c944ea298788/1f4067a2-30b7-5eac-a796-c944ea298788_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2888535,
'Height': 3645,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/0519/18590519/docs_service_history-1771677398301.jpg?ixlib=js-3.8.0&auto=format&s=5b4edb50b3ff01754559e1ca5ba27f96',
'Width': 2374}],
'price': 20836,
'price_includes_vat': False,
'registration_date': '2020-10-26',
'seats_number': None,
'seller_name': None,
'title': 'Audi A6 S Line 40 TDI S-A',
'transmission': 'automatic',
'trim': 'S Line 40 TDI S-A',
'vin': 'WAUZZZF24LN084984',
'year': 2020}
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718590519%27 HTTP/1.1" 200 None
2026-03-29 20:14:26 [motorway.uk] INFO: Saving data for 18590519: {'created_time': 1774815266.781607, 'last_price_update_time': 1774815266.781618, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18590519') HTTP/1.1" 204 0
2026-03-29 20:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20487947.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2807/19842807/exterior_rear_passenger-1774698442835.jpg> (referer: None)
2026-03-29 20:14:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 907b1c2d-546e-54dc-8060-5412b3b7b964 with identifier: 20487947
2026-03-29 20:14:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 907b1c2d-546e-54dc-8060-5412b3b7b964 with scrape type 1
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 907b1c2d-546e-54dc-8060-5412b3b7b964
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7947%252F20487947%252Fexterior_front_driver-1774702929907.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7947/20487947/exterior_front_driver-1774702929907.jpg not downloaded yet
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7947%252F20487947%252Fexterior_rear_driver-1774703000575.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7947/20487947/exterior_rear_driver-1774703000575.jpg not downloaded yet
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7947%252F20487947%252Fexterior_front_passenger-1774703035978.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7947/20487947/exterior_front_passenger-1774703035978.jpg not downloaded yet
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a38e10>
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8529270-ca53-5180-9787-f26a4e649748/e8529270-ca53-5180-9787-f26a4e649748_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2807%252F19842807%252Fexterior_rear_passenger-1774698442835.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2807/19842807/exterior_rear_passenger-1774698442835.jpg saved to cache
2026-03-29 20:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8529270-ca53-5180-9787-f26a4e649748
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7947%252F20487947%252Fexterior_rear_passenger-1774703020615.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7947/20487947/exterior_rear_passenger-1774703020615.jpg not downloaded yet
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7947%252F20487947%252Finterior_front_seats-1774703876214.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7947/20487947/interior_front_seats-1774703876214.jpg not downloaded yet
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7947%252F20487947%252Finterior_rear_seats-1774703703899.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7947/20487947/interior_rear_seats-1774703703899.jpg not downloaded yet
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7947%252F20487947%252Finterior_dashboard-1774703943988.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7947/20487947/interior_dashboard-1774703943988.jpg not downloaded yet
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7947%252F20487947%252Finstrument_cluster-1774703741625.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7947/20487947/instrument_cluster-1774703741625.jpg not downloaded yet
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7947%252F20487947%252Finterior_boot-1774703821402.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7947/20487947/interior_boot-1774703821402.jpg not downloaded yet
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7947%252F20487947%252Fdocs_service_history-1774706203484.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D92e071a56f5dc0162c57b71ac4f21592%27 HTTP/1.1" 200 None
2026-03-29 20:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7947/20487947/docs_service_history-1774706203484.jpg?ixlib=js-3.8.0&auto=format&s=92e071a56f5dc0162c57b71ac4f21592 not downloaded yet
2026-03-29 20:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2807/19842807/docs_service_history-1774784468240.jpg?ixlib=js-3.8.0&auto=format&s=7ad2d0ffa19889c7b8c79a6056c78e7d> (referer: None)
2026-03-29 20:14:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:14:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:27 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:14:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a8cf90>
2026-03-29 20:14:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8529270-ca53-5180-9787-f26a4e649748/e8529270-ca53-5180-9787-f26a4e649748_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2807%252F19842807%252Fdocs_service_history-1774784468240.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7ad2d0ffa19889c7b8c79a6056c78e7d') HTTP/1.1" 204 0
2026-03-29 20:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2807/19842807/docs_service_history-1774784468240.jpg?ixlib=js-3.8.0&auto=format&s=7ad2d0ffa19889c7b8c79a6056c78e7d saved to cache
2026-03-29 20:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8529270-ca53-5180-9787-f26a4e649748
2026-03-29 20:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2807/19842807/docs_service_history-1774784462463.jpg?ixlib=js-3.8.0&auto=format&s=a72c14763903330dee341aed00f674a4> (referer: None)
2026-03-29 20:14:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/7947/20487947/docs_service_history-1774706203484.jpg?ixlib=js-3.8.0&auto=format&s=92e071a56f5dc0162c57b71ac4f21592> (referer: None)
2026-03-29 20:14:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:14:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:27 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:14:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be56e10>
2026-03-29 20:14:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8529270-ca53-5180-9787-f26a4e649748/e8529270-ca53-5180-9787-f26a4e649748_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2807%252F19842807%252Fdocs_service_history-1774784462463.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da72c14763903330dee341aed00f674a4') HTTP/1.1" 204 0
2026-03-29 20:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2807/19842807/docs_service_history-1774784462463.jpg?ixlib=js-3.8.0&auto=format&s=a72c14763903330dee341aed00f674a4 saved to cache
2026-03-29 20:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8529270-ca53-5180-9787-f26a4e649748
2026-03-29 20:14:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a8fcd0>
2026-03-29 20:14:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907b1c2d-546e-54dc-8060-5412b3b7b964/907b1c2d-546e-54dc-8060-5412b3b7b964_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7947%252F20487947%252Fdocs_service_history-1774706203484.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D92e071a56f5dc0162c57b71ac4f21592') HTTP/1.1" 204 0
2026-03-29 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7947/20487947/docs_service_history-1774706203484.jpg?ixlib=js-3.8.0&auto=format&s=92e071a56f5dc0162c57b71ac4f21592 saved to cache
2026-03-29 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 907b1c2d-546e-54dc-8060-5412b3b7b964
2026-03-29 20:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18378231.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7947/20487947/interior_boot-1774703821402.jpg> (referer: None)
2026-03-29 20:14:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daf34b79-ea4c-5eac-b31d-baf5d53d8d58 with identifier: 18378231
2026-03-29 20:14:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daf34b79-ea4c-5eac-b31d-baf5d53d8d58 with scrape type 1
2026-03-29 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item daf34b79-ea4c-5eac-b31d-baf5d53d8d58
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8231%252F18378231%252F18378231-exterior_front_driver-modified-1774698021385.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8231/18378231/18378231-exterior_front_driver-modified-1774698021385.jpeg not downloaded yet
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8231%252F18378231%252Fexterior_rear_driver-1773251547472.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8231/18378231/exterior_rear_driver-1773251547472.jpg not downloaded yet
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8231%252F18378231%252F18378231-exterior_front_passenger-modified-1774698047634.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8231/18378231/18378231-exterior_front_passenger-modified-1774698047634.jpeg not downloaded yet
2026-03-29 20:14:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b85850>
2026-03-29 20:14:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907b1c2d-546e-54dc-8060-5412b3b7b964/907b1c2d-546e-54dc-8060-5412b3b7b964_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7947%252F20487947%252Finterior_boot-1774703821402.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7947/20487947/interior_boot-1774703821402.jpg saved to cache
2026-03-29 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 907b1c2d-546e-54dc-8060-5412b3b7b964
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8231%252F18378231%252F18378231-exterior_rear_passenger-modified-1774698059713.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8231/18378231/18378231-exterior_rear_passenger-modified-1774698059713.jpeg not downloaded yet
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8231%252F18378231%252Finterior_front_seats-1773251626013.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8231/18378231/interior_front_seats-1773251626013.jpg not downloaded yet
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8231%252F18378231%252F18378231-interior_rear_seats-modified-1774698097417.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8231/18378231/18378231-interior_rear_seats-modified-1774698097417.jpeg not downloaded yet
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8231%252F18378231%252F18378231-interior_dashboard-modified-1774698104563.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8231/18378231/18378231-interior_dashboard-modified-1774698104563.jpeg not downloaded yet
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8231%252F18378231%252Finstrument_cluster-1773251788199.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8231/18378231/instrument_cluster-1773251788199.jpg not downloaded yet
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8231%252F18378231%252F18378231-interior_boot-modified-1774698113897.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8231/18378231/18378231-interior_boot-modified-1774698113897.jpeg not downloaded yet
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8231%252F18378231%252F18378231-docs_service_history-modified-1774697229039.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da1b384943e74866196bf14b535b6745b%27 HTTP/1.1" 200 None
2026-03-29 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8231/18378231/18378231-docs_service_history-modified-1774697229039.jpeg?ixlib=js-3.8.0&auto=format&s=a1b384943e74866196bf14b535b6745b not downloaded yet
2026-03-29 20:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7947/20487947/instrument_cluster-1774703741625.jpg> (referer: None)
2026-03-29 20:14:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7947/20487947/interior_dashboard-1774703943988.jpg> (referer: None)
2026-03-29 20:14:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f53a10>
2026-03-29 20:14:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907b1c2d-546e-54dc-8060-5412b3b7b964/907b1c2d-546e-54dc-8060-5412b3b7b964_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7947%252F20487947%252Finstrument_cluster-1774703741625.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7947/20487947/instrument_cluster-1774703741625.jpg saved to cache
2026-03-29 20:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 907b1c2d-546e-54dc-8060-5412b3b7b964
2026-03-29 20:14:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f06cd0>
2026-03-29 20:14:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907b1c2d-546e-54dc-8060-5412b3b7b964/907b1c2d-546e-54dc-8060-5412b3b7b964_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7947%252F20487947%252Finterior_dashboard-1774703943988.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7947/20487947/interior_dashboard-1774703943988.jpg saved to cache
2026-03-29 20:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 907b1c2d-546e-54dc-8060-5412b3b7b964
2026-03-29 20:14:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/8231/18378231/18378231-docs_service_history-modified-1774697229039.jpeg?ixlib=js-3.8.0&auto=format&s=a1b384943e74866196bf14b535b6745b> (referer: None)
2026-03-29 20:14:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7947/20487947/interior_rear_seats-1774703703899.jpg> (referer: None)
2026-03-29 20:14:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589f0310>
2026-03-29 20:14:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daf34b79-ea4c-5eac-b31d-baf5d53d8d58/daf34b79-ea4c-5eac-b31d-baf5d53d8d58_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8231%252F18378231%252F18378231-docs_service_history-modified-1774697229039.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da1b384943e74866196bf14b535b6745b') HTTP/1.1" 204 0
2026-03-29 20:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8231/18378231/18378231-docs_service_history-modified-1774697229039.jpeg?ixlib=js-3.8.0&auto=format&s=a1b384943e74866196bf14b535b6745b saved to cache
2026-03-29 20:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item daf34b79-ea4c-5eac-b31d-baf5d53d8d58
2026-03-29 20:14:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658849d50>
2026-03-29 20:14:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907b1c2d-546e-54dc-8060-5412b3b7b964/907b1c2d-546e-54dc-8060-5412b3b7b964_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7947%252F20487947%252Finterior_rear_seats-1774703703899.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7947/20487947/interior_rear_seats-1774703703899.jpg saved to cache
2026-03-29 20:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 907b1c2d-546e-54dc-8060-5412b3b7b964
2026-03-29 20:14:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8231/18378231/instrument_cluster-1773251788199.jpg> (referer: None)
2026-03-29 20:14:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8231/18378231/18378231-interior_dashboard-modified-1774698104563.jpeg> (referer: None)
2026-03-29 20:14:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8231/18378231/18378231-interior_boot-modified-1774698113897.jpeg> (referer: None)
2026-03-29 20:14:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65830cc90>
2026-03-29 20:14:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daf34b79-ea4c-5eac-b31d-baf5d53d8d58/daf34b79-ea4c-5eac-b31d-baf5d53d8d58_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8231%252F18378231%252Finstrument_cluster-1773251788199.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8231/18378231/instrument_cluster-1773251788199.jpg saved to cache
2026-03-29 20:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item daf34b79-ea4c-5eac-b31d-baf5d53d8d58
2026-03-29 20:14:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c81a10>
2026-03-29 20:14:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daf34b79-ea4c-5eac-b31d-baf5d53d8d58/daf34b79-ea4c-5eac-b31d-baf5d53d8d58_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8231%252F18378231%252F18378231-interior_dashboard-modified-1774698104563.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8231/18378231/18378231-interior_dashboard-modified-1774698104563.jpeg saved to cache
2026-03-29 20:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item daf34b79-ea4c-5eac-b31d-baf5d53d8d58
2026-03-29 20:14:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658852fd0>
2026-03-29 20:14:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daf34b79-ea4c-5eac-b31d-baf5d53d8d58/daf34b79-ea4c-5eac-b31d-baf5d53d8d58_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8231%252F18378231%252F18378231-interior_boot-modified-1774698113897.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8231/18378231/18378231-interior_boot-modified-1774698113897.jpeg saved to cache
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item daf34b79-ea4c-5eac-b31d-baf5d53d8d58
2026-03-29 20:14:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15048808.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8231/18378231/18378231-exterior_rear_passenger-modified-1774698059713.jpeg> (referer: None)
2026-03-29 20:14:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8231/18378231/18378231-interior_rear_seats-modified-1774698097417.jpeg> (referer: None)
2026-03-29 20:14:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8231/18378231/interior_front_seats-1773251626013.jpg> (referer: None)
2026-03-29 20:14:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8231/18378231/18378231-exterior_front_driver-modified-1774698021385.jpeg> (referer: None)
2026-03-29 20:14:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dea1465-19a7-5857-a435-f19638bfdaae with identifier: 15048808
2026-03-29 20:14:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dea1465-19a7-5857-a435-f19638bfdaae with scrape type 1
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5dea1465-19a7-5857-a435-f19638bfdaae
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8808%252F15048808%252Fexterior_front_driver-1774358900504.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8808/15048808/exterior_front_driver-1774358900504.jpg not downloaded yet
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8808%252F15048808%252Fexterior_rear_driver-1774358762100.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8808/15048808/exterior_rear_driver-1774358762100.jpg not downloaded yet
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8808%252F15048808%252Fexterior_front_passenger-1774358939170.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8808/15048808/exterior_front_passenger-1774358939170.jpg not downloaded yet
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ae6790>
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daf34b79-ea4c-5eac-b31d-baf5d53d8d58/daf34b79-ea4c-5eac-b31d-baf5d53d8d58_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8231%252F18378231%252F18378231-exterior_rear_passenger-modified-1774698059713.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8231/18378231/18378231-exterior_rear_passenger-modified-1774698059713.jpeg saved to cache
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item daf34b79-ea4c-5eac-b31d-baf5d53d8d58
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658108c50>
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daf34b79-ea4c-5eac-b31d-baf5d53d8d58/daf34b79-ea4c-5eac-b31d-baf5d53d8d58_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8231%252F18378231%252F18378231-interior_rear_seats-modified-1774698097417.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8231/18378231/18378231-interior_rear_seats-modified-1774698097417.jpeg saved to cache
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item daf34b79-ea4c-5eac-b31d-baf5d53d8d58
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8808%252F15048808%252Fexterior_rear_passenger-1774358925699.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8808/15048808/exterior_rear_passenger-1774358925699.jpg not downloaded yet
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8808%252F15048808%252Finterior_front_seats-1774422653851.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8808/15048808/interior_front_seats-1774422653851.jpg not downloaded yet
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8808%252F15048808%252Finterior_rear_seats-1774422666377.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8808/15048808/interior_rear_seats-1774422666377.jpg not downloaded yet
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b83290>
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daf34b79-ea4c-5eac-b31d-baf5d53d8d58/daf34b79-ea4c-5eac-b31d-baf5d53d8d58_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8231%252F18378231%252Finterior_front_seats-1773251626013.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8231/18378231/interior_front_seats-1773251626013.jpg saved to cache
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item daf34b79-ea4c-5eac-b31d-baf5d53d8d58
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c4b010>
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daf34b79-ea4c-5eac-b31d-baf5d53d8d58/daf34b79-ea4c-5eac-b31d-baf5d53d8d58_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8231%252F18378231%252F18378231-exterior_front_driver-modified-1774698021385.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8231/18378231/18378231-exterior_front_driver-modified-1774698021385.jpeg saved to cache
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item daf34b79-ea4c-5eac-b31d-baf5d53d8d58
2026-03-29 20:14:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8231/18378231/exterior_rear_driver-1773251547472.jpg> (referer: None)
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8808%252F15048808%252Finterior_dashboard-1774422678455.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8808/15048808/interior_dashboard-1774422678455.jpg not downloaded yet
2026-03-29 20:14:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8231/18378231/18378231-exterior_front_passenger-modified-1774698047634.jpeg> (referer: None)
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8808%252F15048808%252Finstrument_cluster-1774422687083.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8808/15048808/instrument_cluster-1774422687083.jpg not downloaded yet
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8808%252F15048808%252Finterior_boot-1774422662507.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8808/15048808/interior_boot-1774422662507.jpg not downloaded yet
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8808%252F15048808%252Fdocs_service_history-1774288348610.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1bc9c00db0fa319176365980e6abe2aa%27 HTTP/1.1" 200 None
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8808/15048808/docs_service_history-1774288348610.jpeg?ixlib=js-3.8.0&auto=format&s=1bc9c00db0fa319176365980e6abe2aa not downloaded yet
2026-03-29 20:14:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20376604.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7947/20487947/exterior_rear_passenger-1774703020615.jpg> (referer: None)
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fb1950>
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daf34b79-ea4c-5eac-b31d-baf5d53d8d58/daf34b79-ea4c-5eac-b31d-baf5d53d8d58_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8231%252F18378231%252Fexterior_rear_driver-1773251547472.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8231/18378231/exterior_rear_driver-1773251547472.jpg saved to cache
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item daf34b79-ea4c-5eac-b31d-baf5d53d8d58
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599cd6d0>
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daf34b79-ea4c-5eac-b31d-baf5d53d8d58/daf34b79-ea4c-5eac-b31d-baf5d53d8d58_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8231%252F18378231%252F18378231-exterior_front_passenger-modified-1774698047634.jpeg') HTTP/1.1" 204 0
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8231/18378231/18378231-exterior_front_passenger-modified-1774698047634.jpeg saved to cache
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item daf34b79-ea4c-5eac-b31d-baf5d53d8d58
2026-03-29 20:14:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: daf34b79-ea4c-5eac-b31d-baf5d53d8d58, skipping ID generation
2026-03-29 20:14:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daf34b79-ea4c-5eac-b31d-baf5d53d8d58 with scrape type 1
2026-03-29 20:14:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item daf34b79-ea4c-5eac-b31d-baf5d53d8d58 sending to next pipeline
2026-03-29 20:14:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: daf34b79-ea4c-5eac-b31d-baf5d53d8d58, identifier: 18378231
2026-03-29 20:14:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: daf34b79-ea4c-5eac-b31d-baf5d53d8d58 with identifier: 18378231
2026-03-29 20:14:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: daf34b79-ea4c-5eac-b31d-baf5d53d8d58 with identifier: 18378231
2026-03-29 20:14:31 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: daf34b79-ea4c-5eac-b31d-baf5d53d8d58 with identifier: 18378231 to the API
2026-03-29 20:14:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/8231/18378231/18378231-exterior_front_passenger-modified-1774698047634.jpeg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'daf34b79-ea4c-5eac-b31d-baf5d53d8d58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GL64 HHO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18378231',
'listing': 'auction',
'location': 'None None',
'make': 'Ford',
'model': 'B-MAX',
'odometer': 50725,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf34b79-ea4c-5eac-b31d-baf5d53d8d58/daf34b79-ea4c-5eac-b31d-baf5d53d8d58_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368467,
'Height': 1266,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8231/18378231/18378231-exterior_front_driver-modified-1774698021385.jpeg',
'Width': 1688},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf34b79-ea4c-5eac-b31d-baf5d53d8d58/daf34b79-ea4c-5eac-b31d-baf5d53d8d58_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322585,
'Height': 1396,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8231/18378231/exterior_rear_driver-1773251547472.jpg',
'Width': 1861},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf34b79-ea4c-5eac-b31d-baf5d53d8d58/daf34b79-ea4c-5eac-b31d-baf5d53d8d58_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 480454,
'Height': 1490,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8231/18378231/18378231-exterior_front_passenger-modified-1774698047634.jpeg',
'Width': 1987},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf34b79-ea4c-5eac-b31d-baf5d53d8d58/daf34b79-ea4c-5eac-b31d-baf5d53d8d58_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 508574,
'Height': 1421,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8231/18378231/18378231-exterior_rear_passenger-modified-1774698059713.jpeg',
'Width': 1895},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf34b79-ea4c-5eac-b31d-baf5d53d8d58/daf34b79-ea4c-5eac-b31d-baf5d53d8d58_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 961636,
'Height': 1944,
'OriginUrl': 'https://motorway-photos.imgix.net/8231/18378231/interior_front_seats-1773251626013.jpg',
'Width': 2592},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf34b79-ea4c-5eac-b31d-baf5d53d8d58/daf34b79-ea4c-5eac-b31d-baf5d53d8d58_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 910932,
'Height': 1944,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8231/18378231/18378231-interior_rear_seats-modified-1774698097417.jpeg',
'Width': 2592},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf34b79-ea4c-5eac-b31d-baf5d53d8d58/daf34b79-ea4c-5eac-b31d-baf5d53d8d58_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1041997,
'Height': 1944,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8231/18378231/18378231-interior_dashboard-modified-1774698104563.jpeg',
'Width': 2592},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf34b79-ea4c-5eac-b31d-baf5d53d8d58/daf34b79-ea4c-5eac-b31d-baf5d53d8d58_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 852080,
'Height': 1944,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8231/18378231/instrument_cluster-1773251788199.jpg',
'Width': 2592},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf34b79-ea4c-5eac-b31d-baf5d53d8d58/daf34b79-ea4c-5eac-b31d-baf5d53d8d58_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1052985,
'Height': 1944,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8231/18378231/18378231-interior_boot-modified-1774698113897.jpeg',
'Width': 2592},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_daf34b79-ea4c-5eac-b31d-baf5d53d8d58/daf34b79-ea4c-5eac-b31d-baf5d53d8d58_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 552996,
'Height': 2592,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/8231/18378231/18378231-docs_service_history-modified-1774697229039.jpeg?ixlib=js-3.8.0&auto=format&s=a1b384943e74866196bf14b535b6745b',
'Width': 1944}],
'price': 4294,
'price_includes_vat': False,
'registration_date': '2014-11-27',
'seats_number': None,
'seller_name': None,
'title': 'Ford B-MAX Titanium Auto',
'transmission': 'automatic',
'trim': 'Titanium Auto',
'vin': 'WF0KXXERJKER54651',
'year': 2014}
2026-03-29 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718378231%27 HTTP/1.1" 200 None
2026-03-29 20:14:32 [motorway.uk] INFO: Saving data for 18378231: {'created_time': 1774815272.68643, 'last_price_update_time': 1774815272.686445, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18378231') HTTP/1.1" 204 0
2026-03-29 20:14:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8808/15048808/docs_service_history-1774288348610.jpeg?ixlib=js-3.8.0&auto=format&s=1bc9c00db0fa319176365980e6abe2aa> (referer: None)
2026-03-29 20:14:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71e27aaf-be75-50dd-b2a3-ca685f9a9438 with identifier: 20376604
2026-03-29 20:14:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71e27aaf-be75-50dd-b2a3-ca685f9a9438 with scrape type 1
2026-03-29 20:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 71e27aaf-be75-50dd-b2a3-ca685f9a9438
2026-03-29 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6604%252F20376604%252Fexterior_front_driver-1774102773306.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6604/20376604/exterior_front_driver-1774102773306.jpg not downloaded yet
2026-03-29 20:14:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfbc250>
2026-03-29 20:14:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907b1c2d-546e-54dc-8060-5412b3b7b964/907b1c2d-546e-54dc-8060-5412b3b7b964_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7947%252F20487947%252Fexterior_rear_passenger-1774703020615.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7947/20487947/exterior_rear_passenger-1774703020615.jpg saved to cache
2026-03-29 20:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 907b1c2d-546e-54dc-8060-5412b3b7b964
2026-03-29 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6604%252F20376604%252Fexterior_rear_driver-1774100946168.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6604/20376604/exterior_rear_driver-1774100946168.jpg not downloaded yet
2026-03-29 20:14:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f50550>
2026-03-29 20:14:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dea1465-19a7-5857-a435-f19638bfdaae/5dea1465-19a7-5857-a435-f19638bfdaae_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8808%252F15048808%252Fdocs_service_history-1774288348610.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1bc9c00db0fa319176365980e6abe2aa') HTTP/1.1" 204 0
2026-03-29 20:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8808/15048808/docs_service_history-1774288348610.jpeg?ixlib=js-3.8.0&auto=format&s=1bc9c00db0fa319176365980e6abe2aa saved to cache
2026-03-29 20:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5dea1465-19a7-5857-a435-f19638bfdaae
2026-03-29 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6604%252F20376604%252Fexterior_front_passenger-1774102787653.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6604/20376604/exterior_front_passenger-1774102787653.jpg not downloaded yet
2026-03-29 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6604%252F20376604%252Fexterior_rear_passenger-1774107228661.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6604/20376604/exterior_rear_passenger-1774107228661.jpg not downloaded yet
2026-03-29 20:14:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/3181281.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20416075.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6604%252F20376604%252Finterior_front_seats-1774102808160.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6604/20376604/interior_front_seats-1774102808160.jpg not downloaded yet
2026-03-29 20:14:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20325744.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6604%252F20376604%252Finterior_rear_seats-1774101201807.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6604/20376604/interior_rear_seats-1774101201807.jpg not downloaded yet
2026-03-29 20:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7947/20487947/interior_front_seats-1774703876214.jpg> (referer: None)
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6604%252F20376604%252Finterior_dashboard-1774102849181.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6604/20376604/interior_dashboard-1774102849181.jpg not downloaded yet
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6604%252F20376604%252Finterior_boot-1774101200137.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6604/20376604/interior_boot-1774101200137.jpg not downloaded yet
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6604%252F20376604%252Fdocs_service_history-1774104291984.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1133fd32d819bef5caab551e2b96b7d7%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6604/20376604/docs_service_history-1774104291984.jpg?ixlib=js-3.8.0&auto=format&s=1133fd32d819bef5caab551e2b96b7d7 not downloaded yet
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6604%252F20376604%252Fwheels_front_driver-1774100996935.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6604/20376604/wheels_front_driver-1774100996935.jpg not downloaded yet
2026-03-29 20:14:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d86f90b-3db3-5c4f-90e0-9ef0e224b653 with identifier: 3181281
2026-03-29 20:14:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d86f90b-3db3-5c4f-90e0-9ef0e224b653 with scrape type 1
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9d86f90b-3db3-5c4f-90e0-9ef0e224b653
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1281%252F3181281%252Fexterior_front_driver-1774525511314.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1281/3181281/exterior_front_driver-1774525511314.jpg not downloaded yet
2026-03-29 20:14:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44c94db1-ef50-5a25-97ff-67721bcc98e5 with identifier: 20416075
2026-03-29 20:14:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44c94db1-ef50-5a25-97ff-67721bcc98e5 with scrape type 1
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 44c94db1-ef50-5a25-97ff-67721bcc98e5
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6075%252F20416075%252Fexterior_front_driver-1774706954554.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6075/20416075/exterior_front_driver-1774706954554.jpg not downloaded yet
2026-03-29 20:14:33 [motorway.uk] ERROR: Error parsing details
Traceback (most recent call last):
File "/usr/src/app/crawlers/spiders/motorway.py", line 262, in parse_details
item = self._extract_listing_item(detail_data, auction_type)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/motorway.py", line 290, in _extract_listing_item
trim = self._extract_trim(detail_data)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/motorway.py", line 476, in _extract_trim
.replace(model, "")
^^^^^^^^^^^^^^^^^^
TypeError: replace() argument 1 must be str, not None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1281%252F3181281%252Fexterior_rear_driver-1774525537164.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1281/3181281/exterior_rear_driver-1774525537164.jpg not downloaded yet
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6075%252F20416075%252Fexterior_rear_driver-1774707002095.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6075/20416075/exterior_rear_driver-1774707002095.jpg not downloaded yet
2026-03-29 20:14:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b85050>
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907b1c2d-546e-54dc-8060-5412b3b7b964/907b1c2d-546e-54dc-8060-5412b3b7b964_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7947%252F20487947%252Finterior_front_seats-1774703876214.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7947/20487947/interior_front_seats-1774703876214.jpg saved to cache
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 907b1c2d-546e-54dc-8060-5412b3b7b964
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1281%252F3181281%252Fexterior_front_passenger-1774525719207.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1281/3181281/exterior_front_passenger-1774525719207.jpg not downloaded yet
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6075%252F20416075%252Fexterior_front_passenger-1774707050768.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6075/20416075/exterior_front_passenger-1774707050768.jpg not downloaded yet
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1281%252F3181281%252Fexterior_rear_passenger-1774525670191.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1281/3181281/exterior_rear_passenger-1774525670191.jpg not downloaded yet
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6075%252F20416075%252Fexterior_rear_passenger-1774707022864.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6075/20416075/exterior_rear_passenger-1774707022864.jpg not downloaded yet
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1281%252F3181281%252Finterior_front_seats-1774779251424.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1281/3181281/interior_front_seats-1774779251424.jpg not downloaded yet
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6075%252F20416075%252Finterior_front_seats-1774708194635.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6075/20416075/interior_front_seats-1774708194635.jpg not downloaded yet
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1281%252F3181281%252Finterior_rear_seats-1774779205449.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1281/3181281/interior_rear_seats-1774779205449.jpg not downloaded yet
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6075%252F20416075%252Finterior_rear_seats-1774707854858.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6075/20416075/interior_rear_seats-1774707854858.jpg not downloaded yet
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1281%252F3181281%252Finterior_dashboard-1774779231514.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1281/3181281/interior_dashboard-1774779231514.jpg not downloaded yet
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6075%252F20416075%252Finterior_dashboard-1774708811904.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6075/20416075/interior_dashboard-1774708811904.jpg not downloaded yet
2026-03-29 20:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=828&page=23&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1281%252F3181281%252Finstrument_cluster-1774779291271.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1281/3181281/instrument_cluster-1774779291271.jpg not downloaded yet
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6075%252F20416075%252Finstrument_cluster-1774708200506.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6075/20416075/instrument_cluster-1774708200506.jpg not downloaded yet
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1281%252F3181281%252Finterior_boot-1774779234224.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1281/3181281/interior_boot-1774779234224.jpg not downloaded yet
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6075%252F20416075%252Finterior_boot-1774708018016.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6075/20416075/interior_boot-1774708018016.jpg not downloaded yet
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1281%252F3181281%252Fdocs_service_history-1774779440695.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D89485494d7c77e4dc648da887c833a6b%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1281/3181281/docs_service_history-1774779440695.jpg?ixlib=js-3.8.0&auto=format&s=89485494d7c77e4dc648da887c833a6b not downloaded yet
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6075%252F20416075%252Fdocs_service_history-1774708256137.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dca31e738fc487aa736b512fa67037787%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6075/20416075/docs_service_history-1774708256137.jpg?ixlib=js-3.8.0&auto=format&s=ca31e738fc487aa736b512fa67037787 not downloaded yet
2026-03-29 20:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6604/20376604/exterior_rear_driver-1774100946168.jpg> (referer: None)
2026-03-29 20:14:33 [motorway.uk] INFO: Found listing with ID: 20345939
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720345939%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [motorway.uk] INFO: Scrape type for 20345939: 1
2026-03-29 20:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6604/20376604/exterior_rear_passenger-1774107228661.jpg> (referer: None)
2026-03-29 20:14:33 [motorway.uk] INFO: Found listing with ID: 12444904
2026-03-29 20:14:33 [motorway.uk] INFO: Found listing with ID: 20479213
2026-03-29 20:14:33 [motorway.uk] INFO: Found listing with ID: 5678750
2026-03-29 20:14:33 [motorway.uk] INFO: Found listing with ID: 1379253
2026-03-29 20:14:33 [motorway.uk] INFO: Found listing with ID: 20147268
2026-03-29 20:14:33 [motorway.uk] INFO: Found listing with ID: 20465867
2026-03-29 20:14:33 [motorway.uk] INFO: Found listing with ID: 18276171
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718276171%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [motorway.uk] INFO: Scrape type for 18276171: 1
2026-03-29 20:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8808/15048808/interior_dashboard-1774422678455.jpg> (referer: None)
2026-03-29 20:14:33 [motorway.uk] INFO: Found listing with ID: 20490982
2026-03-29 20:14:33 [motorway.uk] INFO: Found listing with ID: 20494330
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720494330%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [motorway.uk] INFO: Scrape type for 20494330: 1
2026-03-29 20:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6604/20376604/exterior_front_passenger-1774102787653.jpg> (referer: None)
2026-03-29 20:14:33 [motorway.uk] INFO: Found listing with ID: 20486417
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486417%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [motorway.uk] INFO: Scrape type for 20486417: 1
2026-03-29 20:14:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8808/15048808/interior_rear_seats-1774422666377.jpg> (referer: None)
2026-03-29 20:14:33 [motorway.uk] INFO: Found listing with ID: 19705843
2026-03-29 20:14:33 [motorway.uk] INFO: Found listing with ID: 6409208
2026-03-29 20:14:33 [motorway.uk] INFO: Found listing with ID: 20049212
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720049212%27 HTTP/1.1" 200 None
2026-03-29 20:14:33 [motorway.uk] INFO: Scrape type for 20049212: 1
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c39310>
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71e27aaf-be75-50dd-b2a3-ca685f9a9438/71e27aaf-be75-50dd-b2a3-ca685f9a9438_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6604%252F20376604%252Fexterior_rear_driver-1774100946168.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6604/20376604/exterior_rear_driver-1774100946168.jpg saved to cache
2026-03-29 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 71e27aaf-be75-50dd-b2a3-ca685f9a9438
2026-03-29 20:14:34 [motorway.uk] INFO: Found listing with ID: 12893788
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712893788%27 HTTP/1.1" 200 None
2026-03-29 20:14:34 [motorway.uk] INFO: Scrape type for 12893788: 1
2026-03-29 20:14:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cce550>
2026-03-29 20:14:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71e27aaf-be75-50dd-b2a3-ca685f9a9438/71e27aaf-be75-50dd-b2a3-ca685f9a9438_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6604%252F20376604%252Fexterior_rear_passenger-1774107228661.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6604/20376604/exterior_rear_passenger-1774107228661.jpg saved to cache
2026-03-29 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 71e27aaf-be75-50dd-b2a3-ca685f9a9438
2026-03-29 20:14:34 [motorway.uk] INFO: Found listing with ID: 20129049
2026-03-29 20:14:34 [motorway.uk] INFO: Found listing with ID: 19812836
2026-03-29 20:14:34 [motorway.uk] INFO: Found listing with ID: 7025214
2026-03-29 20:14:34 [motorway.uk] INFO: Found listing with ID: 20458640
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720458640%27 HTTP/1.1" 200 None
2026-03-29 20:14:34 [motorway.uk] INFO: Scrape type for 20458640: 2
2026-03-29 20:14:34 [motorway.uk] INFO: Found listing with ID: 12548446
2026-03-29 20:14:34 [motorway.uk] INFO: Found listing with ID: 20453033
2026-03-29 20:14:34 [motorway.uk] INFO: Found listing with ID: 20028099
2026-03-29 20:14:34 [motorway.uk] INFO: Found listing with ID: 20414917
2026-03-29 20:14:34 [motorway.uk] INFO: Found listing with ID: 18114859
2026-03-29 20:14:34 [motorway.uk] INFO: Found listing with ID: 20498769
2026-03-29 20:14:34 [motorway.uk] INFO: Found listing with ID: 20401260
2026-03-29 20:14:34 [motorway.uk] INFO: Found listing with ID: 20421513
2026-03-29 20:14:34 [motorway.uk] INFO: Found listing with ID: 19128404
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719128404%27 HTTP/1.1" 200 None
2026-03-29 20:14:34 [motorway.uk] INFO: Scrape type for 19128404: 1
2026-03-29 20:14:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f1cc90>
2026-03-29 20:14:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dea1465-19a7-5857-a435-f19638bfdaae/5dea1465-19a7-5857-a435-f19638bfdaae_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8808%252F15048808%252Finterior_dashboard-1774422678455.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8808/15048808/interior_dashboard-1774422678455.jpg saved to cache
2026-03-29 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5dea1465-19a7-5857-a435-f19638bfdaae
2026-03-29 20:14:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f84910>
2026-03-29 20:14:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71e27aaf-be75-50dd-b2a3-ca685f9a9438/71e27aaf-be75-50dd-b2a3-ca685f9a9438_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6604%252F20376604%252Fexterior_front_passenger-1774102787653.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6604/20376604/exterior_front_passenger-1774102787653.jpg saved to cache
2026-03-29 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 71e27aaf-be75-50dd-b2a3-ca685f9a9438
2026-03-29 20:14:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ccdcd0>
2026-03-29 20:14:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dea1465-19a7-5857-a435-f19638bfdaae/5dea1465-19a7-5857-a435-f19638bfdaae_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8808%252F15048808%252Finterior_rear_seats-1774422666377.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8808/15048808/interior_rear_seats-1774422666377.jpg saved to cache
2026-03-29 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5dea1465-19a7-5857-a435-f19638bfdaae
2026-03-29 20:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20428130.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:34 [motorway.uk] INFO: Found listing with ID: 20306533
2026-03-29 20:14:34 [motorway.uk] INFO: Found listing with ID: 20304701
2026-03-29 20:14:34 [motorway.uk] INFO: Found listing with ID: 20378364
2026-03-29 20:14:34 [motorway.uk] INFO: Found listing with ID: 18272017
2026-03-29 20:14:34 [motorway.uk] INFO: Found listing with ID: 20445540
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720445540%27 HTTP/1.1" 200 None
2026-03-29 20:14:34 [motorway.uk] INFO: Scrape type for 20445540: 1
2026-03-29 20:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/7322331.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:34 [motorway.uk] INFO: Found listing with ID: 20500409
2026-03-29 20:14:34 [motorway.uk] INFO: Found listing with ID: 18253303
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718253303%27 HTTP/1.1" 200 None
2026-03-29 20:14:34 [motorway.uk] INFO: Scrape type for 18253303: 1
2026-03-29 20:14:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:34 [motorway.uk] INFO: Found listing with ID: 18656000
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718656000%27 HTTP/1.1" 200 None
2026-03-29 20:14:34 [motorway.uk] INFO: Scrape type for 18656000: 1
2026-03-29 20:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8808/15048808/instrument_cluster-1774422687083.jpg> (referer: None)
2026-03-29 20:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8808/15048808/interior_boot-1774422662507.jpg> (referer: None)
2026-03-29 20:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6075/20416075/interior_dashboard-1774708811904.jpg> (referer: None)
2026-03-29 20:14:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: accd2475-611f-5b0f-842e-df251b6ffe90 with identifier: 20428130
2026-03-29 20:14:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item accd2475-611f-5b0f-842e-df251b6ffe90 with scrape type 1
2026-03-29 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item accd2475-611f-5b0f-842e-df251b6ffe90
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8130%252F20428130%252Fexterior_front_driver-1774699259431.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8130/20428130/exterior_front_driver-1774699259431.jpg not downloaded yet
2026-03-29 20:14:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6075/20416075/exterior_front_driver-1774706954554.jpg> (referer: None)
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8130%252F20428130%252Fexterior_rear_driver-1774698776584.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8130/20428130/exterior_rear_driver-1774698776584.jpg not downloaded yet
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8130%252F20428130%252Fexterior_front_passenger-1774698776280.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8130/20428130/exterior_front_passenger-1774698776280.jpg not downloaded yet
2026-03-29 20:14:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddea6899-84df-5e92-8da2-f4e6af5a1fb9 with identifier: 7322331
2026-03-29 20:14:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddea6899-84df-5e92-8da2-f4e6af5a1fb9 with scrape type 1
2026-03-29 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ddea6899-84df-5e92-8da2-f4e6af5a1fb9
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2331%252F7322331%252Fexterior_front_driver-1774708317612.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2331/7322331/exterior_front_driver-1774708317612.jpg not downloaded yet
2026-03-29 20:14:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65857ab50>
2026-03-29 20:14:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dea1465-19a7-5857-a435-f19638bfdaae/5dea1465-19a7-5857-a435-f19638bfdaae_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8808%252F15048808%252Finstrument_cluster-1774422687083.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8808/15048808/instrument_cluster-1774422687083.jpg saved to cache
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5dea1465-19a7-5857-a435-f19638bfdaae
2026-03-29 20:14:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfc8b50>
2026-03-29 20:14:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dea1465-19a7-5857-a435-f19638bfdaae/5dea1465-19a7-5857-a435-f19638bfdaae_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8808%252F15048808%252Finterior_boot-1774422662507.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8808/15048808/interior_boot-1774422662507.jpg saved to cache
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5dea1465-19a7-5857-a435-f19638bfdaae
2026-03-29 20:14:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfc8a90>
2026-03-29 20:14:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44c94db1-ef50-5a25-97ff-67721bcc98e5/44c94db1-ef50-5a25-97ff-67721bcc98e5_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6075%252F20416075%252Finterior_dashboard-1774708811904.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6075/20416075/interior_dashboard-1774708811904.jpg saved to cache
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 44c94db1-ef50-5a25-97ff-67721bcc98e5
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8130%252F20428130%252Fexterior_rear_passenger-1774698772297.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8130/20428130/exterior_rear_passenger-1774698772297.jpg not downloaded yet
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2331%252F7322331%252Fexterior_rear_driver-1774708337141.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2331/7322331/exterior_rear_driver-1774708337141.jpg not downloaded yet
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8130%252F20428130%252Finterior_front_seats-1774705009642.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8130/20428130/interior_front_seats-1774705009642.jpg not downloaded yet
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2331%252F7322331%252Fexterior_front_passenger-1774708359098.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2331/7322331/exterior_front_passenger-1774708359098.jpg not downloaded yet
2026-03-29 20:14:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659af3d10>
2026-03-29 20:14:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44c94db1-ef50-5a25-97ff-67721bcc98e5/44c94db1-ef50-5a25-97ff-67721bcc98e5_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6075%252F20416075%252Fexterior_front_driver-1774706954554.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6075/20416075/exterior_front_driver-1774706954554.jpg saved to cache
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44c94db1-ef50-5a25-97ff-67721bcc98e5
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8130%252F20428130%252Finterior_rear_seats-1774704954962.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8130/20428130/interior_rear_seats-1774704954962.jpg not downloaded yet
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2331%252F7322331%252Fexterior_rear_passenger-1774708346169.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2331/7322331/exterior_rear_passenger-1774708346169.jpg not downloaded yet
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8130%252F20428130%252Finterior_dashboard-1774712273687.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8130/20428130/interior_dashboard-1774712273687.jpg not downloaded yet
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2331%252F7322331%252Finterior_front_seats-1774708756308.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2331/7322331/interior_front_seats-1774708756308.jpg not downloaded yet
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8130%252F20428130%252Finstrument_cluster-1774704688242.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8130/20428130/instrument_cluster-1774704688242.jpg not downloaded yet
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2331%252F7322331%252Finterior_rear_seats-1774708770461.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2331/7322331/interior_rear_seats-1774708770461.jpg not downloaded yet
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8130%252F20428130%252Finterior_boot-1774704878407.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8130/20428130/interior_boot-1774704878407.jpg not downloaded yet
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2331%252F7322331%252Finterior_dashboard-1774708791057.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2331/7322331/interior_dashboard-1774708791057.jpg not downloaded yet
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8130%252F20428130%252Fdocs_service_history-1774707740692.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df71debfb95ecef5488d291f3e27e48c8%27 HTTP/1.1" 200 None
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8130/20428130/docs_service_history-1774707740692.jpg?ixlib=js-3.8.0&auto=format&s=f71debfb95ecef5488d291f3e27e48c8 not downloaded yet
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2331%252F7322331%252Finstrument_cluster-1774708866525.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2331/7322331/instrument_cluster-1774708866525.jpg not downloaded yet
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2331%252F7322331%252Finterior_boot-1774708802596.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2331/7322331/interior_boot-1774708802596.jpg not downloaded yet
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2331%252F7322331%252Fdocs_service_history-1774708977474.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D96d4cc0e546cd5a9722310c3931ccf21%27 HTTP/1.1" 200 None
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2331/7322331/docs_service_history-1774708977474.jpg?ixlib=js-3.8.0&auto=format&s=96d4cc0e546cd5a9722310c3931ccf21 not downloaded yet
2026-03-29 20:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8130/20428130/exterior_front_passenger-1774698776280.jpg> (referer: None)
2026-03-29 20:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8130/20428130/exterior_rear_driver-1774698776584.jpg> (referer: None)
2026-03-29 20:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8130/20428130/exterior_rear_passenger-1774698772297.jpg> (referer: None)
2026-03-29 20:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6075/20416075/interior_boot-1774708018016.jpg> (referer: None)
2026-03-29 20:14:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2331/7322331/exterior_front_driver-1774708317612.jpg> (referer: None)
2026-03-29 20:14:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65813f710>
2026-03-29 20:14:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_accd2475-611f-5b0f-842e-df251b6ffe90/accd2475-611f-5b0f-842e-df251b6ffe90_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8130%252F20428130%252Fexterior_front_passenger-1774698776280.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8130/20428130/exterior_front_passenger-1774698776280.jpg saved to cache
2026-03-29 20:14:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item accd2475-611f-5b0f-842e-df251b6ffe90
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ec96d0>
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_accd2475-611f-5b0f-842e-df251b6ffe90/accd2475-611f-5b0f-842e-df251b6ffe90_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8130%252F20428130%252Fexterior_rear_driver-1774698776584.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8130/20428130/exterior_rear_driver-1774698776584.jpg saved to cache
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item accd2475-611f-5b0f-842e-df251b6ffe90
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659075e10>
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_accd2475-611f-5b0f-842e-df251b6ffe90/accd2475-611f-5b0f-842e-df251b6ffe90_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8130%252F20428130%252Fexterior_rear_passenger-1774698772297.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8130/20428130/exterior_rear_passenger-1774698772297.jpg saved to cache
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item accd2475-611f-5b0f-842e-df251b6ffe90
2026-03-29 20:14:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a43010>
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44c94db1-ef50-5a25-97ff-67721bcc98e5/44c94db1-ef50-5a25-97ff-67721bcc98e5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6075%252F20416075%252Finterior_boot-1774708018016.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6075/20416075/interior_boot-1774708018016.jpg saved to cache
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 44c94db1-ef50-5a25-97ff-67721bcc98e5
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e96850>
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddea6899-84df-5e92-8da2-f4e6af5a1fb9/ddea6899-84df-5e92-8da2-f4e6af5a1fb9_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2331%252F7322331%252Fexterior_front_driver-1774708317612.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2331/7322331/exterior_front_driver-1774708317612.jpg saved to cache
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ddea6899-84df-5e92-8da2-f4e6af5a1fb9
2026-03-29 20:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20376881.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2331/7322331/docs_service_history-1774708977474.jpg?ixlib=js-3.8.0&auto=format&s=96d4cc0e546cd5a9722310c3931ccf21> (referer: None)
2026-03-29 20:14:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2331/7322331/instrument_cluster-1774708866525.jpg> (referer: None)
2026-03-29 20:14:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3e1a962-a26e-591b-8db6-fbebcd9e5b37 with identifier: 20376881
2026-03-29 20:14:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3e1a962-a26e-591b-8db6-fbebcd9e5b37 with scrape type 1
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d3e1a962-a26e-591b-8db6-fbebcd9e5b37
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6881%252F20376881%252Fexterior_front_driver-1774635040386.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6881/20376881/exterior_front_driver-1774635040386.jpg not downloaded yet
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6881%252F20376881%252Fexterior_rear_driver-1774635033202.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6881/20376881/exterior_rear_driver-1774635033202.jpg not downloaded yet
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6881%252F20376881%252Fexterior_front_passenger-1774635038704.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6881/20376881/exterior_front_passenger-1774635038704.jpg not downloaded yet
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a42050>
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddea6899-84df-5e92-8da2-f4e6af5a1fb9/ddea6899-84df-5e92-8da2-f4e6af5a1fb9_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2331%252F7322331%252Fdocs_service_history-1774708977474.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D96d4cc0e546cd5a9722310c3931ccf21') HTTP/1.1" 204 0
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2331/7322331/docs_service_history-1774708977474.jpg?ixlib=js-3.8.0&auto=format&s=96d4cc0e546cd5a9722310c3931ccf21 saved to cache
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ddea6899-84df-5e92-8da2-f4e6af5a1fb9
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6881%252F20376881%252Fexterior_rear_passenger-1774635027903.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6881/20376881/exterior_rear_passenger-1774635027903.jpg not downloaded yet
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6881%252F20376881%252Finterior_front_seats-1774637867784.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6881/20376881/interior_front_seats-1774637867784.jpg not downloaded yet
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6881%252F20376881%252Finterior_rear_seats-1774636175518.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6881/20376881/interior_rear_seats-1774636175518.jpg not downloaded yet
2026-03-29 20:14:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cc6cd0>
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddea6899-84df-5e92-8da2-f4e6af5a1fb9/ddea6899-84df-5e92-8da2-f4e6af5a1fb9_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2331%252F7322331%252Finstrument_cluster-1774708866525.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2331/7322331/instrument_cluster-1774708866525.jpg saved to cache
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ddea6899-84df-5e92-8da2-f4e6af5a1fb9
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6881%252F20376881%252Finterior_dashboard-1774636199037.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6881/20376881/interior_dashboard-1774636199037.jpg not downloaded yet
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6881%252F20376881%252Finstrument_cluster-1774636219051.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6881/20376881/instrument_cluster-1774636219051.jpg not downloaded yet
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6881%252F20376881%252Finterior_boot-1774636183121.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6881/20376881/interior_boot-1774636183121.jpg not downloaded yet
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6881%252F20376881%252Fdamage_scratches-1774635104511.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6881/20376881/damage_scratches-1774635104511.jpg not downloaded yet
2026-03-29 20:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2331/7322331/interior_boot-1774708802596.jpg> (referer: None)
2026-03-29 20:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8130/20428130/interior_boot-1774704878407.jpg> (referer: None)
2026-03-29 20:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8130/20428130/instrument_cluster-1774704688242.jpg> (referer: None)
2026-03-29 20:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2331/7322331/interior_dashboard-1774708791057.jpg> (referer: None)
2026-03-29 20:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8130/20428130/docs_service_history-1774707740692.jpg?ixlib=js-3.8.0&auto=format&s=f71debfb95ecef5488d291f3e27e48c8> (referer: None)
2026-03-29 20:14:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2331/7322331/interior_rear_seats-1774708770461.jpg> (referer: None)
2026-03-29 20:14:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a77650>
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddea6899-84df-5e92-8da2-f4e6af5a1fb9/ddea6899-84df-5e92-8da2-f4e6af5a1fb9_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2331%252F7322331%252Finterior_boot-1774708802596.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2331/7322331/interior_boot-1774708802596.jpg saved to cache
2026-03-29 20:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ddea6899-84df-5e92-8da2-f4e6af5a1fb9
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65882f150>
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_accd2475-611f-5b0f-842e-df251b6ffe90/accd2475-611f-5b0f-842e-df251b6ffe90_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8130%252F20428130%252Finterior_boot-1774704878407.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8130/20428130/interior_boot-1774704878407.jpg saved to cache
2026-03-29 20:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item accd2475-611f-5b0f-842e-df251b6ffe90
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65aaf9650>
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_accd2475-611f-5b0f-842e-df251b6ffe90/accd2475-611f-5b0f-842e-df251b6ffe90_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8130%252F20428130%252Finstrument_cluster-1774704688242.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8130/20428130/instrument_cluster-1774704688242.jpg saved to cache
2026-03-29 20:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item accd2475-611f-5b0f-842e-df251b6ffe90
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b54410>
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddea6899-84df-5e92-8da2-f4e6af5a1fb9/ddea6899-84df-5e92-8da2-f4e6af5a1fb9_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2331%252F7322331%252Finterior_dashboard-1774708791057.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2331/7322331/interior_dashboard-1774708791057.jpg saved to cache
2026-03-29 20:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ddea6899-84df-5e92-8da2-f4e6af5a1fb9
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65869a890>
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_accd2475-611f-5b0f-842e-df251b6ffe90/accd2475-611f-5b0f-842e-df251b6ffe90_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8130%252F20428130%252Fdocs_service_history-1774707740692.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df71debfb95ecef5488d291f3e27e48c8') HTTP/1.1" 204 0
2026-03-29 20:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8130/20428130/docs_service_history-1774707740692.jpg?ixlib=js-3.8.0&auto=format&s=f71debfb95ecef5488d291f3e27e48c8 saved to cache
2026-03-29 20:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item accd2475-611f-5b0f-842e-df251b6ffe90
2026-03-29 20:14:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65882f990>
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddea6899-84df-5e92-8da2-f4e6af5a1fb9/ddea6899-84df-5e92-8da2-f4e6af5a1fb9_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2331%252F7322331%252Finterior_rear_seats-1774708770461.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2331/7322331/interior_rear_seats-1774708770461.jpg saved to cache
2026-03-29 20:14:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ddea6899-84df-5e92-8da2-f4e6af5a1fb9
2026-03-29 20:14:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20489344.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20458640.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8455c7c5-e416-55d2-aac4-7ec1262d55d5 with identifier: 20489344
2026-03-29 20:14:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8455c7c5-e416-55d2-aac4-7ec1262d55d5 with scrape type 1
2026-03-29 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8455c7c5-e416-55d2-aac4-7ec1262d55d5
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9344%252F20489344%252Fexterior_front_driver-1774710702550.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9344/20489344/exterior_front_driver-1774710702550.jpg not downloaded yet
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9344%252F20489344%252Fexterior_rear_driver-1774707395990.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9344/20489344/exterior_rear_driver-1774707395990.jpg not downloaded yet
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9344%252F20489344%252Fexterior_front_passenger-1774710704761.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9344/20489344/exterior_front_passenger-1774710704761.jpg not downloaded yet
2026-03-29 20:14:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d61e927-0a98-5a4f-ad61-95b3b7e57096 with identifier: 20458640
2026-03-29 20:14:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d61e927-0a98-5a4f-ad61-95b3b7e57096 with scrape type 2
2026-03-29 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d61e927-0a98-5a4f-ad61-95b3b7e57096 with scrape type 2
2026-03-29 20:14:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 0d61e927-0a98-5a4f-ad61-95b3b7e57096, identifier: 20458640
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9344%252F20489344%252Fexterior_rear_passenger-1774710705596.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9344/20489344/exterior_rear_passenger-1774710705596.jpg not downloaded yet
2026-03-29 20:14:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 0d61e927-0a98-5a4f-ad61-95b3b7e57096 with identifier: 20458640
2026-03-29 20:14:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 0d61e927-0a98-5a4f-ad61-95b3b7e57096 with identifier: 20458640
2026-03-29 20:14:38 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 0d61e927-0a98-5a4f-ad61-95b3b7e57096 with identifier: 20458640 to the API
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20458640.json>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '0d61e927-0a98-5a4f-ad61-95b3b7e57096',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'BK65 ZFM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20458640',
'listing': 'auction',
'location': 'Greater London Greenford',
'make': 'Nissan',
'model': 'Micra',
'odometer': 15217,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 3188,
'price_includes_vat': False,
'registration_date': '2015-09-24',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Micra Visia',
'transmission': 'manual',
'trim': 'Visia',
'vin': 'MDHFBUK13U0841102',
'year': 2015}
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720458640%27 HTTP/1.1" 200 None
2026-03-29 20:14:38 [motorway.uk] INFO: Saving data for 20458640: {'auction_closing_time': 1774884600.0, 'created_time': 1774642447.722844, 'last_price_update_time': 1774815278.914872}
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20458640') HTTP/1.1" 204 0
2026-03-29 20:14:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20445540.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9344%252F20489344%252Finterior_front_seats-1774711948758.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9344/20489344/interior_front_seats-1774711948758.jpg not downloaded yet
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9344%252F20489344%252Finterior_rear_seats-1774711603018.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9344/20489344/interior_rear_seats-1774711603018.jpg not downloaded yet
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9344%252F20489344%252Finterior_dashboard-1774711628772.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9344/20489344/interior_dashboard-1774711628772.jpg not downloaded yet
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9344%252F20489344%252Finstrument_cluster-1774711591249.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9344/20489344/instrument_cluster-1774711591249.jpg not downloaded yet
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9344%252F20489344%252Finterior_boot-1774711605616.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9344/20489344/interior_boot-1774711605616.jpg not downloaded yet
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9344%252F20489344%252Fdocs_service_history-1774712703557.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcb995dca97480e98eb087b55dee6f45f%27 HTTP/1.1" 200 None
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9344/20489344/docs_service_history-1774712703557.jpg?ixlib=js-3.8.0&auto=format&s=cb995dca97480e98eb087b55dee6f45f not downloaded yet
2026-03-29 20:14:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6881/20376881/exterior_rear_passenger-1774635027903.jpg> (referer: None)
2026-03-29 20:14:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24ae8235-3504-5922-80d4-3e24029e22fb with identifier: 20445540
2026-03-29 20:14:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24ae8235-3504-5922-80d4-3e24029e22fb with scrape type 1
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 24ae8235-3504-5922-80d4-3e24029e22fb
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5540%252F20445540%252Fexterior_front_driver-1774697312236.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5540/20445540/exterior_front_driver-1774697312236.jpg not downloaded yet
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5540%252F20445540%252Fexterior_rear_driver-1774697356710.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5540/20445540/exterior_rear_driver-1774697356710.jpg not downloaded yet
2026-03-29 20:14:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20165932.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6881/20376881/exterior_front_passenger-1774635038704.jpg> (referer: None)
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5540%252F20445540%252Fexterior_front_passenger-1774697381367.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5540/20445540/exterior_front_passenger-1774697381367.jpg not downloaded yet
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5540%252F20445540%252Fexterior_rear_passenger-1774697355651.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5540/20445540/exterior_rear_passenger-1774697355651.jpg not downloaded yet
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5540%252F20445540%252Finterior_front_seats-1774698114937.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5540/20445540/interior_front_seats-1774698114937.jpg not downloaded yet
2026-03-29 20:14:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e4ff90>
2026-03-29 20:14:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3e1a962-a26e-591b-8db6-fbebcd9e5b37/d3e1a962-a26e-591b-8db6-fbebcd9e5b37_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6881%252F20376881%252Fexterior_rear_passenger-1774635027903.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6881/20376881/exterior_rear_passenger-1774635027903.jpg saved to cache
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d3e1a962-a26e-591b-8db6-fbebcd9e5b37
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5540%252F20445540%252Finterior_rear_seats-1774698158234.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5540/20445540/interior_rear_seats-1774698158234.jpg not downloaded yet
2026-03-29 20:14:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9344/20489344/exterior_rear_passenger-1774710705596.jpg> (referer: None)
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5540%252F20445540%252Finterior_dashboard-1774698190205.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5540/20445540/interior_dashboard-1774698190205.jpg not downloaded yet
2026-03-29 20:14:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83870671-ace1-5314-ad55-d21c015683b3 with identifier: 20165932
2026-03-29 20:14:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83870671-ace1-5314-ad55-d21c015683b3 with scrape type 1
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 83870671-ace1-5314-ad55-d21c015683b3
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5932%252F20165932%252Fexterior_front_driver-1772971961234.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5932/20165932/exterior_front_driver-1772971961234.jpg already downloaded
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5932%252F20165932%252Fexterior_rear_driver-1772971889079.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5932/20165932/exterior_rear_driver-1772971889079.jpg already downloaded
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5932%252F20165932%252Fexterior_front_passenger-1772971928230.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5932/20165932/exterior_front_passenger-1772971928230.jpg already downloaded
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5932%252F20165932%252Fexterior_rear_passenger-1772971899989.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5932/20165932/exterior_rear_passenger-1772971899989.jpg already downloaded
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5932%252F20165932%252Finterior_front_seats-1772977679516.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5932/20165932/interior_front_seats-1772977679516.jpg already downloaded
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5932%252F20165932%252Finterior_rear_seats-1772977093166.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5932/20165932/interior_rear_seats-1772977093166.jpg already downloaded
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5932%252F20165932%252Finterior_dashboard-1772977132378.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5932/20165932/interior_dashboard-1772977132378.jpg already downloaded
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5932%252F20165932%252Finstrument_cluster-1772977093636.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5932/20165932/instrument_cluster-1772977093636.jpg already downloaded
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5932%252F20165932%252Finterior_boot-1772977630812.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5932/20165932/interior_boot-1772977630812.jpg already downloaded
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5932%252F20165932%252Fdocs_service_history-1772981106246.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd1fd430c5b66eb17aa7ff625d231640e%27 HTTP/1.1" 200 None
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5932/20165932/docs_service_history-1772981106246.jpg?ixlib=js-3.8.0&auto=format&s=d1fd430c5b66eb17aa7ff625d231640e already downloaded
2026-03-29 20:14:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 83870671-ace1-5314-ad55-d21c015683b3, identifier: 20165932
2026-03-29 20:14:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658edae50>
2026-03-29 20:14:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3e1a962-a26e-591b-8db6-fbebcd9e5b37/d3e1a962-a26e-591b-8db6-fbebcd9e5b37_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6881%252F20376881%252Fexterior_front_passenger-1774635038704.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6881/20376881/exterior_front_passenger-1774635038704.jpg saved to cache
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d3e1a962-a26e-591b-8db6-fbebcd9e5b37
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5540%252F20445540%252Finstrument_cluster-1774698215609.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5540/20445540/instrument_cluster-1774698215609.jpg not downloaded yet
2026-03-29 20:14:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 83870671-ace1-5314-ad55-d21c015683b3 with identifier: 20165932
2026-03-29 20:14:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 83870671-ace1-5314-ad55-d21c015683b3 with identifier: 20165932
2026-03-29 20:14:39 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 83870671-ace1-5314-ad55-d21c015683b3 with identifier: 20165932 to the API
2026-03-29 20:14:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20165932.json>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.8L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '83870671-ace1-5314-ad55-d21c015683b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FH68 KPR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20165932',
'listing': 'auction',
'location': 'South Yorkshire Rotherham',
'make': 'Toyota',
'model': 'Prius',
'odometer': 24000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/5932/20165932/exterior_front_driver-1772971961234.jpg',
'https://motorway-photos-redacted.imgix.net/5932/20165932/exterior_rear_driver-1772971889079.jpg',
'https://motorway-photos-redacted.imgix.net/5932/20165932/exterior_front_passenger-1772971928230.jpg',
'https://motorway-photos-redacted.imgix.net/5932/20165932/exterior_rear_passenger-1772971899989.jpg',
'https://motorway-photos.imgix.net/5932/20165932/interior_front_seats-1772977679516.jpg',
'https://motorway-photos.imgix.net/5932/20165932/interior_rear_seats-1772977093166.jpg',
'https://motorway-photos-redacted.imgix.net/5932/20165932/interior_dashboard-1772977132378.jpg',
'https://motorway-photos-redacted.imgix.net/5932/20165932/instrument_cluster-1772977093636.jpg',
'https://motorway-photos.imgix.net/5932/20165932/interior_boot-1772977630812.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/oriented/5932/20165932/docs_service_history-1772981106246.jpg?ixlib=js-3.8.0&auto=format&s=d1fd430c5b66eb17aa7ff625d231640e'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83870671-ace1-5314-ad55-d21c015683b3/83870671-ace1-5314-ad55-d21c015683b3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1739789,
'Height': 2992,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5932/20165932/exterior_front_driver-1772971961234.jpg',
'Width': 3989},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83870671-ace1-5314-ad55-d21c015683b3/83870671-ace1-5314-ad55-d21c015683b3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1642620,
'Height': 2984,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5932/20165932/exterior_rear_driver-1772971889079.jpg',
'Width': 3979},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83870671-ace1-5314-ad55-d21c015683b3/83870671-ace1-5314-ad55-d21c015683b3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1748007,
'Height': 2975,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5932/20165932/exterior_front_passenger-1772971928230.jpg',
'Width': 3966},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83870671-ace1-5314-ad55-d21c015683b3/83870671-ace1-5314-ad55-d21c015683b3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1412591,
'Height': 2772,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5932/20165932/exterior_rear_passenger-1772971899989.jpg',
'Width': 3696},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83870671-ace1-5314-ad55-d21c015683b3/83870671-ace1-5314-ad55-d21c015683b3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3280049,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5932/20165932/interior_front_seats-1772977679516.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83870671-ace1-5314-ad55-d21c015683b3/83870671-ace1-5314-ad55-d21c015683b3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2554784,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5932/20165932/interior_rear_seats-1772977093166.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83870671-ace1-5314-ad55-d21c015683b3/83870671-ace1-5314-ad55-d21c015683b3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2540129,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5932/20165932/interior_dashboard-1772977132378.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83870671-ace1-5314-ad55-d21c015683b3/83870671-ace1-5314-ad55-d21c015683b3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2317144,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5932/20165932/instrument_cluster-1772977093636.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83870671-ace1-5314-ad55-d21c015683b3/83870671-ace1-5314-ad55-d21c015683b3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4089480,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5932/20165932/interior_boot-1772977630812.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83870671-ace1-5314-ad55-d21c015683b3/83870671-ace1-5314-ad55-d21c015683b3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7411542,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5932/20165932/docs_service_history-1772981106246.jpg?ixlib=js-3.8.0&auto=format&s=d1fd430c5b66eb17aa7ff625d231640e',
'Width': 4032}],
'price': 13016,
'price_includes_vat': False,
'registration_date': '2019-01-15',
'seats_number': None,
'seller_name': None,
'title': 'Toyota Prius Business ED + VVT-i CVT',
'transmission': 'automatic',
'trim': 'Business ED + VVT-i CVT',
'vin': 'JTDKB3FU303081430',
'year': 2019}
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720165932%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [motorway.uk] INFO: Saving data for 20165932: {'created_time': 1774815280.261525, 'last_price_update_time': 1774815280.261535, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20165932') HTTP/1.1" 204 0
2026-03-29 20:14:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6881/20376881/interior_rear_seats-1774636175518.jpg> (referer: None)
2026-03-29 20:14:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6881/20376881/interior_front_seats-1774637867784.jpg> (referer: None)
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5540%252F20445540%252Finterior_boot-1774700198829.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5540/20445540/interior_boot-1774700198829.jpg not downloaded yet
2026-03-29 20:14:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13723227.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5540%252F20445540%252Fdocs_service_history-1774698522308.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2b8f5e785824ee4e8f8a6c37ea39595a%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5540/20445540/docs_service_history-1774698522308.jpg?ixlib=js-3.8.0&auto=format&s=2b8f5e785824ee4e8f8a6c37ea39595a not downloaded yet
2026-03-29 20:14:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599a46d0>
2026-03-29 20:14:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8455c7c5-e416-55d2-aac4-7ec1262d55d5/8455c7c5-e416-55d2-aac4-7ec1262d55d5_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9344%252F20489344%252Fexterior_rear_passenger-1774710705596.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9344/20489344/exterior_rear_passenger-1774710705596.jpg saved to cache
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8455c7c5-e416-55d2-aac4-7ec1262d55d5
2026-03-29 20:14:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599a4050>
2026-03-29 20:14:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3e1a962-a26e-591b-8db6-fbebcd9e5b37/d3e1a962-a26e-591b-8db6-fbebcd9e5b37_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6881%252F20376881%252Finterior_rear_seats-1774636175518.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6881/20376881/interior_rear_seats-1774636175518.jpg saved to cache
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d3e1a962-a26e-591b-8db6-fbebcd9e5b37
2026-03-29 20:14:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b15990>
2026-03-29 20:14:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3e1a962-a26e-591b-8db6-fbebcd9e5b37/d3e1a962-a26e-591b-8db6-fbebcd9e5b37_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6881%252F20376881%252Finterior_front_seats-1774637867784.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6881/20376881/interior_front_seats-1774637867784.jpg saved to cache
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d3e1a962-a26e-591b-8db6-fbebcd9e5b37
2026-03-29 20:14:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60ac4124-3917-5abb-88b0-032315406d9a with identifier: 13723227
2026-03-29 20:14:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60ac4124-3917-5abb-88b0-032315406d9a with scrape type 1
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 60ac4124-3917-5abb-88b0-032315406d9a
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3227%252F13723227%252Fexterior_front_driver-1768835926611.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3227/13723227/exterior_front_driver-1768835926611.jpg not downloaded yet
2026-03-29 20:14:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6881/20376881/interior_dashboard-1774636199037.jpg> (referer: None)
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3227%252F13723227%252Fexterior_rear_driver-1768835924549.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3227/13723227/exterior_rear_driver-1768835924549.jpg not downloaded yet
2026-03-29 20:14:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6881/20376881/damage_scratches-1774635104511.jpg> (referer: None)
2026-03-29 20:14:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5540/20445540/exterior_front_driver-1774697312236.jpg> (referer: None)
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3227%252F13723227%252Fexterior_front_passenger-1768835939605.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3227/13723227/exterior_front_passenger-1768835939605.jpg not downloaded yet
2026-03-29 20:14:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6881/20376881/interior_boot-1774636183121.jpg> (referer: None)
2026-03-29 20:14:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6881/20376881/instrument_cluster-1774636219051.jpg> (referer: None)
2026-03-29 20:14:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9344/20489344/interior_boot-1774711605616.jpg> (referer: None)
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3227%252F13723227%252Fexterior_rear_passenger-1768835933005.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3227/13723227/exterior_rear_passenger-1768835933005.jpg not downloaded yet
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3227%252F13723227%252Finterior_front_seats-1768836176438.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3227/13723227/interior_front_seats-1768836176438.jpg not downloaded yet
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3227%252F13723227%252Finterior_rear_seats-1768836183989.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3227/13723227/interior_rear_seats-1768836183989.jpg not downloaded yet
2026-03-29 20:14:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfc56d0>
2026-03-29 20:14:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3e1a962-a26e-591b-8db6-fbebcd9e5b37/d3e1a962-a26e-591b-8db6-fbebcd9e5b37_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6881%252F20376881%252Finterior_dashboard-1774636199037.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6881/20376881/interior_dashboard-1774636199037.jpg saved to cache
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d3e1a962-a26e-591b-8db6-fbebcd9e5b37
2026-03-29 20:14:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5540/20445540/exterior_rear_driver-1774697356710.jpg> (referer: None)
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3227%252F13723227%252Finterior_dashboard-1774784294974.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3227/13723227/interior_dashboard-1774784294974.jpg not downloaded yet
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a6edd0>
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3e1a962-a26e-591b-8db6-fbebcd9e5b37/d3e1a962-a26e-591b-8db6-fbebcd9e5b37_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6881%252F20376881%252Fdamage_scratches-1774635104511.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6881/20376881/damage_scratches-1774635104511.jpg saved to cache
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d3e1a962-a26e-591b-8db6-fbebcd9e5b37
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a80690>
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ae8235-3504-5922-80d4-3e24029e22fb/24ae8235-3504-5922-80d4-3e24029e22fb_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5540%252F20445540%252Fexterior_front_driver-1774697312236.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5540/20445540/exterior_front_driver-1774697312236.jpg saved to cache
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 24ae8235-3504-5922-80d4-3e24029e22fb
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3227%252F13723227%252Finstrument_cluster-1768836162006.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3227/13723227/instrument_cluster-1768836162006.jpg not downloaded yet
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3227%252F13723227%252Finterior_boot-1768836205190.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3227/13723227/interior_boot-1768836205190.jpg not downloaded yet
2026-03-29 20:14:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/12893788.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a82110>
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3e1a962-a26e-591b-8db6-fbebcd9e5b37/d3e1a962-a26e-591b-8db6-fbebcd9e5b37_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6881%252F20376881%252Finterior_boot-1774636183121.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6881/20376881/interior_boot-1774636183121.jpg saved to cache
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d3e1a962-a26e-591b-8db6-fbebcd9e5b37
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e3c210>
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3e1a962-a26e-591b-8db6-fbebcd9e5b37/d3e1a962-a26e-591b-8db6-fbebcd9e5b37_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6881%252F20376881%252Finstrument_cluster-1774636219051.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6881/20376881/instrument_cluster-1774636219051.jpg saved to cache
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d3e1a962-a26e-591b-8db6-fbebcd9e5b37
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e3ee90>
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8455c7c5-e416-55d2-aac4-7ec1262d55d5/8455c7c5-e416-55d2-aac4-7ec1262d55d5_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9344%252F20489344%252Finterior_boot-1774711605616.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9344/20489344/interior_boot-1774711605616.jpg saved to cache
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8455c7c5-e416-55d2-aac4-7ec1262d55d5
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b62150>
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ae8235-3504-5922-80d4-3e24029e22fb/24ae8235-3504-5922-80d4-3e24029e22fb_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5540%252F20445540%252Fexterior_rear_driver-1774697356710.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5540/20445540/exterior_rear_driver-1774697356710.jpg saved to cache
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 24ae8235-3504-5922-80d4-3e24029e22fb
2026-03-29 20:14:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20486417.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3227%252F13723227%252Fdocs_service_history-1774783687279.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcf55e632cf34da4bfd800807469042d0%27 HTTP/1.1" 200 None
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3227/13723227/docs_service_history-1774783687279.jpg?ixlib=js-3.8.0&auto=format&s=cf55e632cf34da4bfd800807469042d0 not downloaded yet
2026-03-29 20:14:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28ef423c-8527-588b-a0d2-8e08c906acd4 with identifier: 12893788
2026-03-29 20:14:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28ef423c-8527-588b-a0d2-8e08c906acd4 with scrape type 1
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 28ef423c-8527-588b-a0d2-8e08c906acd4
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3788%252F12893788%252Fexterior_front_driver-1774170909057.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3788/12893788/exterior_front_driver-1774170909057.jpg not downloaded yet
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3788%252F12893788%252Fexterior_rear_driver-1774170913897.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3788/12893788/exterior_rear_driver-1774170913897.jpg not downloaded yet
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3788%252F12893788%252Fexterior_front_passenger-1774170941993.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3788/12893788/exterior_front_passenger-1774170941993.jpg not downloaded yet
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3788%252F12893788%252Fexterior_rear_passenger-1774170944217.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3788/12893788/exterior_rear_passenger-1774170944217.jpg not downloaded yet
2026-03-29 20:14:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd06236a-ea54-53bc-8a2c-a8dc5b77d91e with identifier: 20486417
2026-03-29 20:14:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd06236a-ea54-53bc-8a2c-a8dc5b77d91e with scrape type 1
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bd06236a-ea54-53bc-8a2c-a8dc5b77d91e
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6417%252F20486417%252Fexterior_front_driver-1774699765719.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6417/20486417/exterior_front_driver-1774699765719.jpg not downloaded yet
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3788%252F12893788%252Finterior_front_seats-1774171365088.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3788/12893788/interior_front_seats-1774171365088.jpg not downloaded yet
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6417%252F20486417%252Fexterior_rear_driver-1774697894815.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6417/20486417/exterior_rear_driver-1774697894815.jpg not downloaded yet
2026-03-29 20:14:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20281844.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3788%252F12893788%252Finterior_rear_seats-1774171396045.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3788/12893788/interior_rear_seats-1774171396045.jpg not downloaded yet
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6417%252F20486417%252Fexterior_front_passenger-1774697916503.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6417/20486417/exterior_front_passenger-1774697916503.jpg not downloaded yet
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3788%252F12893788%252Finterior_dashboard-1774171421956.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3788/12893788/interior_dashboard-1774171421956.jpg not downloaded yet
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6417%252F20486417%252Fexterior_rear_passenger-1774697902525.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6417/20486417/exterior_rear_passenger-1774697902525.jpg not downloaded yet
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3788%252F12893788%252Finstrument_cluster-1774171464994.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3788/12893788/instrument_cluster-1774171464994.jpg not downloaded yet
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6417%252F20486417%252Finterior_front_seats-1774699158508.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6417/20486417/interior_front_seats-1774699158508.jpg not downloaded yet
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3788%252F12893788%252Finterior_boot-1774171427263.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3788/12893788/interior_boot-1774171427263.jpg not downloaded yet
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6417%252F20486417%252Finterior_rear_seats-1774699175049.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6417/20486417/interior_rear_seats-1774699175049.jpg not downloaded yet
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3788%252F12893788%252Fdamage_scratches-1774170997303.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3788/12893788/damage_scratches-1774170997303.jpg not downloaded yet
2026-03-29 20:14:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bba66cab-b27a-52d1-a7c4-1eac7daf8645 with identifier: 20281844
2026-03-29 20:14:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bba66cab-b27a-52d1-a7c4-1eac7daf8645 with scrape type 1
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bba66cab-b27a-52d1-a7c4-1eac7daf8645
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1844%252F20281844%252Fexterior_front_driver-1774690515951.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1844/20281844/exterior_front_driver-1774690515951.jpg not downloaded yet
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6417%252F20486417%252Finterior_dashboard-1774706921287.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6417/20486417/interior_dashboard-1774706921287.jpg not downloaded yet
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1844%252F20281844%252Fexterior_rear_driver-1773747859187.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1844/20281844/exterior_rear_driver-1773747859187.jpg already downloaded
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1844%252F20281844%252Fexterior_front_passenger-1773747749986.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1844/20281844/exterior_front_passenger-1773747749986.jpg already downloaded
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1844%252F20281844%252Fexterior_rear_passenger-1773747869726.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1844/20281844/exterior_rear_passenger-1773747869726.jpg already downloaded
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1844%252F20281844%252Finterior_front_seats-1773748333315.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1844/20281844/interior_front_seats-1773748333315.jpg already downloaded
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1844%252F20281844%252Finterior_rear_seats-1773748345398.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1844/20281844/interior_rear_seats-1773748345398.jpg already downloaded
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1844%252F20281844%252Finterior_dashboard-1773748367668.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1844/20281844/interior_dashboard-1773748367668.jpg already downloaded
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1844%252F20281844%252Finstrument_cluster-1773748443100.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1844/20281844/instrument_cluster-1773748443100.jpg already downloaded
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1844%252F20281844%252Finterior_boot-1773748427155.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1844/20281844/interior_boot-1773748427155.jpg already downloaded
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1844%252F20281844%252Fdocs_service_history-1774690494599.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9abdd2356812dec5b99f3ba0e61deca0%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1844/20281844/docs_service_history-1774690494599.jpg?ixlib=js-3.8.0&auto=format&s=9abdd2356812dec5b99f3ba0e61deca0 not downloaded yet
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6417%252F20486417%252Finstrument_cluster-1774706869934.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6417/20486417/instrument_cluster-1774706869934.jpg not downloaded yet
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6417%252F20486417%252Finterior_boot-1774699214340.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6417/20486417/interior_boot-1774699214340.jpg not downloaded yet
2026-03-29 20:14:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5540/20445540/docs_service_history-1774698522308.jpg?ixlib=js-3.8.0&auto=format&s=2b8f5e785824ee4e8f8a6c37ea39595a> (referer: None)
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6417%252F20486417%252Fdocs_service_history-1774699380383.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D90b137b7c98c7c444c118c3a9a2e91e2%27 HTTP/1.1" 200 None
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6417/20486417/docs_service_history-1774699380383.jpg?ixlib=js-3.8.0&auto=format&s=90b137b7c98c7c444c118c3a9a2e91e2 not downloaded yet
2026-03-29 20:14:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3227/13723227/exterior_front_passenger-1768835939605.jpg> (referer: None)
2026-03-29 20:14:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3227/13723227/exterior_rear_driver-1768835924549.jpg> (referer: None)
2026-03-29 20:14:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3227/13723227/exterior_front_driver-1768835926611.jpg> (referer: None)
2026-03-29 20:14:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3227/13723227/exterior_rear_passenger-1768835933005.jpg> (referer: None)
2026-03-29 20:14:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5540/20445540/instrument_cluster-1774698215609.jpg> (referer: None)
2026-03-29 20:14:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6417/20486417/exterior_rear_driver-1774697894815.jpg> (referer: None)
2026-03-29 20:14:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5540/20445540/interior_rear_seats-1774698158234.jpg> (referer: None)
2026-03-29 20:14:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3227/13723227/interior_dashboard-1774784294974.jpg> (referer: None)
2026-03-29 20:14:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3227/13723227/interior_rear_seats-1768836183989.jpg> (referer: None)
2026-03-29 20:14:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3227/13723227/instrument_cluster-1768836162006.jpg> (referer: None)
2026-03-29 20:14:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5540/20445540/interior_boot-1774700198829.jpg> (referer: None)
2026-03-29 20:14:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3227/13723227/interior_boot-1768836205190.jpg> (referer: None)
2026-03-29 20:14:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3227/13723227/interior_front_seats-1768836176438.jpg> (referer: None)
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cc5b90>
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ae8235-3504-5922-80d4-3e24029e22fb/24ae8235-3504-5922-80d4-3e24029e22fb_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5540%252F20445540%252Fdocs_service_history-1774698522308.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2b8f5e785824ee4e8f8a6c37ea39595a') HTTP/1.1" 204 0
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5540/20445540/docs_service_history-1774698522308.jpg?ixlib=js-3.8.0&auto=format&s=2b8f5e785824ee4e8f8a6c37ea39595a saved to cache
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 24ae8235-3504-5922-80d4-3e24029e22fb
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659aa7bd0>
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ac4124-3917-5abb-88b0-032315406d9a/60ac4124-3917-5abb-88b0-032315406d9a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3227%252F13723227%252Fexterior_front_passenger-1768835939605.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3227/13723227/exterior_front_passenger-1768835939605.jpg saved to cache
2026-03-29 20:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60ac4124-3917-5abb-88b0-032315406d9a
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e12ed0>
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ac4124-3917-5abb-88b0-032315406d9a/60ac4124-3917-5abb-88b0-032315406d9a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3227%252F13723227%252Fexterior_rear_driver-1768835924549.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3227/13723227/exterior_rear_driver-1768835924549.jpg saved to cache
2026-03-29 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60ac4124-3917-5abb-88b0-032315406d9a
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659cf4d10>
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ac4124-3917-5abb-88b0-032315406d9a/60ac4124-3917-5abb-88b0-032315406d9a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3227%252F13723227%252Fexterior_front_driver-1768835926611.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3227/13723227/exterior_front_driver-1768835926611.jpg saved to cache
2026-03-29 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60ac4124-3917-5abb-88b0-032315406d9a
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65850df90>
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ac4124-3917-5abb-88b0-032315406d9a/60ac4124-3917-5abb-88b0-032315406d9a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3227%252F13723227%252Fexterior_rear_passenger-1768835933005.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3227/13723227/exterior_rear_passenger-1768835933005.jpg saved to cache
2026-03-29 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60ac4124-3917-5abb-88b0-032315406d9a
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cacb50>
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ae8235-3504-5922-80d4-3e24029e22fb/24ae8235-3504-5922-80d4-3e24029e22fb_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5540%252F20445540%252Finstrument_cluster-1774698215609.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5540/20445540/instrument_cluster-1774698215609.jpg saved to cache
2026-03-29 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 24ae8235-3504-5922-80d4-3e24029e22fb
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659cf54d0>
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd06236a-ea54-53bc-8a2c-a8dc5b77d91e/bd06236a-ea54-53bc-8a2c-a8dc5b77d91e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6417%252F20486417%252Fexterior_rear_driver-1774697894815.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6417/20486417/exterior_rear_driver-1774697894815.jpg saved to cache
2026-03-29 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bd06236a-ea54-53bc-8a2c-a8dc5b77d91e
2026-03-29 20:14:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cade90>
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ae8235-3504-5922-80d4-3e24029e22fb/24ae8235-3504-5922-80d4-3e24029e22fb_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5540%252F20445540%252Finterior_rear_seats-1774698158234.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5540/20445540/interior_rear_seats-1774698158234.jpg saved to cache
2026-03-29 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 24ae8235-3504-5922-80d4-3e24029e22fb
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cc4ad0>
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ac4124-3917-5abb-88b0-032315406d9a/60ac4124-3917-5abb-88b0-032315406d9a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3227%252F13723227%252Finterior_dashboard-1774784294974.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3227/13723227/interior_dashboard-1774784294974.jpg saved to cache
2026-03-29 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 60ac4124-3917-5abb-88b0-032315406d9a
2026-03-29 20:14:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659cf5290>
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ac4124-3917-5abb-88b0-032315406d9a/60ac4124-3917-5abb-88b0-032315406d9a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3227%252F13723227%252Finterior_rear_seats-1768836183989.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3227/13723227/interior_rear_seats-1768836183989.jpg saved to cache
2026-03-29 20:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 60ac4124-3917-5abb-88b0-032315406d9a
2026-03-29 20:14:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659cf4350>
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ac4124-3917-5abb-88b0-032315406d9a/60ac4124-3917-5abb-88b0-032315406d9a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3227%252F13723227%252Finstrument_cluster-1768836162006.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3227/13723227/instrument_cluster-1768836162006.jpg saved to cache
2026-03-29 20:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 60ac4124-3917-5abb-88b0-032315406d9a
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65bbc56d0>
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ae8235-3504-5922-80d4-3e24029e22fb/24ae8235-3504-5922-80d4-3e24029e22fb_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5540%252F20445540%252Finterior_boot-1774700198829.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5540/20445540/interior_boot-1774700198829.jpg saved to cache
2026-03-29 20:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 24ae8235-3504-5922-80d4-3e24029e22fb
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658caf550>
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ac4124-3917-5abb-88b0-032315406d9a/60ac4124-3917-5abb-88b0-032315406d9a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3227%252F13723227%252Finterior_boot-1768836205190.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3227/13723227/interior_boot-1768836205190.jpg saved to cache
2026-03-29 20:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 60ac4124-3917-5abb-88b0-032315406d9a
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659cf4350>
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ac4124-3917-5abb-88b0-032315406d9a/60ac4124-3917-5abb-88b0-032315406d9a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3227%252F13723227%252Finterior_front_seats-1768836176438.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3227/13723227/interior_front_seats-1768836176438.jpg saved to cache
2026-03-29 20:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60ac4124-3917-5abb-88b0-032315406d9a
2026-03-29 20:14:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6417/20486417/instrument_cluster-1774706869934.jpg> (referer: None)
2026-03-29 20:14:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6417/20486417/docs_service_history-1774699380383.jpg?ixlib=js-3.8.0&auto=format&s=90b137b7c98c7c444c118c3a9a2e91e2> (referer: None)
2026-03-29 20:14:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6417/20486417/interior_boot-1774699214340.jpg> (referer: None)
2026-03-29 20:14:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1844/20281844/exterior_front_driver-1774690515951.jpg> (referer: None)
2026-03-29 20:14:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/1844/20281844/docs_service_history-1774690494599.jpg?ixlib=js-3.8.0&auto=format&s=9abdd2356812dec5b99f3ba0e61deca0> (referer: None)
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ce6c10>
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd06236a-ea54-53bc-8a2c-a8dc5b77d91e/bd06236a-ea54-53bc-8a2c-a8dc5b77d91e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6417%252F20486417%252Finstrument_cluster-1774706869934.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6417/20486417/instrument_cluster-1774706869934.jpg saved to cache
2026-03-29 20:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bd06236a-ea54-53bc-8a2c-a8dc5b77d91e
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658815810>
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd06236a-ea54-53bc-8a2c-a8dc5b77d91e/bd06236a-ea54-53bc-8a2c-a8dc5b77d91e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6417%252F20486417%252Fdocs_service_history-1774699380383.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D90b137b7c98c7c444c118c3a9a2e91e2') HTTP/1.1" 204 0
2026-03-29 20:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6417/20486417/docs_service_history-1774699380383.jpg?ixlib=js-3.8.0&auto=format&s=90b137b7c98c7c444c118c3a9a2e91e2 saved to cache
2026-03-29 20:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bd06236a-ea54-53bc-8a2c-a8dc5b77d91e
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65999dd10>
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd06236a-ea54-53bc-8a2c-a8dc5b77d91e/bd06236a-ea54-53bc-8a2c-a8dc5b77d91e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6417%252F20486417%252Finterior_boot-1774699214340.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6417/20486417/interior_boot-1774699214340.jpg saved to cache
2026-03-29 20:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bd06236a-ea54-53bc-8a2c-a8dc5b77d91e
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a75dd0>
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bba66cab-b27a-52d1-a7c4-1eac7daf8645/bba66cab-b27a-52d1-a7c4-1eac7daf8645_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1844%252F20281844%252Fexterior_front_driver-1774690515951.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1844/20281844/exterior_front_driver-1774690515951.jpg saved to cache
2026-03-29 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bba66cab-b27a-52d1-a7c4-1eac7daf8645
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b57cd0>
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bba66cab-b27a-52d1-a7c4-1eac7daf8645/bba66cab-b27a-52d1-a7c4-1eac7daf8645_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1844%252F20281844%252Fdocs_service_history-1774690494599.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9abdd2356812dec5b99f3ba0e61deca0') HTTP/1.1" 204 0
2026-03-29 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1844/20281844/docs_service_history-1774690494599.jpg?ixlib=js-3.8.0&auto=format&s=9abdd2356812dec5b99f3ba0e61deca0 saved to cache
2026-03-29 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bba66cab-b27a-52d1-a7c4-1eac7daf8645
2026-03-29 20:14:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bba66cab-b27a-52d1-a7c4-1eac7daf8645, skipping ID generation
2026-03-29 20:14:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bba66cab-b27a-52d1-a7c4-1eac7daf8645 with scrape type 1
2026-03-29 20:14:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bba66cab-b27a-52d1-a7c4-1eac7daf8645 sending to next pipeline
2026-03-29 20:14:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: bba66cab-b27a-52d1-a7c4-1eac7daf8645, identifier: 20281844
2026-03-29 20:14:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: bba66cab-b27a-52d1-a7c4-1eac7daf8645 with identifier: 20281844
2026-03-29 20:14:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: bba66cab-b27a-52d1-a7c4-1eac7daf8645 with identifier: 20281844
2026-03-29 20:14:45 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: bba66cab-b27a-52d1-a7c4-1eac7daf8645 with identifier: 20281844 to the API
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-service-history-photos.imgix.net/modified/1844/20281844/docs_service_history-1774690494599.jpg?ixlib=js-3.8.0&auto=format&s=9abdd2356812dec5b99f3ba0e61deca0>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.9L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'bba66cab-b27a-52d1-a7c4-1eac7daf8645',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YC70 SRY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20281844',
'listing': 'auction',
'location': 'Derbyshire Derby',
'make': 'Mercedes',
'model': 'GLE Class',
'odometer': 76608,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bba66cab-b27a-52d1-a7c4-1eac7daf8645/bba66cab-b27a-52d1-a7c4-1eac7daf8645_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1392892,
'Height': 2004,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1844/20281844/exterior_front_driver-1774690515951.jpg',
'Width': 2672},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b454e280-38a2-574d-a1b1-5a4b8d6847ae/b454e280-38a2-574d-a1b1-5a4b8d6847ae_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1473564,
'Height': 2399,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1844/20281844/exterior_rear_driver-1773747859187.jpg',
'Width': 3199},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b454e280-38a2-574d-a1b1-5a4b8d6847ae/b454e280-38a2-574d-a1b1-5a4b8d6847ae_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1825150,
'Height': 2893,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1844/20281844/exterior_front_passenger-1773747749986.jpg',
'Width': 3857},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b454e280-38a2-574d-a1b1-5a4b8d6847ae/b454e280-38a2-574d-a1b1-5a4b8d6847ae_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1134876,
'Height': 2426,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1844/20281844/exterior_rear_passenger-1773747869726.jpg',
'Width': 3234},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b454e280-38a2-574d-a1b1-5a4b8d6847ae/b454e280-38a2-574d-a1b1-5a4b8d6847ae_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3118478,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1844/20281844/interior_front_seats-1773748333315.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b454e280-38a2-574d-a1b1-5a4b8d6847ae/b454e280-38a2-574d-a1b1-5a4b8d6847ae_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3027195,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1844/20281844/interior_rear_seats-1773748345398.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b454e280-38a2-574d-a1b1-5a4b8d6847ae/b454e280-38a2-574d-a1b1-5a4b8d6847ae_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3296736,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1844/20281844/interior_dashboard-1773748367668.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b454e280-38a2-574d-a1b1-5a4b8d6847ae/b454e280-38a2-574d-a1b1-5a4b8d6847ae_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2726074,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1844/20281844/instrument_cluster-1773748443100.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b454e280-38a2-574d-a1b1-5a4b8d6847ae/b454e280-38a2-574d-a1b1-5a4b8d6847ae_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2788537,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1844/20281844/interior_boot-1773748427155.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bba66cab-b27a-52d1-a7c4-1eac7daf8645/bba66cab-b27a-52d1-a7c4-1eac7daf8645_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1059909,
'Height': 3252,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/1844/20281844/docs_service_history-1774690494599.jpg?ixlib=js-3.8.0&auto=format&s=9abdd2356812dec5b99f3ba0e61deca0',
'Width': 2439}],
'price': 26573,
'price_includes_vat': False,
'registration_date': '2020-11-06',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes GLE 350 AMG Line Prem D 4M A',
'transmission': 'automatic',
'trim': 'GLE 350 AMG Line Prem D 4M A',
'vin': 'W1N1671212A179183',
'year': 2020}
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720281844%27 HTTP/1.1" 200 None
2026-03-29 20:14:45 [motorway.uk] INFO: Saving data for 20281844: {'created_time': 1774815285.948641, 'last_price_update_time': 1774815285.948656, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20281844') HTTP/1.1" 204 0
2026-03-29 20:14:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3788/12893788/instrument_cluster-1774171464994.jpg> (referer: None)
2026-03-29 20:14:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6417/20486417/exterior_front_passenger-1774697916503.jpg> (referer: None)
2026-03-29 20:14:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6417/20486417/exterior_rear_passenger-1774697902525.jpg> (referer: None)
2026-03-29 20:14:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3788/12893788/interior_dashboard-1774171421956.jpg> (referer: None)
2026-03-29 20:14:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3788/12893788/interior_boot-1774171427263.jpg> (referer: None)
2026-03-29 20:14:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6417/20486417/interior_dashboard-1774706921287.jpg> (referer: None)
2026-03-29 20:14:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3788/12893788/interior_rear_seats-1774171396045.jpg> (referer: None)
2026-03-29 20:14:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3788/12893788/interior_front_seats-1774171365088.jpg> (referer: None)
2026-03-29 20:14:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6417/20486417/interior_rear_seats-1774699175049.jpg> (referer: None)
2026-03-29 20:14:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6417/20486417/interior_front_seats-1774699158508.jpg> (referer: None)
2026-03-29 20:14:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3788/12893788/damage_scratches-1774170997303.jpg> (referer: None)
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65901d990>
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ef423c-8527-588b-a0d2-8e08c906acd4/28ef423c-8527-588b-a0d2-8e08c906acd4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3788%252F12893788%252Finstrument_cluster-1774171464994.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3788/12893788/instrument_cluster-1774171464994.jpg saved to cache
2026-03-29 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 28ef423c-8527-588b-a0d2-8e08c906acd4
2026-03-29 20:14:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6417/20486417/exterior_front_driver-1774699765719.jpg> (referer: None)
2026-03-29 20:14:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3788/12893788/exterior_front_passenger-1774170941993.jpg> (referer: None)
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65813ca90>
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd06236a-ea54-53bc-8a2c-a8dc5b77d91e/bd06236a-ea54-53bc-8a2c-a8dc5b77d91e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6417%252F20486417%252Fexterior_front_passenger-1774697916503.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6417/20486417/exterior_front_passenger-1774697916503.jpg saved to cache
2026-03-29 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bd06236a-ea54-53bc-8a2c-a8dc5b77d91e
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658decc90>
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd06236a-ea54-53bc-8a2c-a8dc5b77d91e/bd06236a-ea54-53bc-8a2c-a8dc5b77d91e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6417%252F20486417%252Fexterior_rear_passenger-1774697902525.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6417/20486417/exterior_rear_passenger-1774697902525.jpg saved to cache
2026-03-29 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bd06236a-ea54-53bc-8a2c-a8dc5b77d91e
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658409010>
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ef423c-8527-588b-a0d2-8e08c906acd4/28ef423c-8527-588b-a0d2-8e08c906acd4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3788%252F12893788%252Finterior_dashboard-1774171421956.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3788/12893788/interior_dashboard-1774171421956.jpg saved to cache
2026-03-29 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 28ef423c-8527-588b-a0d2-8e08c906acd4
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c21b50>
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ef423c-8527-588b-a0d2-8e08c906acd4/28ef423c-8527-588b-a0d2-8e08c906acd4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3788%252F12893788%252Finterior_boot-1774171427263.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3788/12893788/interior_boot-1774171427263.jpg saved to cache
2026-03-29 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 28ef423c-8527-588b-a0d2-8e08c906acd4
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584dce50>
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd06236a-ea54-53bc-8a2c-a8dc5b77d91e/bd06236a-ea54-53bc-8a2c-a8dc5b77d91e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6417%252F20486417%252Finterior_dashboard-1774706921287.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6417/20486417/interior_dashboard-1774706921287.jpg saved to cache
2026-03-29 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bd06236a-ea54-53bc-8a2c-a8dc5b77d91e
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65840a190>
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ef423c-8527-588b-a0d2-8e08c906acd4/28ef423c-8527-588b-a0d2-8e08c906acd4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3788%252F12893788%252Finterior_rear_seats-1774171396045.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3788/12893788/interior_rear_seats-1774171396045.jpg saved to cache
2026-03-29 20:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 28ef423c-8527-588b-a0d2-8e08c906acd4
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c23710>
2026-03-29 20:14:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ef423c-8527-588b-a0d2-8e08c906acd4/28ef423c-8527-588b-a0d2-8e08c906acd4_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3788%252F12893788%252Finterior_front_seats-1774171365088.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3788/12893788/interior_front_seats-1774171365088.jpg saved to cache
2026-03-29 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 28ef423c-8527-588b-a0d2-8e08c906acd4
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583f4250>
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd06236a-ea54-53bc-8a2c-a8dc5b77d91e/bd06236a-ea54-53bc-8a2c-a8dc5b77d91e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6417%252F20486417%252Finterior_rear_seats-1774699175049.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6417/20486417/interior_rear_seats-1774699175049.jpg saved to cache
2026-03-29 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bd06236a-ea54-53bc-8a2c-a8dc5b77d91e
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658dede50>
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd06236a-ea54-53bc-8a2c-a8dc5b77d91e/bd06236a-ea54-53bc-8a2c-a8dc5b77d91e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6417%252F20486417%252Finterior_front_seats-1774699158508.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6417/20486417/interior_front_seats-1774699158508.jpg saved to cache
2026-03-29 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bd06236a-ea54-53bc-8a2c-a8dc5b77d91e
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65bf02910>
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ef423c-8527-588b-a0d2-8e08c906acd4/28ef423c-8527-588b-a0d2-8e08c906acd4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3788%252F12893788%252Fdamage_scratches-1774170997303.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3788/12893788/damage_scratches-1774170997303.jpg saved to cache
2026-03-29 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 28ef423c-8527-588b-a0d2-8e08c906acd4
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658edd450>
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd06236a-ea54-53bc-8a2c-a8dc5b77d91e/bd06236a-ea54-53bc-8a2c-a8dc5b77d91e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6417%252F20486417%252Fexterior_front_driver-1774699765719.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6417/20486417/exterior_front_driver-1774699765719.jpg saved to cache
2026-03-29 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd06236a-ea54-53bc-8a2c-a8dc5b77d91e
2026-03-29 20:14:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd06236a-ea54-53bc-8a2c-a8dc5b77d91e, skipping ID generation
2026-03-29 20:14:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd06236a-ea54-53bc-8a2c-a8dc5b77d91e with scrape type 1
2026-03-29 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd06236a-ea54-53bc-8a2c-a8dc5b77d91e sending to next pipeline
2026-03-29 20:14:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: bd06236a-ea54-53bc-8a2c-a8dc5b77d91e, identifier: 20486417
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658119150>
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ef423c-8527-588b-a0d2-8e08c906acd4/28ef423c-8527-588b-a0d2-8e08c906acd4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3788%252F12893788%252Fexterior_front_passenger-1774170941993.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3788/12893788/exterior_front_passenger-1774170941993.jpg saved to cache
2026-03-29 20:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 28ef423c-8527-588b-a0d2-8e08c906acd4
2026-03-29 20:14:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: bd06236a-ea54-53bc-8a2c-a8dc5b77d91e with identifier: 20486417
2026-03-29 20:14:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: bd06236a-ea54-53bc-8a2c-a8dc5b77d91e with identifier: 20486417
2026-03-29 20:14:48 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: bd06236a-ea54-53bc-8a2c-a8dc5b77d91e with identifier: 20486417 to the API
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/6417/20486417/exterior_front_driver-1774699765719.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'bd06236a-ea54-53bc-8a2c-a8dc5b77d91e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YM69 YBY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20486417',
'listing': 'auction',
'location': 'South Gloucestershire Bristol',
'make': 'BMW',
'model': '5 Series',
'odometer': 54158,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 31,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd06236a-ea54-53bc-8a2c-a8dc5b77d91e/bd06236a-ea54-53bc-8a2c-a8dc5b77d91e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1170463,
'Height': 1753,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6417/20486417/exterior_front_driver-1774699765719.jpg',
'Width': 2337},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd06236a-ea54-53bc-8a2c-a8dc5b77d91e/bd06236a-ea54-53bc-8a2c-a8dc5b77d91e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1154128,
'Height': 1837,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6417/20486417/exterior_rear_driver-1774697894815.jpg',
'Width': 2449},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd06236a-ea54-53bc-8a2c-a8dc5b77d91e/bd06236a-ea54-53bc-8a2c-a8dc5b77d91e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1604058,
'Height': 2044,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6417/20486417/exterior_front_passenger-1774697916503.jpg',
'Width': 2725},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd06236a-ea54-53bc-8a2c-a8dc5b77d91e/bd06236a-ea54-53bc-8a2c-a8dc5b77d91e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1644662,
'Height': 2116,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6417/20486417/exterior_rear_passenger-1774697902525.jpg',
'Width': 2821},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd06236a-ea54-53bc-8a2c-a8dc5b77d91e/bd06236a-ea54-53bc-8a2c-a8dc5b77d91e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2864992,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6417/20486417/interior_front_seats-1774699158508.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd06236a-ea54-53bc-8a2c-a8dc5b77d91e/bd06236a-ea54-53bc-8a2c-a8dc5b77d91e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2945291,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6417/20486417/interior_rear_seats-1774699175049.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd06236a-ea54-53bc-8a2c-a8dc5b77d91e/bd06236a-ea54-53bc-8a2c-a8dc5b77d91e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2253076,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6417/20486417/interior_dashboard-1774706921287.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd06236a-ea54-53bc-8a2c-a8dc5b77d91e/bd06236a-ea54-53bc-8a2c-a8dc5b77d91e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1715513,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6417/20486417/instrument_cluster-1774706869934.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd06236a-ea54-53bc-8a2c-a8dc5b77d91e/bd06236a-ea54-53bc-8a2c-a8dc5b77d91e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4816748,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6417/20486417/interior_boot-1774699214340.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd06236a-ea54-53bc-8a2c-a8dc5b77d91e/bd06236a-ea54-53bc-8a2c-a8dc5b77d91e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1704918,
'Height': 972,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6417/20486417/docs_service_history-1774699380383.jpg?ixlib=js-3.8.0&auto=format&s=90b137b7c98c7c444c118c3a9a2e91e2',
'Width': 2120}],
'price': 18103,
'price_includes_vat': False,
'registration_date': '2020-02-28',
'seats_number': None,
'seller_name': None,
'title': 'BMW 530D M Sport Auto',
'transmission': 'automatic',
'trim': '530D M Sport Auto',
'vin': 'WBAJC92030CE23568',
'year': 2020}
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486417%27 HTTP/1.1" 200 None
2026-03-29 20:14:48 [motorway.uk] INFO: Saving data for 20486417: {'created_time': 1774815288.334704, 'last_price_update_time': 1774815288.334717, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20486417') HTTP/1.1" 204 0
2026-03-29 20:14:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19128404.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3788/12893788/exterior_rear_passenger-1774170944217.jpg> (referer: None)
2026-03-29 20:14:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3788/12893788/exterior_rear_driver-1774170913897.jpg> (referer: None)
2026-03-29 20:14:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3788/12893788/exterior_front_driver-1774170909057.jpg> (referer: None)
2026-03-29 20:14:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9344/20489344/interior_dashboard-1774711628772.jpg> (referer: None)
2026-03-29 20:14:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9344/20489344/instrument_cluster-1774711591249.jpg> (referer: None)
2026-03-29 20:14:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3227/13723227/docs_service_history-1774783687279.jpg?ixlib=js-3.8.0&auto=format&s=cf55e632cf34da4bfd800807469042d0> (referer: None)
2026-03-29 20:14:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9344/20489344/interior_front_seats-1774711948758.jpg> (referer: None)
2026-03-29 20:14:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5540/20445540/exterior_rear_passenger-1774697355651.jpg> (referer: None)
2026-03-29 20:14:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9344/20489344/interior_rear_seats-1774711603018.jpg> (referer: None)
2026-03-29 20:14:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5540/20445540/exterior_front_passenger-1774697381367.jpg> (referer: None)
2026-03-29 20:14:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5540/20445540/interior_dashboard-1774698190205.jpg> (referer: None)
2026-03-29 20:14:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61b8b4c5-ab76-503a-ab62-590776e4ec0f with identifier: 19128404
2026-03-29 20:14:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61b8b4c5-ab76-503a-ab62-590776e4ec0f with scrape type 1
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 61b8b4c5-ab76-503a-ab62-590776e4ec0f
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8404%252F19128404%252Fexterior_front_driver-1774621936470.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8404/19128404/exterior_front_driver-1774621936470.jpg not downloaded yet
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8404%252F19128404%252Fexterior_rear_driver-1774621938886.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8404/19128404/exterior_rear_driver-1774621938886.jpg not downloaded yet
2026-03-29 20:14:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9344/20489344/docs_service_history-1774712703557.jpg?ixlib=js-3.8.0&auto=format&s=cb995dca97480e98eb087b55dee6f45f> (referer: None)
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8404%252F19128404%252Fexterior_front_passenger-1774621926613.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8404/19128404/exterior_front_passenger-1774621926613.jpg not downloaded yet
2026-03-29 20:14:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ede310>
2026-03-29 20:14:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ef423c-8527-588b-a0d2-8e08c906acd4/28ef423c-8527-588b-a0d2-8e08c906acd4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3788%252F12893788%252Fexterior_rear_passenger-1774170944217.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3788/12893788/exterior_rear_passenger-1774170944217.jpg saved to cache
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 28ef423c-8527-588b-a0d2-8e08c906acd4
2026-03-29 20:14:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c0ab50>
2026-03-29 20:14:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ef423c-8527-588b-a0d2-8e08c906acd4/28ef423c-8527-588b-a0d2-8e08c906acd4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3788%252F12893788%252Fexterior_rear_driver-1774170913897.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3788/12893788/exterior_rear_driver-1774170913897.jpg saved to cache
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 28ef423c-8527-588b-a0d2-8e08c906acd4
2026-03-29 20:14:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a71790>
2026-03-29 20:14:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ef423c-8527-588b-a0d2-8e08c906acd4/28ef423c-8527-588b-a0d2-8e08c906acd4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3788%252F12893788%252Fexterior_front_driver-1774170909057.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3788/12893788/exterior_front_driver-1774170909057.jpg saved to cache
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 28ef423c-8527-588b-a0d2-8e08c906acd4
2026-03-29 20:14:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 28ef423c-8527-588b-a0d2-8e08c906acd4, skipping ID generation
2026-03-29 20:14:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28ef423c-8527-588b-a0d2-8e08c906acd4 with scrape type 1
2026-03-29 20:14:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 28ef423c-8527-588b-a0d2-8e08c906acd4 sending to next pipeline
2026-03-29 20:14:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 28ef423c-8527-588b-a0d2-8e08c906acd4, identifier: 12893788
2026-03-29 20:14:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659980910>
2026-03-29 20:14:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8455c7c5-e416-55d2-aac4-7ec1262d55d5/8455c7c5-e416-55d2-aac4-7ec1262d55d5_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9344%252F20489344%252Finterior_dashboard-1774711628772.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9344/20489344/interior_dashboard-1774711628772.jpg saved to cache
2026-03-29 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8455c7c5-e416-55d2-aac4-7ec1262d55d5
2026-03-29 20:14:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658431790>
2026-03-29 20:14:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8455c7c5-e416-55d2-aac4-7ec1262d55d5/8455c7c5-e416-55d2-aac4-7ec1262d55d5_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9344%252F20489344%252Finstrument_cluster-1774711591249.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9344/20489344/instrument_cluster-1774711591249.jpg saved to cache
2026-03-29 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8455c7c5-e416-55d2-aac4-7ec1262d55d5
2026-03-29 20:14:49 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:14:49 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:14:49 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x11_\xbc\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x032\xbf\x00\x11H\x1d\x00\x00\x00\x00'
2026-03-29 20:14:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c08650>
2026-03-29 20:14:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ac4124-3917-5abb-88b0-032315406d9a/60ac4124-3917-5abb-88b0-032315406d9a_image_9.mpo HTTP/1.1" 201 0
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3227%252F13723227%252Fdocs_service_history-1774783687279.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcf55e632cf34da4bfd800807469042d0') HTTP/1.1" 204 0
2026-03-29 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3227/13723227/docs_service_history-1774783687279.jpg?ixlib=js-3.8.0&auto=format&s=cf55e632cf34da4bfd800807469042d0 saved to cache
2026-03-29 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 60ac4124-3917-5abb-88b0-032315406d9a
2026-03-29 20:14:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60ac4124-3917-5abb-88b0-032315406d9a, skipping ID generation
2026-03-29 20:14:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60ac4124-3917-5abb-88b0-032315406d9a with scrape type 1
2026-03-29 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60ac4124-3917-5abb-88b0-032315406d9a sending to next pipeline
2026-03-29 20:14:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 60ac4124-3917-5abb-88b0-032315406d9a, identifier: 13723227
2026-03-29 20:14:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be556d0>
2026-03-29 20:14:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8455c7c5-e416-55d2-aac4-7ec1262d55d5/8455c7c5-e416-55d2-aac4-7ec1262d55d5_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9344%252F20489344%252Finterior_front_seats-1774711948758.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9344/20489344/interior_front_seats-1774711948758.jpg saved to cache
2026-03-29 20:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8455c7c5-e416-55d2-aac4-7ec1262d55d5
2026-03-29 20:14:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 28ef423c-8527-588b-a0d2-8e08c906acd4 with identifier: 12893788
2026-03-29 20:14:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 28ef423c-8527-588b-a0d2-8e08c906acd4 with identifier: 12893788
2026-03-29 20:14:49 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 28ef423c-8527-588b-a0d2-8e08c906acd4 with identifier: 12893788 to the API
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3788/12893788/exterior_front_driver-1774170909057.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '28ef423c-8527-588b-a0d2-8e08c906acd4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'DS68 FLP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/12893788',
'listing': 'auction',
'location': 'Shropshire Newport',
'make': 'Kia',
'model': 'Sportage',
'odometer': 40032,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ef423c-8527-588b-a0d2-8e08c906acd4/28ef423c-8527-588b-a0d2-8e08c906acd4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1756606,
'Height': 2626,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3788/12893788/exterior_front_driver-1774170909057.jpg',
'Width': 3501},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ef423c-8527-588b-a0d2-8e08c906acd4/28ef423c-8527-588b-a0d2-8e08c906acd4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1460565,
'Height': 2396,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3788/12893788/exterior_rear_driver-1774170913897.jpg',
'Width': 3195},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ef423c-8527-588b-a0d2-8e08c906acd4/28ef423c-8527-588b-a0d2-8e08c906acd4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1455253,
'Height': 2459,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3788/12893788/exterior_front_passenger-1774170941993.jpg',
'Width': 3278},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ef423c-8527-588b-a0d2-8e08c906acd4/28ef423c-8527-588b-a0d2-8e08c906acd4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1606166,
'Height': 2670,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3788/12893788/exterior_rear_passenger-1774170944217.jpg',
'Width': 3560},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ef423c-8527-588b-a0d2-8e08c906acd4/28ef423c-8527-588b-a0d2-8e08c906acd4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3312782,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3788/12893788/interior_front_seats-1774171365088.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ef423c-8527-588b-a0d2-8e08c906acd4/28ef423c-8527-588b-a0d2-8e08c906acd4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3388954,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3788/12893788/interior_rear_seats-1774171396045.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ef423c-8527-588b-a0d2-8e08c906acd4/28ef423c-8527-588b-a0d2-8e08c906acd4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3136403,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3788/12893788/interior_dashboard-1774171421956.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ef423c-8527-588b-a0d2-8e08c906acd4/28ef423c-8527-588b-a0d2-8e08c906acd4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2268271,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3788/12893788/instrument_cluster-1774171464994.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ef423c-8527-588b-a0d2-8e08c906acd4/28ef423c-8527-588b-a0d2-8e08c906acd4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2571171,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3788/12893788/interior_boot-1774171427263.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ef423c-8527-588b-a0d2-8e08c906acd4/28ef423c-8527-588b-a0d2-8e08c906acd4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3561279,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3788/12893788/damage_scratches-1774170997303.jpg',
'Width': 4032}],
'price': 10714,
'price_includes_vat': False,
'registration_date': '2018-11-14',
'seats_number': None,
'seller_name': None,
'title': 'Kia Sportage Edition 25 ISG',
'transmission': 'manual',
'trim': 'Edition 25 ISG',
'vin': 'U5YPH814LKL616851',
'year': 2018}
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712893788%27 HTTP/1.1" 200 None
2026-03-29 20:14:49 [motorway.uk] INFO: Saving data for 12893788: {'created_time': 1774815289.973167, 'last_price_update_time': 1774815289.97318, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='12893788') HTTP/1.1" 204 0
2026-03-29 20:14:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 60ac4124-3917-5abb-88b0-032315406d9a with identifier: 13723227
2026-03-29 20:14:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 60ac4124-3917-5abb-88b0-032315406d9a with identifier: 13723227
2026-03-29 20:14:50 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 60ac4124-3917-5abb-88b0-032315406d9a with identifier: 13723227 to the API
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-service-history-photos.imgix.net/redacted/oriented/3227/13723227/docs_service_history-1774783687279.jpg?ixlib=js-3.8.0&auto=format&s=cf55e632cf34da4bfd800807469042d0>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '60ac4124-3917-5abb-88b0-032315406d9a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'FH24 SXY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/13723227',
'listing': 'auction',
'location': 'Devon Ivybridge',
'make': 'Audi',
'model': 'A3',
'odometer': 22500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60ac4124-3917-5abb-88b0-032315406d9a/60ac4124-3917-5abb-88b0-032315406d9a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1584505,
'Height': 2139,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3227/13723227/exterior_front_driver-1768835926611.jpg',
'Width': 2852},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60ac4124-3917-5abb-88b0-032315406d9a/60ac4124-3917-5abb-88b0-032315406d9a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1184459,
'Height': 2092,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3227/13723227/exterior_rear_driver-1768835924549.jpg',
'Width': 2789},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60ac4124-3917-5abb-88b0-032315406d9a/60ac4124-3917-5abb-88b0-032315406d9a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1189374,
'Height': 1995,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3227/13723227/exterior_front_passenger-1768835939605.jpg',
'Width': 2660},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60ac4124-3917-5abb-88b0-032315406d9a/60ac4124-3917-5abb-88b0-032315406d9a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1360399,
'Height': 2372,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3227/13723227/exterior_rear_passenger-1768835933005.jpg',
'Width': 3163},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60ac4124-3917-5abb-88b0-032315406d9a/60ac4124-3917-5abb-88b0-032315406d9a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3264851,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3227/13723227/interior_front_seats-1768836176438.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60ac4124-3917-5abb-88b0-032315406d9a/60ac4124-3917-5abb-88b0-032315406d9a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2534101,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3227/13723227/interior_rear_seats-1768836183989.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60ac4124-3917-5abb-88b0-032315406d9a/60ac4124-3917-5abb-88b0-032315406d9a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2513138,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3227/13723227/interior_dashboard-1774784294974.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60ac4124-3917-5abb-88b0-032315406d9a/60ac4124-3917-5abb-88b0-032315406d9a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2477214,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3227/13723227/instrument_cluster-1768836162006.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60ac4124-3917-5abb-88b0-032315406d9a/60ac4124-3917-5abb-88b0-032315406d9a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2791753,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3227/13723227/interior_boot-1768836205190.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60ac4124-3917-5abb-88b0-032315406d9a/60ac4124-3917-5abb-88b0-032315406d9a_image_9.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 1348219,
'Height': 2142,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3227/13723227/docs_service_history-1774783687279.jpg?ixlib=js-3.8.0&auto=format&s=cf55e632cf34da4bfd800807469042d0',
'Width': 2856}],
'price': 24506,
'price_includes_vat': False,
'registration_date': '2024-07-19',
'seats_number': None,
'seller_name': None,
'title': 'Audi A3 S LN BLK ED 35 TFSI MHEV SA',
'transmission': 'automatic',
'trim': 'S LN BLK ED 35 TFSI MHEV SA',
'vin': 'WAUZZZGY6SA014301',
'year': 2024}
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713723227%27 HTTP/1.1" 200 None
2026-03-29 20:14:50 [motorway.uk] INFO: Saving data for 13723227: {'created_time': 1774815290.379376, 'last_price_update_time': 1774815290.379391, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='13723227') HTTP/1.1" 204 0
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8404%252F19128404%252Fexterior_rear_passenger-1774621930504.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8404/19128404/exterior_rear_passenger-1774621930504.jpg not downloaded yet
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c0e2d0>
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ae8235-3504-5922-80d4-3e24029e22fb/24ae8235-3504-5922-80d4-3e24029e22fb_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5540%252F20445540%252Fexterior_rear_passenger-1774697355651.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5540/20445540/exterior_rear_passenger-1774697355651.jpg saved to cache
2026-03-29 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 24ae8235-3504-5922-80d4-3e24029e22fb
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6588696d0>
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8455c7c5-e416-55d2-aac4-7ec1262d55d5/8455c7c5-e416-55d2-aac4-7ec1262d55d5_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9344%252F20489344%252Finterior_rear_seats-1774711603018.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9344/20489344/interior_rear_seats-1774711603018.jpg saved to cache
2026-03-29 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8455c7c5-e416-55d2-aac4-7ec1262d55d5
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d98590>
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ae8235-3504-5922-80d4-3e24029e22fb/24ae8235-3504-5922-80d4-3e24029e22fb_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5540%252F20445540%252Fexterior_front_passenger-1774697381367.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5540/20445540/exterior_front_passenger-1774697381367.jpg saved to cache
2026-03-29 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 24ae8235-3504-5922-80d4-3e24029e22fb
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfc96d0>
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ae8235-3504-5922-80d4-3e24029e22fb/24ae8235-3504-5922-80d4-3e24029e22fb_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5540%252F20445540%252Finterior_dashboard-1774698190205.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5540/20445540/interior_dashboard-1774698190205.jpg saved to cache
2026-03-29 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 24ae8235-3504-5922-80d4-3e24029e22fb
2026-03-29 20:14:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-29 20:14:50 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:14:50 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:14:50 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x1a\xab\x0f\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x0fE\x00\x1a\xa3v\x00\x00\x00\x00'
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659abdb50>
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8455c7c5-e416-55d2-aac4-7ec1262d55d5/8455c7c5-e416-55d2-aac4-7ec1262d55d5_image_9.mpo HTTP/1.1" 201 0
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9344%252F20489344%252Fdocs_service_history-1774712703557.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcb995dca97480e98eb087b55dee6f45f') HTTP/1.1" 204 0
2026-03-29 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9344/20489344/docs_service_history-1774712703557.jpg?ixlib=js-3.8.0&auto=format&s=cb995dca97480e98eb087b55dee6f45f saved to cache
2026-03-29 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8455c7c5-e416-55d2-aac4-7ec1262d55d5
2026-03-29 20:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9344/20489344/exterior_front_driver-1774710702550.jpg> (referer: None)
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8404%252F19128404%252Finterior_front_seats-1774622892980.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8404/19128404/interior_front_seats-1774622892980.jpg not downloaded yet
2026-03-29 20:14:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5540/20445540/interior_front_seats-1774698114937.jpg> (referer: None)
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8404%252F19128404%252Finterior_rear_seats-1774622859912.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8404/19128404/interior_rear_seats-1774622859912.jpg not downloaded yet
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8404%252F19128404%252Finterior_dashboard-1774622856880.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8404/19128404/interior_dashboard-1774622856880.jpg not downloaded yet
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8404%252F19128404%252Finstrument_cluster-1774623971974.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8404/19128404/instrument_cluster-1774623971974.jpg not downloaded yet
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8404%252F19128404%252Finterior_boot-1774622857180.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8404/19128404/interior_boot-1774622857180.jpg not downloaded yet
2026-03-29 20:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9344/20489344/exterior_rear_driver-1774707395990.jpg> (referer: None)
2026-03-29 20:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659abef10>
2026-03-29 20:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8455c7c5-e416-55d2-aac4-7ec1262d55d5/8455c7c5-e416-55d2-aac4-7ec1262d55d5_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9344%252F20489344%252Fexterior_front_driver-1774710702550.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9344/20489344/exterior_front_driver-1774710702550.jpg saved to cache
2026-03-29 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8455c7c5-e416-55d2-aac4-7ec1262d55d5
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8404%252F19128404%252Fdocs_service_history-1774623160112.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D47f527081ea623592e162a00e7c19f45%27 HTTP/1.1" 200 None
2026-03-29 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8404/19128404/docs_service_history-1774623160112.jpg?ixlib=js-3.8.0&auto=format&s=47f527081ea623592e162a00e7c19f45 not downloaded yet
2026-03-29 20:14:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ae1450>
2026-03-29 20:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24ae8235-3504-5922-80d4-3e24029e22fb/24ae8235-3504-5922-80d4-3e24029e22fb_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5540%252F20445540%252Finterior_front_seats-1774698114937.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5540/20445540/interior_front_seats-1774698114937.jpg saved to cache
2026-03-29 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 24ae8235-3504-5922-80d4-3e24029e22fb
2026-03-29 20:14:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24ae8235-3504-5922-80d4-3e24029e22fb, skipping ID generation
2026-03-29 20:14:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24ae8235-3504-5922-80d4-3e24029e22fb with scrape type 1
2026-03-29 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 24ae8235-3504-5922-80d4-3e24029e22fb sending to next pipeline
2026-03-29 20:14:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 24ae8235-3504-5922-80d4-3e24029e22fb, identifier: 20445540
2026-03-29 20:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9344/20489344/exterior_front_passenger-1774710704761.jpg> (referer: None)
2026-03-29 20:14:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 24ae8235-3504-5922-80d4-3e24029e22fb with identifier: 20445540
2026-03-29 20:14:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 24ae8235-3504-5922-80d4-3e24029e22fb with identifier: 20445540
2026-03-29 20:14:51 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 24ae8235-3504-5922-80d4-3e24029e22fb with identifier: 20445540 to the API
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/5540/20445540/interior_front_seats-1774698114937.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '24ae8235-3504-5922-80d4-3e24029e22fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EK66 XYC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20445540',
'listing': 'auction',
'location': 'Central Bedfordshire Dunstable',
'make': 'Abarth',
'model': '595',
'odometer': 76843,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ae8235-3504-5922-80d4-3e24029e22fb/24ae8235-3504-5922-80d4-3e24029e22fb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1067760,
'Height': 2081,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5540/20445540/exterior_front_driver-1774697312236.jpg',
'Width': 2775},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ae8235-3504-5922-80d4-3e24029e22fb/24ae8235-3504-5922-80d4-3e24029e22fb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1328767,
'Height': 2427,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5540/20445540/exterior_rear_driver-1774697356710.jpg',
'Width': 3236},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ae8235-3504-5922-80d4-3e24029e22fb/24ae8235-3504-5922-80d4-3e24029e22fb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1671206,
'Height': 2539,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5540/20445540/exterior_front_passenger-1774697381367.jpg',
'Width': 3385},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ae8235-3504-5922-80d4-3e24029e22fb/24ae8235-3504-5922-80d4-3e24029e22fb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1707220,
'Height': 2455,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5540/20445540/exterior_rear_passenger-1774697355651.jpg',
'Width': 3273},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ae8235-3504-5922-80d4-3e24029e22fb/24ae8235-3504-5922-80d4-3e24029e22fb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3646986,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5540/20445540/interior_front_seats-1774698114937.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ae8235-3504-5922-80d4-3e24029e22fb/24ae8235-3504-5922-80d4-3e24029e22fb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4653927,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5540/20445540/interior_rear_seats-1774698158234.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ae8235-3504-5922-80d4-3e24029e22fb/24ae8235-3504-5922-80d4-3e24029e22fb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1687317,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5540/20445540/interior_dashboard-1774698190205.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ae8235-3504-5922-80d4-3e24029e22fb/24ae8235-3504-5922-80d4-3e24029e22fb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1829106,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5540/20445540/instrument_cluster-1774698215609.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ae8235-3504-5922-80d4-3e24029e22fb/24ae8235-3504-5922-80d4-3e24029e22fb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2938553,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5540/20445540/interior_boot-1774700198829.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24ae8235-3504-5922-80d4-3e24029e22fb/24ae8235-3504-5922-80d4-3e24029e22fb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 750891,
'Height': 1394,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5540/20445540/docs_service_history-1774698522308.jpg?ixlib=js-3.8.0&auto=format&s=2b8f5e785824ee4e8f8a6c37ea39595a',
'Width': 3902}],
'price': 6288,
'price_includes_vat': False,
'registration_date': '2016-09-30',
'seats_number': None,
'seller_name': None,
'title': 'Abarth 595 Competizione',
'transmission': 'manual',
'trim': 'Competizione',
'vin': 'ZFA3120000J649697',
'year': 2016}
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720445540%27 HTTP/1.1" 200 None
2026-03-29 20:14:51 [motorway.uk] INFO: Saving data for 20445540: {'created_time': 1774815291.854932, 'last_price_update_time': 1774815291.854942, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20445540') HTTP/1.1" 204 0
2026-03-29 20:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c397d0>
2026-03-29 20:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8455c7c5-e416-55d2-aac4-7ec1262d55d5/8455c7c5-e416-55d2-aac4-7ec1262d55d5_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9344%252F20489344%252Fexterior_rear_driver-1774707395990.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9344/20489344/exterior_rear_driver-1774707395990.jpg saved to cache
2026-03-29 20:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8455c7c5-e416-55d2-aac4-7ec1262d55d5
2026-03-29 20:14:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d153d0>
2026-03-29 20:14:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8455c7c5-e416-55d2-aac4-7ec1262d55d5/8455c7c5-e416-55d2-aac4-7ec1262d55d5_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9344%252F20489344%252Fexterior_front_passenger-1774710704761.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9344/20489344/exterior_front_passenger-1774710704761.jpg saved to cache
2026-03-29 20:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8455c7c5-e416-55d2-aac4-7ec1262d55d5
2026-03-29 20:14:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8455c7c5-e416-55d2-aac4-7ec1262d55d5, skipping ID generation
2026-03-29 20:14:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8455c7c5-e416-55d2-aac4-7ec1262d55d5 with scrape type 1
2026-03-29 20:14:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8455c7c5-e416-55d2-aac4-7ec1262d55d5 sending to next pipeline
2026-03-29 20:14:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8455c7c5-e416-55d2-aac4-7ec1262d55d5, identifier: 20489344
2026-03-29 20:14:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8455c7c5-e416-55d2-aac4-7ec1262d55d5 with identifier: 20489344
2026-03-29 20:14:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8455c7c5-e416-55d2-aac4-7ec1262d55d5 with identifier: 20489344
2026-03-29 20:14:52 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8455c7c5-e416-55d2-aac4-7ec1262d55d5 with identifier: 20489344 to the API
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9344/20489344/exterior_front_passenger-1774710704761.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.8L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '8455c7c5-e416-55d2-aac4-7ec1262d55d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MXZ 4071',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20489344',
'listing': 'auction',
'location': 'Greater Manchester Manchester',
'make': 'Toyota',
'model': 'C-HR',
'odometer': 36819,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8455c7c5-e416-55d2-aac4-7ec1262d55d5/8455c7c5-e416-55d2-aac4-7ec1262d55d5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 638118,
'Height': 2441,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9344/20489344/exterior_front_driver-1774710702550.jpg',
'Width': 3254},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8455c7c5-e416-55d2-aac4-7ec1262d55d5/8455c7c5-e416-55d2-aac4-7ec1262d55d5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1098011,
'Height': 2151,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9344/20489344/exterior_rear_driver-1774707395990.jpg',
'Width': 2868},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8455c7c5-e416-55d2-aac4-7ec1262d55d5/8455c7c5-e416-55d2-aac4-7ec1262d55d5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1397279,
'Height': 2482,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9344/20489344/exterior_front_passenger-1774710704761.jpg',
'Width': 3309},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8455c7c5-e416-55d2-aac4-7ec1262d55d5/8455c7c5-e416-55d2-aac4-7ec1262d55d5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 946228,
'Height': 2225,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9344/20489344/exterior_rear_passenger-1774710705596.jpg',
'Width': 2967},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8455c7c5-e416-55d2-aac4-7ec1262d55d5/8455c7c5-e416-55d2-aac4-7ec1262d55d5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1611052,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/9344/20489344/interior_front_seats-1774711948758.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8455c7c5-e416-55d2-aac4-7ec1262d55d5/8455c7c5-e416-55d2-aac4-7ec1262d55d5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1932487,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/9344/20489344/interior_rear_seats-1774711603018.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8455c7c5-e416-55d2-aac4-7ec1262d55d5/8455c7c5-e416-55d2-aac4-7ec1262d55d5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1096165,
'Height': 2891,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9344/20489344/interior_dashboard-1774711628772.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8455c7c5-e416-55d2-aac4-7ec1262d55d5/8455c7c5-e416-55d2-aac4-7ec1262d55d5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1117190,
'Height': 2891,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9344/20489344/instrument_cluster-1774711591249.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8455c7c5-e416-55d2-aac4-7ec1262d55d5/8455c7c5-e416-55d2-aac4-7ec1262d55d5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1474891,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/9344/20489344/interior_boot-1774711605616.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8455c7c5-e416-55d2-aac4-7ec1262d55d5/8455c7c5-e416-55d2-aac4-7ec1262d55d5_image_9.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 1751636,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9344/20489344/docs_service_history-1774712703557.jpg?ixlib=js-3.8.0&auto=format&s=cb995dca97480e98eb087b55dee6f45f',
'Width': 2891}],
'price': 13042,
'price_includes_vat': False,
'registration_date': '2018-08-09',
'seats_number': None,
'seller_name': None,
'title': 'Toyota C-HR Dynamic HEV CVT',
'transmission': 'automatic',
'trim': 'Dynamic HEV CVT',
'vin': 'NMTKZ3BX20R191510',
'year': 2018}
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720489344%27 HTTP/1.1" 200 None
2026-03-29 20:14:52 [motorway.uk] INFO: Saving data for 20489344: {'created_time': 1774815292.623399, 'last_price_update_time': 1774815292.623411, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20489344') HTTP/1.1" 204 0
2026-03-29 20:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6881/20376881/exterior_front_driver-1774635040386.jpg> (referer: None)
2026-03-29 20:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6881/20376881/exterior_rear_driver-1774635033202.jpg> (referer: None)
2026-03-29 20:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8404/19128404/exterior_rear_passenger-1774621930504.jpg> (referer: None)
2026-03-29 20:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2331/7322331/exterior_rear_passenger-1774708346169.jpg> (referer: None)
2026-03-29 20:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8404/19128404/exterior_rear_driver-1774621938886.jpg> (referer: None)
2026-03-29 20:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8130/20428130/interior_rear_seats-1774704954962.jpg> (referer: None)
2026-03-29 20:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8404/19128404/exterior_front_driver-1774621936470.jpg> (referer: None)
2026-03-29 20:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8130/20428130/interior_front_seats-1774705009642.jpg> (referer: None)
2026-03-29 20:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8404/19128404/exterior_front_passenger-1774621926613.jpg> (referer: None)
2026-03-29 20:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2331/7322331/exterior_front_passenger-1774708359098.jpg> (referer: None)
2026-03-29 20:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8130/20428130/interior_dashboard-1774712273687.jpg> (referer: None)
2026-03-29 20:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8404/19128404/interior_front_seats-1774622892980.jpg> (referer: None)
2026-03-29 20:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2331/7322331/interior_front_seats-1774708756308.jpg> (referer: None)
2026-03-29 20:14:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c3a450>
2026-03-29 20:14:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3e1a962-a26e-591b-8db6-fbebcd9e5b37/d3e1a962-a26e-591b-8db6-fbebcd9e5b37_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6881%252F20376881%252Fexterior_front_driver-1774635040386.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6881/20376881/exterior_front_driver-1774635040386.jpg saved to cache
2026-03-29 20:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3e1a962-a26e-591b-8db6-fbebcd9e5b37
2026-03-29 20:14:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cfda50>
2026-03-29 20:14:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3e1a962-a26e-591b-8db6-fbebcd9e5b37/d3e1a962-a26e-591b-8db6-fbebcd9e5b37_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6881%252F20376881%252Fexterior_rear_driver-1774635033202.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6881/20376881/exterior_rear_driver-1774635033202.jpg saved to cache
2026-03-29 20:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d3e1a962-a26e-591b-8db6-fbebcd9e5b37
2026-03-29 20:14:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3e1a962-a26e-591b-8db6-fbebcd9e5b37, skipping ID generation
2026-03-29 20:14:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3e1a962-a26e-591b-8db6-fbebcd9e5b37 with scrape type 1
2026-03-29 20:14:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3e1a962-a26e-591b-8db6-fbebcd9e5b37 sending to next pipeline
2026-03-29 20:14:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d3e1a962-a26e-591b-8db6-fbebcd9e5b37, identifier: 20376881
2026-03-29 20:14:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c3a110>
2026-03-29 20:14:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b8b4c5-ab76-503a-ab62-590776e4ec0f/61b8b4c5-ab76-503a-ab62-590776e4ec0f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8404%252F19128404%252Fexterior_rear_passenger-1774621930504.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8404/19128404/exterior_rear_passenger-1774621930504.jpg saved to cache
2026-03-29 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 61b8b4c5-ab76-503a-ab62-590776e4ec0f
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cfec90>
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddea6899-84df-5e92-8da2-f4e6af5a1fb9/ddea6899-84df-5e92-8da2-f4e6af5a1fb9_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2331%252F7322331%252Fexterior_rear_passenger-1774708346169.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2331/7322331/exterior_rear_passenger-1774708346169.jpg saved to cache
2026-03-29 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ddea6899-84df-5e92-8da2-f4e6af5a1fb9
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658409e90>
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b8b4c5-ab76-503a-ab62-590776e4ec0f/61b8b4c5-ab76-503a-ab62-590776e4ec0f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8404%252F19128404%252Fexterior_rear_driver-1774621938886.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8404/19128404/exterior_rear_driver-1774621938886.jpg saved to cache
2026-03-29 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 61b8b4c5-ab76-503a-ab62-590776e4ec0f
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65840ad50>
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_accd2475-611f-5b0f-842e-df251b6ffe90/accd2475-611f-5b0f-842e-df251b6ffe90_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8130%252F20428130%252Finterior_rear_seats-1774704954962.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8130/20428130/interior_rear_seats-1774704954962.jpg saved to cache
2026-03-29 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item accd2475-611f-5b0f-842e-df251b6ffe90
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fb3990>
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b8b4c5-ab76-503a-ab62-590776e4ec0f/61b8b4c5-ab76-503a-ab62-590776e4ec0f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8404%252F19128404%252Fexterior_front_driver-1774621936470.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8404/19128404/exterior_front_driver-1774621936470.jpg saved to cache
2026-03-29 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 61b8b4c5-ab76-503a-ab62-590776e4ec0f
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fb2250>
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_accd2475-611f-5b0f-842e-df251b6ffe90/accd2475-611f-5b0f-842e-df251b6ffe90_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8130%252F20428130%252Finterior_front_seats-1774705009642.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8130/20428130/interior_front_seats-1774705009642.jpg saved to cache
2026-03-29 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item accd2475-611f-5b0f-842e-df251b6ffe90
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586f6410>
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b8b4c5-ab76-503a-ab62-590776e4ec0f/61b8b4c5-ab76-503a-ab62-590776e4ec0f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8404%252F19128404%252Fexterior_front_passenger-1774621926613.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8404/19128404/exterior_front_passenger-1774621926613.jpg saved to cache
2026-03-29 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 61b8b4c5-ab76-503a-ab62-590776e4ec0f
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65840b1d0>
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddea6899-84df-5e92-8da2-f4e6af5a1fb9/ddea6899-84df-5e92-8da2-f4e6af5a1fb9_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2331%252F7322331%252Fexterior_front_passenger-1774708359098.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2331/7322331/exterior_front_passenger-1774708359098.jpg saved to cache
2026-03-29 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ddea6899-84df-5e92-8da2-f4e6af5a1fb9
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65830f8d0>
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_accd2475-611f-5b0f-842e-df251b6ffe90/accd2475-611f-5b0f-842e-df251b6ffe90_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8130%252F20428130%252Finterior_dashboard-1774712273687.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8130/20428130/interior_dashboard-1774712273687.jpg saved to cache
2026-03-29 20:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item accd2475-611f-5b0f-842e-df251b6ffe90
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a7f190>
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b8b4c5-ab76-503a-ab62-590776e4ec0f/61b8b4c5-ab76-503a-ab62-590776e4ec0f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8404%252F19128404%252Finterior_front_seats-1774622892980.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8404/19128404/interior_front_seats-1774622892980.jpg saved to cache
2026-03-29 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 61b8b4c5-ab76-503a-ab62-590776e4ec0f
2026-03-29 20:14:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586f5f90>
2026-03-29 20:14:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddea6899-84df-5e92-8da2-f4e6af5a1fb9/ddea6899-84df-5e92-8da2-f4e6af5a1fb9_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2331%252F7322331%252Finterior_front_seats-1774708756308.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2331/7322331/interior_front_seats-1774708756308.jpg saved to cache
2026-03-29 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ddea6899-84df-5e92-8da2-f4e6af5a1fb9
2026-03-29 20:14:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d3e1a962-a26e-591b-8db6-fbebcd9e5b37 with identifier: 20376881
2026-03-29 20:14:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d3e1a962-a26e-591b-8db6-fbebcd9e5b37 with identifier: 20376881
2026-03-29 20:14:54 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d3e1a962-a26e-591b-8db6-fbebcd9e5b37 with identifier: 20376881 to the API
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6881/20376881/exterior_rear_driver-1774635033202.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'd3e1a962-a26e-591b-8db6-fbebcd9e5b37',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'KY67 SBZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20376881',
'listing': 'auction',
'location': 'Neath Port Talbot Principle Area Neath',
'make': 'Volvo',
'model': 'S60',
'odometer': 28524,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3e1a962-a26e-591b-8db6-fbebcd9e5b37/d3e1a962-a26e-591b-8db6-fbebcd9e5b37_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 640855,
'Height': 2333,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6881/20376881/exterior_front_driver-1774635040386.jpg',
'Width': 3111},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3e1a962-a26e-591b-8db6-fbebcd9e5b37/d3e1a962-a26e-591b-8db6-fbebcd9e5b37_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1612487,
'Height': 2543,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6881/20376881/exterior_rear_driver-1774635033202.jpg',
'Width': 3391},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3e1a962-a26e-591b-8db6-fbebcd9e5b37/d3e1a962-a26e-591b-8db6-fbebcd9e5b37_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1090211,
'Height': 2308,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6881/20376881/exterior_front_passenger-1774635038704.jpg',
'Width': 3077},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3e1a962-a26e-591b-8db6-fbebcd9e5b37/d3e1a962-a26e-591b-8db6-fbebcd9e5b37_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 827420,
'Height': 2438,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6881/20376881/exterior_rear_passenger-1774635027903.jpg',
'Width': 3251},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3e1a962-a26e-591b-8db6-fbebcd9e5b37/d3e1a962-a26e-591b-8db6-fbebcd9e5b37_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1841057,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6881/20376881/interior_front_seats-1774637867784.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3e1a962-a26e-591b-8db6-fbebcd9e5b37/d3e1a962-a26e-591b-8db6-fbebcd9e5b37_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2419060,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6881/20376881/interior_rear_seats-1774636175518.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3e1a962-a26e-591b-8db6-fbebcd9e5b37/d3e1a962-a26e-591b-8db6-fbebcd9e5b37_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2317651,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6881/20376881/interior_dashboard-1774636199037.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3e1a962-a26e-591b-8db6-fbebcd9e5b37/d3e1a962-a26e-591b-8db6-fbebcd9e5b37_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2668025,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6881/20376881/instrument_cluster-1774636219051.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3e1a962-a26e-591b-8db6-fbebcd9e5b37/d3e1a962-a26e-591b-8db6-fbebcd9e5b37_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3124389,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6881/20376881/interior_boot-1774636183121.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3e1a962-a26e-591b-8db6-fbebcd9e5b37/d3e1a962-a26e-591b-8db6-fbebcd9e5b37_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2435784,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6881/20376881/damage_scratches-1774635104511.jpg',
'Width': 3840}],
'price': 12475,
'price_includes_vat': False,
'registration_date': '2017-09-19',
'seats_number': None,
'seller_name': None,
'title': 'Volvo S60 R-DESIGN LUX NAV D4 Auto',
'transmission': 'automatic',
'trim': 'R-DESIGN LUX NAV D4 Auto',
'vin': 'YV1FSA8CDJ2453075',
'year': 2017}
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720376881%27 HTTP/1.1" 200 None
2026-03-29 20:14:54 [motorway.uk] INFO: Saving data for 20376881: {'created_time': 1774815294.564321, 'last_price_update_time': 1774815294.564331, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20376881') HTTP/1.1" 204 0
2026-03-29 20:14:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8404/19128404/instrument_cluster-1774623971974.jpg> (referer: None)
2026-03-29 20:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8404/19128404/docs_service_history-1774623160112.jpg?ixlib=js-3.8.0&auto=format&s=47f527081ea623592e162a00e7c19f45> (referer: None)
2026-03-29 20:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8404/19128404/interior_boot-1774622857180.jpg> (referer: None)
2026-03-29 20:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8404/19128404/interior_dashboard-1774622856880.jpg> (referer: None)
2026-03-29 20:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8404/19128404/interior_rear_seats-1774622859912.jpg> (referer: None)
2026-03-29 20:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6075/20416075/docs_service_history-1774708256137.jpg?ixlib=js-3.8.0&auto=format&s=ca31e738fc487aa736b512fa67037787> (referer: None)
2026-03-29 20:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8130/20428130/exterior_front_driver-1774699259431.jpg> (referer: None)
2026-03-29 20:14:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65ab21410>
2026-03-29 20:14:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b8b4c5-ab76-503a-ab62-590776e4ec0f/61b8b4c5-ab76-503a-ab62-590776e4ec0f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8404%252F19128404%252Finstrument_cluster-1774623971974.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8404/19128404/instrument_cluster-1774623971974.jpg saved to cache
2026-03-29 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 61b8b4c5-ab76-503a-ab62-590776e4ec0f
2026-03-29 20:14:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658108490>
2026-03-29 20:14:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b8b4c5-ab76-503a-ab62-590776e4ec0f/61b8b4c5-ab76-503a-ab62-590776e4ec0f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8404%252F19128404%252Fdocs_service_history-1774623160112.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D47f527081ea623592e162a00e7c19f45') HTTP/1.1" 204 0
2026-03-29 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8404/19128404/docs_service_history-1774623160112.jpg?ixlib=js-3.8.0&auto=format&s=47f527081ea623592e162a00e7c19f45 saved to cache
2026-03-29 20:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 61b8b4c5-ab76-503a-ab62-590776e4ec0f
2026-03-29 20:14:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a84650>
2026-03-29 20:14:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b8b4c5-ab76-503a-ab62-590776e4ec0f/61b8b4c5-ab76-503a-ab62-590776e4ec0f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8404%252F19128404%252Finterior_boot-1774622857180.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8404/19128404/interior_boot-1774622857180.jpg saved to cache
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 61b8b4c5-ab76-503a-ab62-590776e4ec0f
2026-03-29 20:14:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658415f50>
2026-03-29 20:14:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b8b4c5-ab76-503a-ab62-590776e4ec0f/61b8b4c5-ab76-503a-ab62-590776e4ec0f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8404%252F19128404%252Finterior_dashboard-1774622856880.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8404/19128404/interior_dashboard-1774622856880.jpg saved to cache
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 61b8b4c5-ab76-503a-ab62-590776e4ec0f
2026-03-29 20:14:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fe3350>
2026-03-29 20:14:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_61b8b4c5-ab76-503a-ab62-590776e4ec0f/61b8b4c5-ab76-503a-ab62-590776e4ec0f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8404%252F19128404%252Finterior_rear_seats-1774622859912.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8404/19128404/interior_rear_seats-1774622859912.jpg saved to cache
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 61b8b4c5-ab76-503a-ab62-590776e4ec0f
2026-03-29 20:14:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 61b8b4c5-ab76-503a-ab62-590776e4ec0f, skipping ID generation
2026-03-29 20:14:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61b8b4c5-ab76-503a-ab62-590776e4ec0f with scrape type 1
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 61b8b4c5-ab76-503a-ab62-590776e4ec0f sending to next pipeline
2026-03-29 20:14:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 61b8b4c5-ab76-503a-ab62-590776e4ec0f, identifier: 19128404
2026-03-29 20:14:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b83910>
2026-03-29 20:14:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44c94db1-ef50-5a25-97ff-67721bcc98e5/44c94db1-ef50-5a25-97ff-67721bcc98e5_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6075%252F20416075%252Fdocs_service_history-1774708256137.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dca31e738fc487aa736b512fa67037787') HTTP/1.1" 204 0
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6075/20416075/docs_service_history-1774708256137.jpg?ixlib=js-3.8.0&auto=format&s=ca31e738fc487aa736b512fa67037787 saved to cache
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 44c94db1-ef50-5a25-97ff-67721bcc98e5
2026-03-29 20:14:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d31f10>
2026-03-29 20:14:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_accd2475-611f-5b0f-842e-df251b6ffe90/accd2475-611f-5b0f-842e-df251b6ffe90_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8130%252F20428130%252Fexterior_front_driver-1774699259431.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8130/20428130/exterior_front_driver-1774699259431.jpg saved to cache
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item accd2475-611f-5b0f-842e-df251b6ffe90
2026-03-29 20:14:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: accd2475-611f-5b0f-842e-df251b6ffe90, skipping ID generation
2026-03-29 20:14:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item accd2475-611f-5b0f-842e-df251b6ffe90 with scrape type 1
2026-03-29 20:14:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item accd2475-611f-5b0f-842e-df251b6ffe90 sending to next pipeline
2026-03-29 20:14:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: accd2475-611f-5b0f-842e-df251b6ffe90, identifier: 20428130
2026-03-29 20:14:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 61b8b4c5-ab76-503a-ab62-590776e4ec0f with identifier: 19128404
2026-03-29 20:14:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 61b8b4c5-ab76-503a-ab62-590776e4ec0f with identifier: 19128404
2026-03-29 20:14:55 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 61b8b4c5-ab76-503a-ab62-590776e4ec0f with identifier: 19128404 to the API
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/8404/19128404/interior_rear_seats-1774622859912.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '61b8b4c5-ab76-503a-ab62-590776e4ec0f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MF17 ZBG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19128404',
'listing': 'auction',
'location': 'Greater Manchester Bolton',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 62188,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b8b4c5-ab76-503a-ab62-590776e4ec0f/61b8b4c5-ab76-503a-ab62-590776e4ec0f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1875766,
'Height': 2628,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8404/19128404/exterior_front_driver-1774621936470.jpg',
'Width': 3504},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b8b4c5-ab76-503a-ab62-590776e4ec0f/61b8b4c5-ab76-503a-ab62-590776e4ec0f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1525763,
'Height': 2574,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8404/19128404/exterior_rear_driver-1774621938886.jpg',
'Width': 3432},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b8b4c5-ab76-503a-ab62-590776e4ec0f/61b8b4c5-ab76-503a-ab62-590776e4ec0f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1918537,
'Height': 2493,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8404/19128404/exterior_front_passenger-1774621926613.jpg',
'Width': 3324},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b8b4c5-ab76-503a-ab62-590776e4ec0f/61b8b4c5-ab76-503a-ab62-590776e4ec0f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1175469,
'Height': 2358,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8404/19128404/exterior_rear_passenger-1774621930504.jpg',
'Width': 3144},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b8b4c5-ab76-503a-ab62-590776e4ec0f/61b8b4c5-ab76-503a-ab62-590776e4ec0f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3159445,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8404/19128404/interior_front_seats-1774622892980.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b8b4c5-ab76-503a-ab62-590776e4ec0f/61b8b4c5-ab76-503a-ab62-590776e4ec0f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2854645,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8404/19128404/interior_rear_seats-1774622859912.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b8b4c5-ab76-503a-ab62-590776e4ec0f/61b8b4c5-ab76-503a-ab62-590776e4ec0f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2357172,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8404/19128404/interior_dashboard-1774622856880.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b8b4c5-ab76-503a-ab62-590776e4ec0f/61b8b4c5-ab76-503a-ab62-590776e4ec0f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 521067,
'Height': 1885,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8404/19128404/instrument_cluster-1774623971974.jpg',
'Width': 2513},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b8b4c5-ab76-503a-ab62-590776e4ec0f/61b8b4c5-ab76-503a-ab62-590776e4ec0f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1634842,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8404/19128404/interior_boot-1774622857180.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_61b8b4c5-ab76-503a-ab62-590776e4ec0f/61b8b4c5-ab76-503a-ab62-590776e4ec0f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1454427,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8404/19128404/docs_service_history-1774623160112.jpg?ixlib=js-3.8.0&auto=format&s=47f527081ea623592e162a00e7c19f45',
'Width': 3840}],
'price': 6448,
'price_includes_vat': False,
'registration_date': '2017-05-18',
'seats_number': None,
'seller_name': None,
'title': 'Citroen Berlingo Multispace Flair Bhdi',
'transmission': 'manual',
'trim': 'Multispace Flair Bhdi',
'vin': 'VF77JBHY6HJ660402',
'year': 2017}
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719128404%27 HTTP/1.1" 200 None
2026-03-29 20:14:56 [motorway.uk] INFO: Saving data for 19128404: {'created_time': 1774815296.018726, 'last_price_update_time': 1774815296.018738, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19128404') HTTP/1.1" 204 0
2026-03-29 20:14:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: accd2475-611f-5b0f-842e-df251b6ffe90 with identifier: 20428130
2026-03-29 20:14:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: accd2475-611f-5b0f-842e-df251b6ffe90 with identifier: 20428130
2026-03-29 20:14:56 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: accd2475-611f-5b0f-842e-df251b6ffe90 with identifier: 20428130 to the API
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8130/20428130/exterior_front_driver-1774699259431.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'accd2475-611f-5b0f-842e-df251b6ffe90',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'VE16 ZBL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20428130',
'listing': 'auction',
'location': 'West Midlands Birmingham',
'make': 'BMW',
'model': '4 Series',
'odometer': 55164,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_accd2475-611f-5b0f-842e-df251b6ffe90/accd2475-611f-5b0f-842e-df251b6ffe90_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 885200,
'Height': 2114,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8130/20428130/exterior_front_driver-1774699259431.jpg',
'Width': 2819},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_accd2475-611f-5b0f-842e-df251b6ffe90/accd2475-611f-5b0f-842e-df251b6ffe90_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 774702,
'Height': 2056,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8130/20428130/exterior_rear_driver-1774698776584.jpg',
'Width': 2741},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_accd2475-611f-5b0f-842e-df251b6ffe90/accd2475-611f-5b0f-842e-df251b6ffe90_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 479102,
'Height': 1598,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8130/20428130/exterior_front_passenger-1774698776280.jpg',
'Width': 2131},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_accd2475-611f-5b0f-842e-df251b6ffe90/accd2475-611f-5b0f-842e-df251b6ffe90_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1022848,
'Height': 2141,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8130/20428130/exterior_rear_passenger-1774698772297.jpg',
'Width': 2854},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_accd2475-611f-5b0f-842e-df251b6ffe90/accd2475-611f-5b0f-842e-df251b6ffe90_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2008543,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8130/20428130/interior_front_seats-1774705009642.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_accd2475-611f-5b0f-842e-df251b6ffe90/accd2475-611f-5b0f-842e-df251b6ffe90_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1875600,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8130/20428130/interior_rear_seats-1774704954962.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_accd2475-611f-5b0f-842e-df251b6ffe90/accd2475-611f-5b0f-842e-df251b6ffe90_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2172282,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8130/20428130/interior_dashboard-1774712273687.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_accd2475-611f-5b0f-842e-df251b6ffe90/accd2475-611f-5b0f-842e-df251b6ffe90_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1419584,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8130/20428130/instrument_cluster-1774704688242.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_accd2475-611f-5b0f-842e-df251b6ffe90/accd2475-611f-5b0f-842e-df251b6ffe90_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1821639,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8130/20428130/interior_boot-1774704878407.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_accd2475-611f-5b0f-842e-df251b6ffe90/accd2475-611f-5b0f-842e-df251b6ffe90_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1545769,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8130/20428130/docs_service_history-1774707740692.jpg?ixlib=js-3.8.0&auto=format&s=f71debfb95ecef5488d291f3e27e48c8',
'Width': 3840}],
'price': 10840,
'price_includes_vat': False,
'registration_date': '2016-06-30',
'seats_number': None,
'seller_name': None,
'title': 'BMW 420D M Sport Auto',
'transmission': 'automatic',
'trim': '420D M Sport Auto',
'vin': 'WBA4U320705A00889',
'year': 2016}
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720428130%27 HTTP/1.1" 200 None
2026-03-29 20:14:56 [motorway.uk] INFO: Saving data for 20428130: {'created_time': 1774815296.439974, 'last_price_update_time': 1774815296.439988, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20428130') HTTP/1.1" 204 0
2026-03-29 20:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1281/3181281/docs_service_history-1774779440695.jpg?ixlib=js-3.8.0&auto=format&s=89485494d7c77e4dc648da887c833a6b> (referer: None)
2026-03-29 20:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2331/7322331/exterior_rear_driver-1774708337141.jpg> (referer: None)
2026-03-29 20:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1281/3181281/instrument_cluster-1774779291271.jpg> (referer: None)
2026-03-29 20:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6075/20416075/instrument_cluster-1774708200506.jpg> (referer: None)
2026-03-29 20:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1281/3181281/interior_boot-1774779234224.jpg> (referer: None)
2026-03-29 20:14:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a84610>
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d86f90b-3db3-5c4f-90e0-9ef0e224b653/9d86f90b-3db3-5c4f-90e0-9ef0e224b653_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1281%252F3181281%252Fdocs_service_history-1774779440695.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D89485494d7c77e4dc648da887c833a6b') HTTP/1.1" 204 0
2026-03-29 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1281/3181281/docs_service_history-1774779440695.jpg?ixlib=js-3.8.0&auto=format&s=89485494d7c77e4dc648da887c833a6b saved to cache
2026-03-29 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9d86f90b-3db3-5c4f-90e0-9ef0e224b653
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d0a890>
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ddea6899-84df-5e92-8da2-f4e6af5a1fb9/ddea6899-84df-5e92-8da2-f4e6af5a1fb9_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2331%252F7322331%252Fexterior_rear_driver-1774708337141.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2331/7322331/exterior_rear_driver-1774708337141.jpg saved to cache
2026-03-29 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ddea6899-84df-5e92-8da2-f4e6af5a1fb9
2026-03-29 20:14:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ddea6899-84df-5e92-8da2-f4e6af5a1fb9, skipping ID generation
2026-03-29 20:14:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddea6899-84df-5e92-8da2-f4e6af5a1fb9 with scrape type 1
2026-03-29 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ddea6899-84df-5e92-8da2-f4e6af5a1fb9 sending to next pipeline
2026-03-29 20:14:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ddea6899-84df-5e92-8da2-f4e6af5a1fb9, identifier: 7322331
2026-03-29 20:14:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658aa2a90>
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d86f90b-3db3-5c4f-90e0-9ef0e224b653/9d86f90b-3db3-5c4f-90e0-9ef0e224b653_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1281%252F3181281%252Finstrument_cluster-1774779291271.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1281/3181281/instrument_cluster-1774779291271.jpg saved to cache
2026-03-29 20:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9d86f90b-3db3-5c4f-90e0-9ef0e224b653
2026-03-29 20:14:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658557510>
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44c94db1-ef50-5a25-97ff-67721bcc98e5/44c94db1-ef50-5a25-97ff-67721bcc98e5_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6075%252F20416075%252Finstrument_cluster-1774708200506.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6075/20416075/instrument_cluster-1774708200506.jpg saved to cache
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 44c94db1-ef50-5a25-97ff-67721bcc98e5
2026-03-29 20:14:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c83990>
2026-03-29 20:14:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d86f90b-3db3-5c4f-90e0-9ef0e224b653/9d86f90b-3db3-5c4f-90e0-9ef0e224b653_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1281%252F3181281%252Finterior_boot-1774779234224.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1281/3181281/interior_boot-1774779234224.jpg saved to cache
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9d86f90b-3db3-5c4f-90e0-9ef0e224b653
2026-03-29 20:14:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ddea6899-84df-5e92-8da2-f4e6af5a1fb9 with identifier: 7322331
2026-03-29 20:14:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ddea6899-84df-5e92-8da2-f4e6af5a1fb9 with identifier: 7322331
2026-03-29 20:14:57 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ddea6899-84df-5e92-8da2-f4e6af5a1fb9 with identifier: 7322331 to the API
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2331/7322331/exterior_rear_driver-1774708337141.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'ddea6899-84df-5e92-8da2-f4e6af5a1fb9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'BP69 VWD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/7322331',
'listing': 'auction',
'location': 'West Midlands Birmingham',
'make': 'Kia',
'model': 'Ceed',
'odometer': 55219,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddea6899-84df-5e92-8da2-f4e6af5a1fb9/ddea6899-84df-5e92-8da2-f4e6af5a1fb9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1426846,
'Height': 2376,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2331/7322331/exterior_front_driver-1774708317612.jpg',
'Width': 3168},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddea6899-84df-5e92-8da2-f4e6af5a1fb9/ddea6899-84df-5e92-8da2-f4e6af5a1fb9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1596353,
'Height': 2327,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2331/7322331/exterior_rear_driver-1774708337141.jpg',
'Width': 3103},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddea6899-84df-5e92-8da2-f4e6af5a1fb9/ddea6899-84df-5e92-8da2-f4e6af5a1fb9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1598148,
'Height': 2471,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2331/7322331/exterior_front_passenger-1774708359098.jpg',
'Width': 3294},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddea6899-84df-5e92-8da2-f4e6af5a1fb9/ddea6899-84df-5e92-8da2-f4e6af5a1fb9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1360355,
'Height': 2426,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2331/7322331/exterior_rear_passenger-1774708346169.jpg',
'Width': 3234},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddea6899-84df-5e92-8da2-f4e6af5a1fb9/ddea6899-84df-5e92-8da2-f4e6af5a1fb9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3733362,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2331/7322331/interior_front_seats-1774708756308.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddea6899-84df-5e92-8da2-f4e6af5a1fb9/ddea6899-84df-5e92-8da2-f4e6af5a1fb9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3930877,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2331/7322331/interior_rear_seats-1774708770461.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddea6899-84df-5e92-8da2-f4e6af5a1fb9/ddea6899-84df-5e92-8da2-f4e6af5a1fb9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2059675,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2331/7322331/interior_dashboard-1774708791057.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddea6899-84df-5e92-8da2-f4e6af5a1fb9/ddea6899-84df-5e92-8da2-f4e6af5a1fb9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2418230,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2331/7322331/instrument_cluster-1774708866525.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddea6899-84df-5e92-8da2-f4e6af5a1fb9/ddea6899-84df-5e92-8da2-f4e6af5a1fb9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4805148,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2331/7322331/interior_boot-1774708802596.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ddea6899-84df-5e92-8da2-f4e6af5a1fb9/ddea6899-84df-5e92-8da2-f4e6af5a1fb9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 394281,
'Height': 1945,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2331/7322331/docs_service_history-1774708977474.jpg?ixlib=js-3.8.0&auto=format&s=96d4cc0e546cd5a9722310c3931ccf21',
'Width': 2706}],
'price': 11262,
'price_includes_vat': False,
'registration_date': '2019-12-23',
'seats_number': None,
'seller_name': None,
'title': "Kia c'eed GT-LINE S ISG S-A",
'transmission': 'automatic',
'trim': "c'eed GT-LINE S ISG S-A",
'vin': 'U5YH6514VLL087148',
'year': 2019}
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277322331%27 HTTP/1.1" 200 None
2026-03-29 20:14:57 [motorway.uk] INFO: Saving data for 7322331: {'created_time': 1774815297.638984, 'last_price_update_time': 1774815297.638998, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='7322331') HTTP/1.1" 204 0
2026-03-29 20:14:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20049212.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:14:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1281/3181281/exterior_rear_passenger-1774525670191.jpg> (referer: None)
2026-03-29 20:14:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6075/20416075/exterior_rear_passenger-1774707022864.jpg> (referer: None)
2026-03-29 20:14:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1281/3181281/interior_rear_seats-1774779205449.jpg> (referer: None)
2026-03-29 20:14:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1281/3181281/interior_dashboard-1774779231514.jpg> (referer: None)
2026-03-29 20:14:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6075/20416075/interior_rear_seats-1774707854858.jpg> (referer: None)
2026-03-29 20:14:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1281/3181281/interior_front_seats-1774779251424.jpg> (referer: None)
2026-03-29 20:14:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6075/20416075/interior_front_seats-1774708194635.jpg> (referer: None)
2026-03-29 20:14:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa4648e4-4f61-5331-abdc-94f79af85200 with identifier: 20049212
2026-03-29 20:14:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa4648e4-4f61-5331-abdc-94f79af85200 with scrape type 1
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aa4648e4-4f61-5331-abdc-94f79af85200
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9212%252F20049212%252Fexterior_front_driver-1774094124293.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9212/20049212/exterior_front_driver-1774094124293.jpg not downloaded yet
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9212%252F20049212%252Fexterior_rear_driver-1774094142489.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9212/20049212/exterior_rear_driver-1774094142489.jpg already downloaded
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9212%252F20049212%252Fexterior_front_passenger-1774094163029.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9212/20049212/exterior_front_passenger-1774094163029.jpg already downloaded
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9212%252F20049212%252Fexterior_rear_passenger-1774094156702.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9212/20049212/exterior_rear_passenger-1774094156702.jpg already downloaded
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9212%252F20049212%252Finterior_front_seats-1774094820177.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9212/20049212/interior_front_seats-1774094820177.jpg already downloaded
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9212%252F20049212%252Finterior_rear_seats-1774094748367.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9212/20049212/interior_rear_seats-1774094748367.jpg already downloaded
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9212%252F20049212%252Finterior_dashboard-1774094743842.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9212/20049212/interior_dashboard-1774094743842.jpg already downloaded
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9212%252F20049212%252Finterior_boot-1774094761135.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9212/20049212/interior_boot-1774094761135.jpg already downloaded
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9212%252F20049212%252Fdocs_service_history-1774094911514.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc44cdbfaa7f8b322a0afc491f8301300%27 HTTP/1.1" 200 None
2026-03-29 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9212/20049212/docs_service_history-1774094911514.jpg?ixlib=js-3.8.0&auto=format&s=c44cdbfaa7f8b322a0afc491f8301300 not downloaded yet
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9212%252F20049212%252Fdocs_service_history-1774094926975.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D414b0481c432b9330df2d5f255352866%27 HTTP/1.1" 200 None
2026-03-29 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9212/20049212/docs_service_history-1774094926975.jpg?ixlib=js-3.8.0&auto=format&s=414b0481c432b9330df2d5f255352866 already downloaded
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cc6450>
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d86f90b-3db3-5c4f-90e0-9ef0e224b653/9d86f90b-3db3-5c4f-90e0-9ef0e224b653_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1281%252F3181281%252Fexterior_rear_passenger-1774525670191.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1281/3181281/exterior_rear_passenger-1774525670191.jpg saved to cache
2026-03-29 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9d86f90b-3db3-5c4f-90e0-9ef0e224b653
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cc4c90>
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44c94db1-ef50-5a25-97ff-67721bcc98e5/44c94db1-ef50-5a25-97ff-67721bcc98e5_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6075%252F20416075%252Fexterior_rear_passenger-1774707022864.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6075/20416075/exterior_rear_passenger-1774707022864.jpg saved to cache
2026-03-29 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 44c94db1-ef50-5a25-97ff-67721bcc98e5
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65833b410>
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d86f90b-3db3-5c4f-90e0-9ef0e224b653/9d86f90b-3db3-5c4f-90e0-9ef0e224b653_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1281%252F3181281%252Finterior_rear_seats-1774779205449.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1281/3181281/interior_rear_seats-1774779205449.jpg saved to cache
2026-03-29 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9d86f90b-3db3-5c4f-90e0-9ef0e224b653
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cc4c90>
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d86f90b-3db3-5c4f-90e0-9ef0e224b653/9d86f90b-3db3-5c4f-90e0-9ef0e224b653_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1281%252F3181281%252Finterior_dashboard-1774779231514.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1281/3181281/interior_dashboard-1774779231514.jpg saved to cache
2026-03-29 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9d86f90b-3db3-5c4f-90e0-9ef0e224b653
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b84110>
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44c94db1-ef50-5a25-97ff-67721bcc98e5/44c94db1-ef50-5a25-97ff-67721bcc98e5_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6075%252F20416075%252Finterior_rear_seats-1774707854858.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6075/20416075/interior_rear_seats-1774707854858.jpg saved to cache
2026-03-29 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 44c94db1-ef50-5a25-97ff-67721bcc98e5
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cc4e10>
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d86f90b-3db3-5c4f-90e0-9ef0e224b653/9d86f90b-3db3-5c4f-90e0-9ef0e224b653_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1281%252F3181281%252Finterior_front_seats-1774779251424.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1281/3181281/interior_front_seats-1774779251424.jpg saved to cache
2026-03-29 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9d86f90b-3db3-5c4f-90e0-9ef0e224b653
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:14:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cc4410>
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44c94db1-ef50-5a25-97ff-67721bcc98e5/44c94db1-ef50-5a25-97ff-67721bcc98e5_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6075%252F20416075%252Finterior_front_seats-1774708194635.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6075/20416075/interior_front_seats-1774708194635.jpg saved to cache
2026-03-29 20:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 44c94db1-ef50-5a25-97ff-67721bcc98e5
2026-03-29 20:14:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1281/3181281/exterior_rear_driver-1774525537164.jpg> (referer: None)
2026-03-29 20:14:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1281/3181281/exterior_front_passenger-1774525719207.jpg> (referer: None)
2026-03-29 20:14:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6075/20416075/exterior_front_passenger-1774707050768.jpg> (referer: None)
2026-03-29 20:14:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6075/20416075/exterior_rear_driver-1774707002095.jpg> (referer: None)
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf2fd90>
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d86f90b-3db3-5c4f-90e0-9ef0e224b653/9d86f90b-3db3-5c4f-90e0-9ef0e224b653_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1281%252F3181281%252Fexterior_rear_driver-1774525537164.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1281/3181281/exterior_rear_driver-1774525537164.jpg saved to cache
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9d86f90b-3db3-5c4f-90e0-9ef0e224b653
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589e40d0>
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d86f90b-3db3-5c4f-90e0-9ef0e224b653/9d86f90b-3db3-5c4f-90e0-9ef0e224b653_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1281%252F3181281%252Fexterior_front_passenger-1774525719207.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1281/3181281/exterior_front_passenger-1774525719207.jpg saved to cache
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9d86f90b-3db3-5c4f-90e0-9ef0e224b653
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658476510>
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44c94db1-ef50-5a25-97ff-67721bcc98e5/44c94db1-ef50-5a25-97ff-67721bcc98e5_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6075%252F20416075%252Fexterior_front_passenger-1774707050768.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6075/20416075/exterior_front_passenger-1774707050768.jpg saved to cache
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 44c94db1-ef50-5a25-97ff-67721bcc98e5
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c94810>
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:14:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44c94db1-ef50-5a25-97ff-67721bcc98e5/44c94db1-ef50-5a25-97ff-67721bcc98e5_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6075%252F20416075%252Fexterior_rear_driver-1774707002095.jpg') HTTP/1.1" 204 0
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6075/20416075/exterior_rear_driver-1774707002095.jpg saved to cache
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 44c94db1-ef50-5a25-97ff-67721bcc98e5
2026-03-29 20:14:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44c94db1-ef50-5a25-97ff-67721bcc98e5, skipping ID generation
2026-03-29 20:14:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44c94db1-ef50-5a25-97ff-67721bcc98e5 with scrape type 1
2026-03-29 20:14:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44c94db1-ef50-5a25-97ff-67721bcc98e5 sending to next pipeline
2026-03-29 20:14:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 44c94db1-ef50-5a25-97ff-67721bcc98e5, identifier: 20416075
2026-03-29 20:14:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 44c94db1-ef50-5a25-97ff-67721bcc98e5 with identifier: 20416075
2026-03-29 20:14:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 44c94db1-ef50-5a25-97ff-67721bcc98e5 with identifier: 20416075
2026-03-29 20:14:59 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 44c94db1-ef50-5a25-97ff-67721bcc98e5 with identifier: 20416075 to the API
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:14:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6075/20416075/exterior_rear_driver-1774707002095.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '44c94db1-ef50-5a25-97ff-67721bcc98e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'RO09 ESH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20416075',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Jaguar',
'model': 'F-PACE',
'odometer': 68907,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44c94db1-ef50-5a25-97ff-67721bcc98e5/44c94db1-ef50-5a25-97ff-67721bcc98e5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2827210,
'Height': 2986,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6075/20416075/exterior_front_driver-1774706954554.jpg',
'Width': 3981},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44c94db1-ef50-5a25-97ff-67721bcc98e5/44c94db1-ef50-5a25-97ff-67721bcc98e5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2534817,
'Height': 2906,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6075/20416075/exterior_rear_driver-1774707002095.jpg',
'Width': 3875},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44c94db1-ef50-5a25-97ff-67721bcc98e5/44c94db1-ef50-5a25-97ff-67721bcc98e5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2507245,
'Height': 2982,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6075/20416075/exterior_front_passenger-1774707050768.jpg',
'Width': 3976},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44c94db1-ef50-5a25-97ff-67721bcc98e5/44c94db1-ef50-5a25-97ff-67721bcc98e5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2453945,
'Height': 3018,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6075/20416075/exterior_rear_passenger-1774707022864.jpg',
'Width': 4024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44c94db1-ef50-5a25-97ff-67721bcc98e5/44c94db1-ef50-5a25-97ff-67721bcc98e5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3594271,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6075/20416075/interior_front_seats-1774708194635.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44c94db1-ef50-5a25-97ff-67721bcc98e5/44c94db1-ef50-5a25-97ff-67721bcc98e5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3351719,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6075/20416075/interior_rear_seats-1774707854858.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44c94db1-ef50-5a25-97ff-67721bcc98e5/44c94db1-ef50-5a25-97ff-67721bcc98e5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2153739,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6075/20416075/interior_dashboard-1774708811904.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44c94db1-ef50-5a25-97ff-67721bcc98e5/44c94db1-ef50-5a25-97ff-67721bcc98e5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2385742,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6075/20416075/instrument_cluster-1774708200506.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44c94db1-ef50-5a25-97ff-67721bcc98e5/44c94db1-ef50-5a25-97ff-67721bcc98e5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4504003,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6075/20416075/interior_boot-1774708018016.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44c94db1-ef50-5a25-97ff-67721bcc98e5/44c94db1-ef50-5a25-97ff-67721bcc98e5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332341,
'Height': 1777,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6075/20416075/docs_service_history-1774708256137.jpg?ixlib=js-3.8.0&auto=format&s=ca31e738fc487aa736b512fa67037787',
'Width': 1290}],
'price': 9405,
'price_includes_vat': False,
'registration_date': '2017-11-29',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar F-PACE R-Sport AWD D Auto',
'transmission': 'automatic',
'trim': 'R-Sport AWD D Auto',
'vin': 'SADCA2AN5JA283382',
'year': 2017}
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720416075%27 HTTP/1.1" 200 None
2026-03-29 20:14:59 [motorway.uk] INFO: Saving data for 20416075: {'created_time': 1774815299.901838, 'last_price_update_time': 1774815299.901853, 'auction_closing_time': 1774884600.0}
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20416075') HTTP/1.1" 204 0
2026-03-29 20:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6604/20376604/wheels_front_driver-1774100996935.jpg> (referer: None)
2026-03-29 20:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9212/20049212/docs_service_history-1774094911514.jpg?ixlib=js-3.8.0&auto=format&s=c44cdbfaa7f8b322a0afc491f8301300> (referer: None)
2026-03-29 20:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6604/20376604/interior_dashboard-1774102849181.jpg> (referer: None)
2026-03-29 20:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/6604/20376604/docs_service_history-1774104291984.jpg?ixlib=js-3.8.0&auto=format&s=1133fd32d819bef5caab551e2b96b7d7> (referer: None)
2026-03-29 20:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1281/3181281/exterior_front_driver-1774525511314.jpg> (referer: None)
2026-03-29 20:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6604/20376604/interior_rear_seats-1774101201807.jpg> (referer: None)
2026-03-29 20:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6604/20376604/interior_boot-1774101200137.jpg> (referer: None)
2026-03-29 20:14:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9212/20049212/exterior_front_driver-1774094124293.jpg> (referer: None)
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584f2d90>
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71e27aaf-be75-50dd-b2a3-ca685f9a9438/71e27aaf-be75-50dd-b2a3-ca685f9a9438_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6604%252F20376604%252Fwheels_front_driver-1774100996935.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6604/20376604/wheels_front_driver-1774100996935.jpg saved to cache
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 71e27aaf-be75-50dd-b2a3-ca685f9a9438
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659bcab50>
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4648e4-4f61-5331-abdc-94f79af85200/aa4648e4-4f61-5331-abdc-94f79af85200_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9212%252F20049212%252Fdocs_service_history-1774094911514.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc44cdbfaa7f8b322a0afc491f8301300') HTTP/1.1" 204 0
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9212/20049212/docs_service_history-1774094911514.jpg?ixlib=js-3.8.0&auto=format&s=c44cdbfaa7f8b322a0afc491f8301300 saved to cache
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aa4648e4-4f61-5331-abdc-94f79af85200
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b61b50>
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71e27aaf-be75-50dd-b2a3-ca685f9a9438/71e27aaf-be75-50dd-b2a3-ca685f9a9438_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6604%252F20376604%252Finterior_dashboard-1774102849181.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6604/20376604/interior_dashboard-1774102849181.jpg saved to cache
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 71e27aaf-be75-50dd-b2a3-ca685f9a9438
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b815d0>
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71e27aaf-be75-50dd-b2a3-ca685f9a9438/71e27aaf-be75-50dd-b2a3-ca685f9a9438_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6604%252F20376604%252Fdocs_service_history-1774104291984.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1133fd32d819bef5caab551e2b96b7d7') HTTP/1.1" 204 0
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6604/20376604/docs_service_history-1774104291984.jpg?ixlib=js-3.8.0&auto=format&s=1133fd32d819bef5caab551e2b96b7d7 saved to cache
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 71e27aaf-be75-50dd-b2a3-ca685f9a9438
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65999eb50>
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d86f90b-3db3-5c4f-90e0-9ef0e224b653/9d86f90b-3db3-5c4f-90e0-9ef0e224b653_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1281%252F3181281%252Fexterior_front_driver-1774525511314.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1281/3181281/exterior_front_driver-1774525511314.jpg saved to cache
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d86f90b-3db3-5c4f-90e0-9ef0e224b653
2026-03-29 20:15:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d86f90b-3db3-5c4f-90e0-9ef0e224b653, skipping ID generation
2026-03-29 20:15:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d86f90b-3db3-5c4f-90e0-9ef0e224b653 with scrape type 1
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d86f90b-3db3-5c4f-90e0-9ef0e224b653 sending to next pipeline
2026-03-29 20:15:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9d86f90b-3db3-5c4f-90e0-9ef0e224b653, identifier: 3181281
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584f1e50>
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71e27aaf-be75-50dd-b2a3-ca685f9a9438/71e27aaf-be75-50dd-b2a3-ca685f9a9438_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6604%252F20376604%252Finterior_rear_seats-1774101201807.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6604/20376604/interior_rear_seats-1774101201807.jpg saved to cache
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 71e27aaf-be75-50dd-b2a3-ca685f9a9438
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658dd5b90>
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71e27aaf-be75-50dd-b2a3-ca685f9a9438/71e27aaf-be75-50dd-b2a3-ca685f9a9438_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6604%252F20376604%252Finterior_boot-1774101200137.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6604/20376604/interior_boot-1774101200137.jpg saved to cache
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 71e27aaf-be75-50dd-b2a3-ca685f9a9438
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b61a50>
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4648e4-4f61-5331-abdc-94f79af85200/aa4648e4-4f61-5331-abdc-94f79af85200_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9212%252F20049212%252Fexterior_front_driver-1774094124293.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9212/20049212/exterior_front_driver-1774094124293.jpg saved to cache
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa4648e4-4f61-5331-abdc-94f79af85200
2026-03-29 20:15:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa4648e4-4f61-5331-abdc-94f79af85200, skipping ID generation
2026-03-29 20:15:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa4648e4-4f61-5331-abdc-94f79af85200 with scrape type 1
2026-03-29 20:15:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa4648e4-4f61-5331-abdc-94f79af85200 sending to next pipeline
2026-03-29 20:15:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: aa4648e4-4f61-5331-abdc-94f79af85200, identifier: 20049212
2026-03-29 20:15:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9d86f90b-3db3-5c4f-90e0-9ef0e224b653 with identifier: 3181281
2026-03-29 20:15:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9d86f90b-3db3-5c4f-90e0-9ef0e224b653 with identifier: 3181281
2026-03-29 20:15:01 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9d86f90b-3db3-5c4f-90e0-9ef0e224b653 with identifier: 3181281 to the API
2026-03-29 20:15:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1281/3181281/exterior_front_driver-1774525511314.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '9d86f90b-3db3-5c4f-90e0-9ef0e224b653',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BG66 KHR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/3181281',
'listing': 'auction',
'location': 'Cheshire East Nantwich',
'make': 'Mercedes',
'model': 'CLS',
'odometer': 55000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d86f90b-3db3-5c4f-90e0-9ef0e224b653/9d86f90b-3db3-5c4f-90e0-9ef0e224b653_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1582358,
'Height': 2538,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1281/3181281/exterior_front_driver-1774525511314.jpg',
'Width': 3384},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d86f90b-3db3-5c4f-90e0-9ef0e224b653/9d86f90b-3db3-5c4f-90e0-9ef0e224b653_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1635766,
'Height': 2564,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1281/3181281/exterior_rear_driver-1774525537164.jpg',
'Width': 3419},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d86f90b-3db3-5c4f-90e0-9ef0e224b653/9d86f90b-3db3-5c4f-90e0-9ef0e224b653_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2163113,
'Height': 2842,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1281/3181281/exterior_front_passenger-1774525719207.jpg',
'Width': 3789},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d86f90b-3db3-5c4f-90e0-9ef0e224b653/9d86f90b-3db3-5c4f-90e0-9ef0e224b653_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2079133,
'Height': 2737,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1281/3181281/exterior_rear_passenger-1774525670191.jpg',
'Width': 3649},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d86f90b-3db3-5c4f-90e0-9ef0e224b653/9d86f90b-3db3-5c4f-90e0-9ef0e224b653_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3485299,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1281/3181281/interior_front_seats-1774779251424.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d86f90b-3db3-5c4f-90e0-9ef0e224b653/9d86f90b-3db3-5c4f-90e0-9ef0e224b653_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3202817,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1281/3181281/interior_rear_seats-1774779205449.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d86f90b-3db3-5c4f-90e0-9ef0e224b653/9d86f90b-3db3-5c4f-90e0-9ef0e224b653_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3322025,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1281/3181281/interior_dashboard-1774779231514.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d86f90b-3db3-5c4f-90e0-9ef0e224b653/9d86f90b-3db3-5c4f-90e0-9ef0e224b653_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2224296,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1281/3181281/instrument_cluster-1774779291271.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d86f90b-3db3-5c4f-90e0-9ef0e224b653/9d86f90b-3db3-5c4f-90e0-9ef0e224b653_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3696870,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1281/3181281/interior_boot-1774779234224.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d86f90b-3db3-5c4f-90e0-9ef0e224b653/9d86f90b-3db3-5c4f-90e0-9ef0e224b653_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 124749,
'Height': 842,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1281/3181281/docs_service_history-1774779440695.jpg?ixlib=js-3.8.0&auto=format&s=89485494d7c77e4dc648da887c833a6b',
'Width': 596}],
'price': 14316,
'price_includes_vat': False,
'registration_date': '2016-09-28',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes CLS350 D AMG Line Premium Auto',
'transmission': 'automatic',
'trim': '350 D AMG Line Premium Auto',
'vin': 'WDD2183262A170787',
'year': 2016}
2026-03-29 20:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273181281%27 HTTP/1.1" 200 None
2026-03-29 20:15:01 [motorway.uk] INFO: Saving data for 3181281: {'created_time': 1774815301.491185, 'last_price_update_time': 1774815301.4912, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='3181281') HTTP/1.1" 204 0
2026-03-29 20:15:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: aa4648e4-4f61-5331-abdc-94f79af85200 with identifier: 20049212
2026-03-29 20:15:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: aa4648e4-4f61-5331-abdc-94f79af85200 with identifier: 20049212
2026-03-29 20:15:01 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: aa4648e4-4f61-5331-abdc-94f79af85200 with identifier: 20049212 to the API
2026-03-29 20:15:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9212/20049212/exterior_front_driver-1774094124293.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'aa4648e4-4f61-5331-abdc-94f79af85200',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DU19 LRO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20049212',
'listing': 'auction',
'location': 'Dorset Christchurch',
'make': 'Vauxhall',
'model': 'Astra',
'odometer': 49063,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4648e4-4f61-5331-abdc-94f79af85200/aa4648e4-4f61-5331-abdc-94f79af85200_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2371202,
'Height': 2750,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9212/20049212/exterior_front_driver-1774094124293.jpg',
'Width': 3666},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4648e4-4f61-5331-abdc-94f79af85200/aa4648e4-4f61-5331-abdc-94f79af85200_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1576243,
'Height': 2317,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9212/20049212/exterior_rear_driver-1774094142489.jpg',
'Width': 3089},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4648e4-4f61-5331-abdc-94f79af85200/aa4648e4-4f61-5331-abdc-94f79af85200_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1599952,
'Height': 2635,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9212/20049212/exterior_front_passenger-1774094163029.jpg',
'Width': 3513},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4648e4-4f61-5331-abdc-94f79af85200/aa4648e4-4f61-5331-abdc-94f79af85200_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1371587,
'Height': 2338,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9212/20049212/exterior_rear_passenger-1774094156702.jpg',
'Width': 3117},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4648e4-4f61-5331-abdc-94f79af85200/aa4648e4-4f61-5331-abdc-94f79af85200_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2967826,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9212/20049212/interior_front_seats-1774094820177.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4648e4-4f61-5331-abdc-94f79af85200/aa4648e4-4f61-5331-abdc-94f79af85200_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4129163,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9212/20049212/interior_rear_seats-1774094748367.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4648e4-4f61-5331-abdc-94f79af85200/aa4648e4-4f61-5331-abdc-94f79af85200_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3047097,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9212/20049212/interior_dashboard-1774094743842.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4648e4-4f61-5331-abdc-94f79af85200/aa4648e4-4f61-5331-abdc-94f79af85200_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4046601,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9212/20049212/interior_boot-1774094761135.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4648e4-4f61-5331-abdc-94f79af85200/aa4648e4-4f61-5331-abdc-94f79af85200_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 839067,
'Height': 2130,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9212/20049212/docs_service_history-1774094911514.jpg?ixlib=js-3.8.0&auto=format&s=c44cdbfaa7f8b322a0afc491f8301300',
'Width': 3249},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa4648e4-4f61-5331-abdc-94f79af85200/aa4648e4-4f61-5331-abdc-94f79af85200_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 692875,
'Height': 1895,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9212/20049212/docs_service_history-1774094926975.jpg?ixlib=js-3.8.0&auto=format&s=414b0481c432b9330df2d5f255352866',
'Width': 3602}],
'price': 6741,
'price_includes_vat': False,
'registration_date': '2019-03-31',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Astra Tech Line NAV Turbo',
'transmission': 'manual',
'trim': 'Tech Line NAV Turbo',
'vin': 'W0VBD6EBXKG336815',
'year': 2019}
2026-03-29 20:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720049212%27 HTTP/1.1" 200 None
2026-03-29 20:15:01 [motorway.uk] INFO: Saving data for 20049212: {'created_time': 1774815301.918521, 'last_price_update_time': 1774815301.918533, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20049212') HTTP/1.1" 204 0
2026-03-29 20:15:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6604/20376604/exterior_front_driver-1774102773306.jpg> (referer: None)
2026-03-29 20:15:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6604/20376604/interior_front_seats-1774102808160.jpg> (referer: None)
2026-03-29 20:15:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8808/15048808/exterior_front_passenger-1774358939170.jpg> (referer: None)
2026-03-29 20:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8808/15048808/exterior_rear_driver-1774358762100.jpg> (referer: None)
2026-03-29 20:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8808/15048808/exterior_rear_passenger-1774358925699.jpg> (referer: None)
2026-03-29 20:15:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8808/15048808/interior_front_seats-1774422653851.jpg> (referer: None)
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586f7590>
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71e27aaf-be75-50dd-b2a3-ca685f9a9438/71e27aaf-be75-50dd-b2a3-ca685f9a9438_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6604%252F20376604%252Fexterior_front_driver-1774102773306.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6604/20376604/exterior_front_driver-1774102773306.jpg saved to cache
2026-03-29 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 71e27aaf-be75-50dd-b2a3-ca685f9a9438
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d747d0>
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71e27aaf-be75-50dd-b2a3-ca685f9a9438/71e27aaf-be75-50dd-b2a3-ca685f9a9438_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6604%252F20376604%252Finterior_front_seats-1774102808160.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6604/20376604/interior_front_seats-1774102808160.jpg saved to cache
2026-03-29 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 71e27aaf-be75-50dd-b2a3-ca685f9a9438
2026-03-29 20:15:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 71e27aaf-be75-50dd-b2a3-ca685f9a9438, skipping ID generation
2026-03-29 20:15:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71e27aaf-be75-50dd-b2a3-ca685f9a9438 with scrape type 1
2026-03-29 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 71e27aaf-be75-50dd-b2a3-ca685f9a9438 sending to next pipeline
2026-03-29 20:15:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 71e27aaf-be75-50dd-b2a3-ca685f9a9438, identifier: 20376604
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65bc10310>
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dea1465-19a7-5857-a435-f19638bfdaae/5dea1465-19a7-5857-a435-f19638bfdaae_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8808%252F15048808%252Fexterior_front_passenger-1774358939170.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8808/15048808/exterior_front_passenger-1774358939170.jpg saved to cache
2026-03-29 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5dea1465-19a7-5857-a435-f19638bfdaae
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65869b090>
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dea1465-19a7-5857-a435-f19638bfdaae/5dea1465-19a7-5857-a435-f19638bfdaae_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8808%252F15048808%252Fexterior_rear_driver-1774358762100.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8808/15048808/exterior_rear_driver-1774358762100.jpg saved to cache
2026-03-29 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5dea1465-19a7-5857-a435-f19638bfdaae
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e11e10>
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dea1465-19a7-5857-a435-f19638bfdaae/5dea1465-19a7-5857-a435-f19638bfdaae_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8808%252F15048808%252Fexterior_rear_passenger-1774358925699.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8808/15048808/exterior_rear_passenger-1774358925699.jpg saved to cache
2026-03-29 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5dea1465-19a7-5857-a435-f19638bfdaae
2026-03-29 20:15:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfc8d50>
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dea1465-19a7-5857-a435-f19638bfdaae/5dea1465-19a7-5857-a435-f19638bfdaae_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8808%252F15048808%252Finterior_front_seats-1774422653851.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8808/15048808/interior_front_seats-1774422653851.jpg saved to cache
2026-03-29 20:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5dea1465-19a7-5857-a435-f19638bfdaae
2026-03-29 20:15:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 71e27aaf-be75-50dd-b2a3-ca685f9a9438 with identifier: 20376604
2026-03-29 20:15:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 71e27aaf-be75-50dd-b2a3-ca685f9a9438 with identifier: 20376604
2026-03-29 20:15:02 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 71e27aaf-be75-50dd-b2a3-ca685f9a9438 with identifier: 20376604 to the API
2026-03-29 20:15:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/6604/20376604/interior_front_seats-1774102808160.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '71e27aaf-be75-50dd-b2a3-ca685f9a9438',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'L111 JCJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20376604',
'listing': 'auction',
'location': 'Northamptonshire Wellingborough',
'make': 'MINI',
'model': 'Countryman',
'odometer': 88000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71e27aaf-be75-50dd-b2a3-ca685f9a9438/71e27aaf-be75-50dd-b2a3-ca685f9a9438_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1073582,
'Height': 2479,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6604/20376604/exterior_front_driver-1774102773306.jpg',
'Width': 3305},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71e27aaf-be75-50dd-b2a3-ca685f9a9438/71e27aaf-be75-50dd-b2a3-ca685f9a9438_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 996960,
'Height': 2389,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6604/20376604/exterior_rear_driver-1774100946168.jpg',
'Width': 3185},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71e27aaf-be75-50dd-b2a3-ca685f9a9438/71e27aaf-be75-50dd-b2a3-ca685f9a9438_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1610664,
'Height': 2577,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6604/20376604/exterior_front_passenger-1774102787653.jpg',
'Width': 3436},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71e27aaf-be75-50dd-b2a3-ca685f9a9438/71e27aaf-be75-50dd-b2a3-ca685f9a9438_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1468832,
'Height': 2408,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6604/20376604/exterior_rear_passenger-1774107228661.jpg',
'Width': 3211},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71e27aaf-be75-50dd-b2a3-ca685f9a9438/71e27aaf-be75-50dd-b2a3-ca685f9a9438_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1098230,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6604/20376604/interior_front_seats-1774102808160.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71e27aaf-be75-50dd-b2a3-ca685f9a9438/71e27aaf-be75-50dd-b2a3-ca685f9a9438_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1660441,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6604/20376604/interior_rear_seats-1774101201807.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71e27aaf-be75-50dd-b2a3-ca685f9a9438/71e27aaf-be75-50dd-b2a3-ca685f9a9438_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1255557,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6604/20376604/interior_dashboard-1774102849181.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71e27aaf-be75-50dd-b2a3-ca685f9a9438/71e27aaf-be75-50dd-b2a3-ca685f9a9438_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1777610,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6604/20376604/interior_boot-1774101200137.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71e27aaf-be75-50dd-b2a3-ca685f9a9438/71e27aaf-be75-50dd-b2a3-ca685f9a9438_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1271489,
'Height': 1920,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/6604/20376604/docs_service_history-1774104291984.jpg?ixlib=js-3.8.0&auto=format&s=1133fd32d819bef5caab551e2b96b7d7',
'Width': 2560},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71e27aaf-be75-50dd-b2a3-ca685f9a9438/71e27aaf-be75-50dd-b2a3-ca685f9a9438_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377006,
'Height': 1820,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6604/20376604/wheels_front_driver-1774100996935.jpg',
'Width': 2427}],
'price': 10175,
'price_includes_vat': False,
'registration_date': '2019-02-26',
'seats_number': None,
'seller_name': None,
'title': 'MINI Countryman Cooper S Exclusive',
'transmission': 'manual',
'trim': 'Cooper S Exclusive',
'vin': 'WMWYW720803J00334',
'year': 2019}
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720376604%27 HTTP/1.1" 200 None
2026-03-29 20:15:03 [motorway.uk] INFO: Saving data for 20376604: {'created_time': 1774815303.251441, 'last_price_update_time': 1774815303.251454, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20376604') HTTP/1.1" 204 0
2026-03-29 20:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18253303.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8808/15048808/exterior_front_driver-1774358900504.jpg> (referer: None)
2026-03-29 20:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=864&page=24&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7947/20487947/exterior_rear_driver-1774703000575.jpg> (referer: None)
2026-03-29 20:15:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7947/20487947/exterior_front_passenger-1774703035978.jpg> (referer: None)
2026-03-29 20:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7947/20487947/exterior_front_driver-1774702929907.jpg> (referer: None)
2026-03-29 20:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2807/19842807/interior_dashboard-1774699338302.jpg> (referer: None)
2026-03-29 20:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2807/19842807/interior_boot-1774699183610.jpg> (referer: None)
2026-03-29 20:15:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2807/19842807/interior_rear_seats-1774699266954.jpg> (referer: None)
2026-03-29 20:15:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6aae8cd-49e3-5b8a-b45b-d4cee1fd6a3f with identifier: 18253303
2026-03-29 20:15:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6aae8cd-49e3-5b8a-b45b-d4cee1fd6a3f with scrape type 1
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e6aae8cd-49e3-5b8a-b45b-d4cee1fd6a3f
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3303%252F18253303%252Fexterior_front_driver-1774544379670.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3303/18253303/exterior_front_driver-1774544379670.jpg not downloaded yet
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3303%252F18253303%252Fexterior_rear_driver-1774544381480.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3303/18253303/exterior_rear_driver-1774544381480.jpg not downloaded yet
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3303%252F18253303%252Fexterior_front_passenger-1774544384492.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3303/18253303/exterior_front_passenger-1774544384492.jpg not downloaded yet
2026-03-29 20:15:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fb1650>
2026-03-29 20:15:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5dea1465-19a7-5857-a435-f19638bfdaae/5dea1465-19a7-5857-a435-f19638bfdaae_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8808%252F15048808%252Fexterior_front_driver-1774358900504.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8808/15048808/exterior_front_driver-1774358900504.jpg saved to cache
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5dea1465-19a7-5857-a435-f19638bfdaae
2026-03-29 20:15:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5dea1465-19a7-5857-a435-f19638bfdaae, skipping ID generation
2026-03-29 20:15:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dea1465-19a7-5857-a435-f19638bfdaae with scrape type 1
2026-03-29 20:15:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5dea1465-19a7-5857-a435-f19638bfdaae sending to next pipeline
2026-03-29 20:15:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5dea1465-19a7-5857-a435-f19638bfdaae, identifier: 15048808
2026-03-29 20:15:03 [motorway.uk] INFO: Found listing with ID: 1329664
2026-03-29 20:15:03 [motorway.uk] INFO: Found listing with ID: 20409002
2026-03-29 20:15:03 [motorway.uk] INFO: Found listing with ID: 18827226
2026-03-29 20:15:03 [motorway.uk] INFO: Found listing with ID: 20436077
2026-03-29 20:15:03 [motorway.uk] INFO: Found listing with ID: 16052794
2026-03-29 20:15:03 [motorway.uk] INFO: Found listing with ID: 20401398
2026-03-29 20:15:03 [motorway.uk] INFO: Found listing with ID: 20375710
2026-03-29 20:15:03 [motorway.uk] INFO: Found listing with ID: 17939747
2026-03-29 20:15:03 [motorway.uk] INFO: Found listing with ID: 20202196
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720202196%27 HTTP/1.1" 200 None
2026-03-29 20:15:03 [motorway.uk] INFO: Scrape type for 20202196: 1
2026-03-29 20:15:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5dea1465-19a7-5857-a435-f19638bfdaae with identifier: 15048808
2026-03-29 20:15:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5dea1465-19a7-5857-a435-f19638bfdaae with identifier: 15048808
2026-03-29 20:15:03 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5dea1465-19a7-5857-a435-f19638bfdaae with identifier: 15048808 to the API
2026-03-29 20:15:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8808/15048808/exterior_front_driver-1774358900504.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '5dea1465-19a7-5857-a435-f19638bfdaae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ML23 UVU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/15048808',
'listing': 'auction',
'location': 'Lincolnshire Lincoln',
'make': 'Audi',
'model': 'S3',
'odometer': 17000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dea1465-19a7-5857-a435-f19638bfdaae/5dea1465-19a7-5857-a435-f19638bfdaae_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1104727,
'Height': 2017,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8808/15048808/exterior_front_driver-1774358900504.jpg',
'Width': 2689},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dea1465-19a7-5857-a435-f19638bfdaae/5dea1465-19a7-5857-a435-f19638bfdaae_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1763941,
'Height': 2494,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8808/15048808/exterior_rear_driver-1774358762100.jpg',
'Width': 3325},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dea1465-19a7-5857-a435-f19638bfdaae/5dea1465-19a7-5857-a435-f19638bfdaae_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1243454,
'Height': 2121,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8808/15048808/exterior_front_passenger-1774358939170.jpg',
'Width': 2828},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dea1465-19a7-5857-a435-f19638bfdaae/5dea1465-19a7-5857-a435-f19638bfdaae_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1739769,
'Height': 2440,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8808/15048808/exterior_rear_passenger-1774358925699.jpg',
'Width': 3253},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dea1465-19a7-5857-a435-f19638bfdaae/5dea1465-19a7-5857-a435-f19638bfdaae_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2765400,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8808/15048808/interior_front_seats-1774422653851.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dea1465-19a7-5857-a435-f19638bfdaae/5dea1465-19a7-5857-a435-f19638bfdaae_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3427020,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8808/15048808/interior_rear_seats-1774422666377.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dea1465-19a7-5857-a435-f19638bfdaae/5dea1465-19a7-5857-a435-f19638bfdaae_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3124378,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8808/15048808/interior_dashboard-1774422678455.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dea1465-19a7-5857-a435-f19638bfdaae/5dea1465-19a7-5857-a435-f19638bfdaae_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2756632,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8808/15048808/instrument_cluster-1774422687083.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dea1465-19a7-5857-a435-f19638bfdaae/5dea1465-19a7-5857-a435-f19638bfdaae_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4417978,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8808/15048808/interior_boot-1774422662507.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5dea1465-19a7-5857-a435-f19638bfdaae/5dea1465-19a7-5857-a435-f19638bfdaae_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187338,
'Height': 2796,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8808/15048808/docs_service_history-1774288348610.jpeg?ixlib=js-3.8.0&auto=format&s=1bc9c00db0fa319176365980e6abe2aa',
'Width': 1290}],
'price': 31100,
'price_includes_vat': False,
'registration_date': '2023-04-28',
'seats_number': None,
'seller_name': None,
'title': 'Audi S3 TFSI Quattro S-A',
'transmission': 'automatic',
'trim': 'TFSI Quattro S-A',
'vin': 'WAUZZZGY6PA099230',
'year': 2023}
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715048808%27 HTTP/1.1" 200 None
2026-03-29 20:15:04 [motorway.uk] INFO: Saving data for 15048808: {'created_time': 1774815304.149719, 'last_price_update_time': 1774815304.149731, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='15048808') HTTP/1.1" 204 0
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3303%252F18253303%252Fexterior_rear_passenger-1774544525417.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3303/18253303/exterior_rear_passenger-1774544525417.jpg not downloaded yet
2026-03-29 20:15:04 [motorway.uk] INFO: Found listing with ID: 18800703
2026-03-29 20:15:04 [motorway.uk] INFO: Found listing with ID: 12120509
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712120509%27 HTTP/1.1" 200 None
2026-03-29 20:15:04 [motorway.uk] INFO: Scrape type for 12120509: 1
2026-03-29 20:15:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599ea310>
2026-03-29 20:15:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907b1c2d-546e-54dc-8060-5412b3b7b964/907b1c2d-546e-54dc-8060-5412b3b7b964_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7947%252F20487947%252Fexterior_rear_driver-1774703000575.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7947/20487947/exterior_rear_driver-1774703000575.jpg saved to cache
2026-03-29 20:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 907b1c2d-546e-54dc-8060-5412b3b7b964
2026-03-29 20:15:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658426f90>
2026-03-29 20:15:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907b1c2d-546e-54dc-8060-5412b3b7b964/907b1c2d-546e-54dc-8060-5412b3b7b964_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7947%252F20487947%252Fexterior_front_passenger-1774703035978.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7947/20487947/exterior_front_passenger-1774703035978.jpg saved to cache
2026-03-29 20:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 907b1c2d-546e-54dc-8060-5412b3b7b964
2026-03-29 20:15:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a09b50>
2026-03-29 20:15:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_907b1c2d-546e-54dc-8060-5412b3b7b964/907b1c2d-546e-54dc-8060-5412b3b7b964_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7947%252F20487947%252Fexterior_front_driver-1774702929907.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7947/20487947/exterior_front_driver-1774702929907.jpg saved to cache
2026-03-29 20:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 907b1c2d-546e-54dc-8060-5412b3b7b964
2026-03-29 20:15:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 907b1c2d-546e-54dc-8060-5412b3b7b964, skipping ID generation
2026-03-29 20:15:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 907b1c2d-546e-54dc-8060-5412b3b7b964 with scrape type 1
2026-03-29 20:15:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 907b1c2d-546e-54dc-8060-5412b3b7b964 sending to next pipeline
2026-03-29 20:15:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 907b1c2d-546e-54dc-8060-5412b3b7b964, identifier: 20487947
2026-03-29 20:15:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 907b1c2d-546e-54dc-8060-5412b3b7b964 with identifier: 20487947
2026-03-29 20:15:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 907b1c2d-546e-54dc-8060-5412b3b7b964 with identifier: 20487947
2026-03-29 20:15:05 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 907b1c2d-546e-54dc-8060-5412b3b7b964 with identifier: 20487947 to the API
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7947/20487947/exterior_front_driver-1774702929907.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.9L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '907b1c2d-546e-54dc-8060-5412b3b7b964',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'T888 AYO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20487947',
'listing': 'auction',
'location': 'Kent Dartford',
'make': 'Mercedes',
'model': 'E Class',
'odometer': 80479,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907b1c2d-546e-54dc-8060-5412b3b7b964/907b1c2d-546e-54dc-8060-5412b3b7b964_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1674164,
'Height': 2736,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7947/20487947/exterior_front_driver-1774702929907.jpg',
'Width': 3648},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907b1c2d-546e-54dc-8060-5412b3b7b964/907b1c2d-546e-54dc-8060-5412b3b7b964_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1136639,
'Height': 2418,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7947/20487947/exterior_rear_driver-1774703000575.jpg',
'Width': 3224},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907b1c2d-546e-54dc-8060-5412b3b7b964/907b1c2d-546e-54dc-8060-5412b3b7b964_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1307368,
'Height': 2252,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7947/20487947/exterior_front_passenger-1774703035978.jpg',
'Width': 3002},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907b1c2d-546e-54dc-8060-5412b3b7b964/907b1c2d-546e-54dc-8060-5412b3b7b964_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1605749,
'Height': 2702,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7947/20487947/exterior_rear_passenger-1774703020615.jpg',
'Width': 3603},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907b1c2d-546e-54dc-8060-5412b3b7b964/907b1c2d-546e-54dc-8060-5412b3b7b964_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3307366,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7947/20487947/interior_front_seats-1774703876214.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907b1c2d-546e-54dc-8060-5412b3b7b964/907b1c2d-546e-54dc-8060-5412b3b7b964_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4329458,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7947/20487947/interior_rear_seats-1774703703899.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907b1c2d-546e-54dc-8060-5412b3b7b964/907b1c2d-546e-54dc-8060-5412b3b7b964_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2983785,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7947/20487947/interior_dashboard-1774703943988.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907b1c2d-546e-54dc-8060-5412b3b7b964/907b1c2d-546e-54dc-8060-5412b3b7b964_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2592017,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7947/20487947/instrument_cluster-1774703741625.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907b1c2d-546e-54dc-8060-5412b3b7b964/907b1c2d-546e-54dc-8060-5412b3b7b964_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3012427,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7947/20487947/interior_boot-1774703821402.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_907b1c2d-546e-54dc-8060-5412b3b7b964/907b1c2d-546e-54dc-8060-5412b3b7b964_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 169528,
'Height': 1887,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/7947/20487947/docs_service_history-1774706203484.jpg?ixlib=js-3.8.0&auto=format&s=92e071a56f5dc0162c57b71ac4f21592',
'Width': 1415}],
'price': 13605,
'price_includes_vat': False,
'registration_date': '2017-12-28',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes E 220 D AMG Line PREMIUM+ Auto',
'transmission': 'automatic',
'trim': 'E 220 D AMG Line PREMIUM+ Auto',
'vin': 'WDD2384142F035083',
'year': 2017}
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487947%27 HTTP/1.1" 200 None
2026-03-29 20:15:05 [motorway.uk] INFO: Saving data for 20487947: {'created_time': 1774815305.450497, 'last_price_update_time': 1774815305.45051, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20487947') HTTP/1.1" 204 0
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3303%252F18253303%252Finterior_front_seats-1774546232575.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3303/18253303/interior_front_seats-1774546232575.jpg not downloaded yet
2026-03-29 20:15:05 [motorway.uk] INFO: Found listing with ID: 14548428
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714548428%27 HTTP/1.1" 200 None
2026-03-29 20:15:05 [motorway.uk] INFO: Scrape type for 14548428: 1
2026-03-29 20:15:05 [scrapy.extensions.logstats] INFO: Crawled 206 pages (at 42 pages/min), scraped 102 items (at 26 items/min)
2026-03-29 20:15:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 258MiB
2026-03-29 20:15:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a09010>
2026-03-29 20:15:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8529270-ca53-5180-9787-f26a4e649748/e8529270-ca53-5180-9787-f26a4e649748_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2807%252F19842807%252Finterior_dashboard-1774699338302.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2807/19842807/interior_dashboard-1774699338302.jpg saved to cache
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8529270-ca53-5180-9787-f26a4e649748
2026-03-29 20:15:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e5f1d0>
2026-03-29 20:15:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8529270-ca53-5180-9787-f26a4e649748/e8529270-ca53-5180-9787-f26a4e649748_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2807%252F19842807%252Finterior_boot-1774699183610.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2807/19842807/interior_boot-1774699183610.jpg saved to cache
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8529270-ca53-5180-9787-f26a4e649748
2026-03-29 20:15:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659bbd590>
2026-03-29 20:15:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8529270-ca53-5180-9787-f26a4e649748/e8529270-ca53-5180-9787-f26a4e649748_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2807%252F19842807%252Finterior_rear_seats-1774699266954.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2807/19842807/interior_rear_seats-1774699266954.jpg saved to cache
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8529270-ca53-5180-9787-f26a4e649748
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3303%252F18253303%252Finterior_rear_seats-1774544798255.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3303/18253303/interior_rear_seats-1774544798255.jpg not downloaded yet
2026-03-29 20:15:06 [motorway.uk] INFO: Found listing with ID: 20386514
2026-03-29 20:15:06 [motorway.uk] INFO: Found listing with ID: 17979492
2026-03-29 20:15:06 [motorway.uk] INFO: Found listing with ID: 20435734
2026-03-29 20:15:06 [motorway.uk] INFO: Found listing with ID: 19226483
2026-03-29 20:15:06 [motorway.uk] INFO: Found listing with ID: 20265624
2026-03-29 20:15:06 [motorway.uk] INFO: Found listing with ID: 7585646
2026-03-29 20:15:06 [motorway.uk] INFO: Found listing with ID: 19995676
2026-03-29 20:15:06 [motorway.uk] INFO: Found listing with ID: 16512497
2026-03-29 20:15:06 [motorway.uk] INFO: Found listing with ID: 20498788
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720498788%27 HTTP/1.1" 200 None
2026-03-29 20:15:06 [motorway.uk] INFO: Scrape type for 20498788: 1
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3303%252F18253303%252Finterior_dashboard-1774546679287.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3303/18253303/interior_dashboard-1774546679287.jpg not downloaded yet
2026-03-29 20:15:06 [motorway.uk] INFO: Found listing with ID: 6438177
2026-03-29 20:15:06 [motorway.uk] INFO: Found listing with ID: 20309766
2026-03-29 20:15:06 [motorway.uk] INFO: Found listing with ID: 20454787
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720454787%27 HTTP/1.1" 200 None
2026-03-29 20:15:06 [motorway.uk] INFO: Scrape type for 20454787: 1
2026-03-29 20:15:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20494330.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3303%252F18253303%252Finterior_boot-1774544800031.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3303/18253303/interior_boot-1774544800031.jpg not downloaded yet
2026-03-29 20:15:06 [motorway.uk] INFO: Found listing with ID: 20456993
2026-03-29 20:15:06 [motorway.uk] INFO: Found listing with ID: 20486739
2026-03-29 20:15:06 [motorway.uk] INFO: Found listing with ID: 20130808
2026-03-29 20:15:06 [motorway.uk] INFO: Found listing with ID: 20423862
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720423862%27 HTTP/1.1" 200 None
2026-03-29 20:15:06 [motorway.uk] INFO: Scrape type for 20423862: 1
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3303%252F18253303%252Fdocs_service_history-1774545264745.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D77fdcbadd7cb72f5ecf959567d0a1437%27 HTTP/1.1" 200 None
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3303/18253303/docs_service_history-1774545264745.jpg?ixlib=js-3.8.0&auto=format&s=77fdcbadd7cb72f5ecf959567d0a1437 not downloaded yet
2026-03-29 20:15:06 [motorway.uk] INFO: Found listing with ID: 20283454
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720283454%27 HTTP/1.1" 200 None
2026-03-29 20:15:06 [motorway.uk] INFO: Scrape type for 20283454: 1
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3303%252F18253303%252Fdamage_scratches-1774547017032.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3303/18253303/damage_scratches-1774547017032.jpg not downloaded yet
2026-03-29 20:15:06 [motorway.uk] INFO: Found listing with ID: 10973365
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710973365%27 HTTP/1.1" 200 None
2026-03-29 20:15:06 [motorway.uk] INFO: Scrape type for 10973365: 1
2026-03-29 20:15:06 [motorway.uk] INFO: Found listing with ID: 20392215
2026-03-29 20:15:06 [motorway.uk] INFO: Found listing with ID: 20496032
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720496032%27 HTTP/1.1" 200 None
2026-03-29 20:15:06 [motorway.uk] INFO: Scrape type for 20496032: 1
2026-03-29 20:15:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20345939.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68c9dbc7-080a-5572-ab67-081994e9686f with identifier: 20494330
2026-03-29 20:15:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68c9dbc7-080a-5572-ab67-081994e9686f with scrape type 1
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 68c9dbc7-080a-5572-ab67-081994e9686f
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4330%252F20494330%252Fexterior_front_driver-1774779278400.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4330/20494330/exterior_front_driver-1774779278400.jpeg not downloaded yet
2026-03-29 20:15:06 [motorway.uk] INFO: Found listing with ID: 19667593
2026-03-29 20:15:06 [motorway.uk] INFO: Found listing with ID: 13151440
2026-03-29 20:15:06 [motorway.uk] INFO: Found listing with ID: 19970268
2026-03-29 20:15:06 [motorway.uk] INFO: Found listing with ID: 20240702
2026-03-29 20:15:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4330%252F20494330%252F20494330-exterior_rear_driver-modified-1774784483426.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4330/20494330/20494330-exterior_rear_driver-modified-1774784483426.jpeg not downloaded yet
2026-03-29 20:15:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7758/19747758/interior_dashboard-1774778239959.jpg> (referer: None)
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4330%252F20494330%252Fexterior_front_passenger-1774779316320.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4330/20494330/exterior_front_passenger-1774779316320.jpeg not downloaded yet
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4330%252F20494330%252F20494330-exterior_rear_passenger-modified-1774784589795.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4330/20494330/20494330-exterior_rear_passenger-modified-1774784589795.jpeg not downloaded yet
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4330%252F20494330%252F20494330-interior_front_seats-modified-1774784608572.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4330/20494330/20494330-interior_front_seats-modified-1774784608572.jpeg not downloaded yet
2026-03-29 20:15:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18276171.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4330%252F20494330%252Finterior_rear_seats-1774779461047.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4330/20494330/interior_rear_seats-1774779461047.jpeg not downloaded yet
2026-03-29 20:15:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64ffc591-7874-5442-a409-b295765bcff0 with identifier: 20345939
2026-03-29 20:15:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64ffc591-7874-5442-a409-b295765bcff0 with scrape type 1
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 64ffc591-7874-5442-a409-b295765bcff0
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5939%252F20345939%252Fexterior_front_driver-1774621119073.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5939/20345939/exterior_front_driver-1774621119073.jpg not downloaded yet
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4330%252F20494330%252F20494330-interior_dashboard-modified-1774784646148.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4330/20494330/20494330-interior_dashboard-modified-1774784646148.jpeg not downloaded yet
2026-03-29 20:15:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2807/19842807/exterior_front_passenger-1774698463178.jpg> (referer: None)
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5939%252F20345939%252Fexterior_rear_driver-1774621246893.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5939/20345939/exterior_rear_driver-1774621246893.jpg not downloaded yet
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4330%252F20494330%252F20494330-instrument_cluster-modified-1774784896358.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4330/20494330/20494330-instrument_cluster-modified-1774784896358.jpeg not downloaded yet
2026-03-29 20:15:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f6b350>
2026-03-29 20:15:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f9d1f9d-650a-59d6-b8ac-9f3c97509a75/8f9d1f9d-650a-59d6-b8ac-9f3c97509a75_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7758%252F19747758%252Finterior_dashboard-1774778239959.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7758/19747758/interior_dashboard-1774778239959.jpg saved to cache
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8f9d1f9d-650a-59d6-b8ac-9f3c97509a75
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5939%252F20345939%252Fexterior_front_passenger-1774619835585.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5939/20345939/exterior_front_passenger-1774619835585.jpg not downloaded yet
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4330%252F20494330%252F20494330-interior_boot-modified-1774784635122.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4330/20494330/20494330-interior_boot-modified-1774784635122.jpeg not downloaded yet
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5939%252F20345939%252Fexterior_rear_passenger-1774619850761.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5939/20345939/exterior_rear_passenger-1774619850761.jpg not downloaded yet
2026-03-29 20:15:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35f8854b-6974-5339-842f-48649375a541 with identifier: 18276171
2026-03-29 20:15:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35f8854b-6974-5339-842f-48649375a541 with scrape type 1
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 35f8854b-6974-5339-842f-48649375a541
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6171%252F18276171%252Fexterior_front_driver-1774509992681.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6171/18276171/exterior_front_driver-1774509992681.jpg not downloaded yet
2026-03-29 20:15:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659bf5fd0>
2026-03-29 20:15:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8529270-ca53-5180-9787-f26a4e649748/e8529270-ca53-5180-9787-f26a4e649748_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2807%252F19842807%252Fexterior_front_passenger-1774698463178.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2807/19842807/exterior_front_passenger-1774698463178.jpg saved to cache
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8529270-ca53-5180-9787-f26a4e649748
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4330%252F20494330%252Fdocs_service_history-1774783575733.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddfbe579d99922eb105d5aba1c7ef8490%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4330/20494330/docs_service_history-1774783575733.jpeg?ixlib=js-3.8.0&auto=format&s=dfbe579d99922eb105d5aba1c7ef8490 not downloaded yet
2026-03-29 20:15:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2807/19842807/exterior_rear_driver-1774698412789.jpg> (referer: None)
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5939%252F20345939%252Finterior_front_seats-1774621162116.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5939/20345939/interior_front_seats-1774621162116.jpg not downloaded yet
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6171%252F18276171%252Fexterior_rear_driver-1774510008595.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6171/18276171/exterior_rear_driver-1774510008595.jpg not downloaded yet
2026-03-29 20:15:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2807/19842807/exterior_front_driver-1774784929380.jpg> (referer: None)
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5939%252F20345939%252Finterior_rear_seats-1774620501929.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5939/20345939/interior_rear_seats-1774620501929.jpg not downloaded yet
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6171%252F18276171%252Fexterior_front_passenger-1774510036205.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6171/18276171/exterior_front_passenger-1774510036205.jpg not downloaded yet
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5939%252F20345939%252Finterior_dashboard-1774620486347.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5939/20345939/interior_dashboard-1774620486347.jpg not downloaded yet
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6171%252F18276171%252Fexterior_rear_passenger-1774510021580.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6171/18276171/exterior_rear_passenger-1774510021580.jpg not downloaded yet
2026-03-29 20:15:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65871bbd0>
2026-03-29 20:15:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8529270-ca53-5180-9787-f26a4e649748/e8529270-ca53-5180-9787-f26a4e649748_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2807%252F19842807%252Fexterior_rear_driver-1774698412789.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2807/19842807/exterior_rear_driver-1774698412789.jpg saved to cache
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8529270-ca53-5180-9787-f26a4e649748
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5939%252F20345939%252Finstrument_cluster-1774620420533.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5939/20345939/instrument_cluster-1774620420533.jpg not downloaded yet
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6171%252F18276171%252Finterior_front_seats-1774550007874.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6171/18276171/interior_front_seats-1774550007874.jpg not downloaded yet
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5939%252F20345939%252Finterior_boot-1774620489266.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5939/20345939/interior_boot-1774620489266.jpg not downloaded yet
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6171%252F18276171%252Finterior_rear_seats-1774550031719.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6171/18276171/interior_rear_seats-1774550031719.jpg not downloaded yet
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658425890>
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8529270-ca53-5180-9787-f26a4e649748/e8529270-ca53-5180-9787-f26a4e649748_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2807%252F19842807%252Fexterior_front_driver-1774784929380.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2807/19842807/exterior_front_driver-1774784929380.jpg saved to cache
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8529270-ca53-5180-9787-f26a4e649748
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F5939%252F20345939%252Fdocs_service_history-1774690973091.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfcd3b90f8924f29378d0d7de713bfbdf%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/5939/20345939/docs_service_history-1774690973091.jpg?ixlib=js-3.8.0&auto=format&s=fcd3b90f8924f29378d0d7de713bfbdf not downloaded yet
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6171%252F18276171%252Finterior_dashboard-1774550091494.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6171/18276171/interior_dashboard-1774550091494.jpg not downloaded yet
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6171%252F18276171%252Finstrument_cluster-1774550107812.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6171/18276171/instrument_cluster-1774550107812.jpg not downloaded yet
2026-03-29 20:15:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20490179.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6171%252F18276171%252Finterior_boot-1774550131571.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6171/18276171/interior_boot-1774550131571.jpg not downloaded yet
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6171%252F18276171%252Fdocs_service_history-1774552387392.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D16f9510c49702aa9423f4d8685320f7e%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6171/18276171/docs_service_history-1774552387392.jpg?ixlib=js-3.8.0&auto=format&s=16f9510c49702aa9423f4d8685320f7e not downloaded yet
2026-03-29 20:15:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3303/18253303/interior_rear_seats-1774544798255.jpg> (referer: None)
2026-03-29 20:15:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3303/18253303/interior_front_seats-1774546232575.jpg> (referer: None)
2026-03-29 20:15:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2807/19842807/interior_front_seats-1774699255936.jpg> (referer: None)
2026-03-29 20:15:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4330/20494330/exterior_front_driver-1774779278400.jpeg> (referer: None)
2026-03-29 20:15:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6171/18276171/exterior_rear_passenger-1774510021580.jpg> (referer: None)
2026-03-29 20:15:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50b56767-2f53-5948-a863-346dd1b88232 with identifier: 20490179
2026-03-29 20:15:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50b56767-2f53-5948-a863-346dd1b88232 with scrape type 1
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 50b56767-2f53-5948-a863-346dd1b88232
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0179%252F20490179%252Fexterior_front_driver-1774709670684.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0179/20490179/exterior_front_driver-1774709670684.jpg not downloaded yet
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0179%252F20490179%252Fexterior_rear_driver-1774709692549.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0179/20490179/exterior_rear_driver-1774709692549.jpg not downloaded yet
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0179%252F20490179%252Fexterior_front_passenger-1774709761560.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0179/20490179/exterior_front_passenger-1774709761560.jpg not downloaded yet
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65853dd50>
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6aae8cd-49e3-5b8a-b45b-d4cee1fd6a3f/e6aae8cd-49e3-5b8a-b45b-d4cee1fd6a3f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3303%252F18253303%252Finterior_rear_seats-1774544798255.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3303/18253303/interior_rear_seats-1774544798255.jpg saved to cache
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e6aae8cd-49e3-5b8a-b45b-d4cee1fd6a3f
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c1b310>
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6aae8cd-49e3-5b8a-b45b-d4cee1fd6a3f/e6aae8cd-49e3-5b8a-b45b-d4cee1fd6a3f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3303%252F18253303%252Finterior_front_seats-1774546232575.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3303/18253303/interior_front_seats-1774546232575.jpg saved to cache
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e6aae8cd-49e3-5b8a-b45b-d4cee1fd6a3f
2026-03-29 20:15:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ce0550>
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8529270-ca53-5180-9787-f26a4e649748/e8529270-ca53-5180-9787-f26a4e649748_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2807%252F19842807%252Finterior_front_seats-1774699255936.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2807/19842807/interior_front_seats-1774699255936.jpg saved to cache
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8529270-ca53-5180-9787-f26a4e649748
2026-03-29 20:15:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8529270-ca53-5180-9787-f26a4e649748, skipping ID generation
2026-03-29 20:15:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8529270-ca53-5180-9787-f26a4e649748 with scrape type 1
2026-03-29 20:15:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8529270-ca53-5180-9787-f26a4e649748 sending to next pipeline
2026-03-29 20:15:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e8529270-ca53-5180-9787-f26a4e649748, identifier: 19842807
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0179%252F20490179%252Fexterior_rear_passenger-1774709738635.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0179/20490179/exterior_rear_passenger-1774709738635.jpg not downloaded yet
2026-03-29 20:15:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e8529270-ca53-5180-9787-f26a4e649748 with identifier: 19842807
2026-03-29 20:15:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e8529270-ca53-5180-9787-f26a4e649748 with identifier: 19842807
2026-03-29 20:15:09 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e8529270-ca53-5180-9787-f26a4e649748 with identifier: 19842807 to the API
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/2807/19842807/interior_front_seats-1774699255936.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'e8529270-ca53-5180-9787-f26a4e649748',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LV20 CXG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19842807',
'listing': 'auction',
'location': 'Greater London Sidcup',
'make': 'MINI',
'model': 'Cooper',
'odometer': 39000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8529270-ca53-5180-9787-f26a4e649748/e8529270-ca53-5180-9787-f26a4e649748_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2419425,
'Height': 2373,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2807/19842807/exterior_front_driver-1774784929380.jpg',
'Width': 3164},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8529270-ca53-5180-9787-f26a4e649748/e8529270-ca53-5180-9787-f26a4e649748_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2287453,
'Height': 2693,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2807/19842807/exterior_rear_driver-1774698412789.jpg',
'Width': 3591},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8529270-ca53-5180-9787-f26a4e649748/e8529270-ca53-5180-9787-f26a4e649748_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1839700,
'Height': 2317,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2807/19842807/exterior_front_passenger-1774698463178.jpg',
'Width': 3089},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8529270-ca53-5180-9787-f26a4e649748/e8529270-ca53-5180-9787-f26a4e649748_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2633994,
'Height': 2794,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2807/19842807/exterior_rear_passenger-1774698442835.jpg',
'Width': 3725},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8529270-ca53-5180-9787-f26a4e649748/e8529270-ca53-5180-9787-f26a4e649748_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4615775,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2807/19842807/interior_front_seats-1774699255936.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8529270-ca53-5180-9787-f26a4e649748/e8529270-ca53-5180-9787-f26a4e649748_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5601219,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2807/19842807/interior_rear_seats-1774699266954.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8529270-ca53-5180-9787-f26a4e649748/e8529270-ca53-5180-9787-f26a4e649748_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2193394,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2807/19842807/interior_dashboard-1774699338302.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8529270-ca53-5180-9787-f26a4e649748/e8529270-ca53-5180-9787-f26a4e649748_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4741253,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2807/19842807/interior_boot-1774699183610.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8529270-ca53-5180-9787-f26a4e649748/e8529270-ca53-5180-9787-f26a4e649748_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4985183,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2807/19842807/docs_service_history-1774784462463.jpg?ixlib=js-3.8.0&auto=format&s=a72c14763903330dee341aed00f674a4',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8529270-ca53-5180-9787-f26a4e649748/e8529270-ca53-5180-9787-f26a4e649748_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5990903,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2807/19842807/docs_service_history-1774784468240.jpg?ixlib=js-3.8.0&auto=format&s=7ad2d0ffa19889c7b8c79a6056c78e7d',
'Width': 4032}],
'price': 9519,
'price_includes_vat': False,
'registration_date': '2020-03-16',
'seats_number': None,
'seller_name': None,
'title': 'MINI Cooper Classic',
'transmission': 'manual',
'trim': 'Classic',
'vin': 'WMWXR320402M50478',
'year': 2020}
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719842807%27 HTTP/1.1" 200 None
2026-03-29 20:15:09 [motorway.uk] INFO: Saving data for 19842807: {'created_time': 1774815309.397478, 'last_price_update_time': 1774815309.397487, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19842807') HTTP/1.1" 204 0
2026-03-29 20:15:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6171/18276171/docs_service_history-1774552387392.jpg?ixlib=js-3.8.0&auto=format&s=16f9510c49702aa9423f4d8685320f7e> (referer: None)
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0179%252F20490179%252Finterior_front_seats-1774710119464.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0179/20490179/interior_front_seats-1774710119464.jpg not downloaded yet
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e1aed0>
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68c9dbc7-080a-5572-ab67-081994e9686f/68c9dbc7-080a-5572-ab67-081994e9686f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4330%252F20494330%252Fexterior_front_driver-1774779278400.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4330/20494330/exterior_front_driver-1774779278400.jpeg saved to cache
2026-03-29 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68c9dbc7-080a-5572-ab67-081994e9686f
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ac3ad0>
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35f8854b-6974-5339-842f-48649375a541/35f8854b-6974-5339-842f-48649375a541_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6171%252F18276171%252Fexterior_rear_passenger-1774510021580.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6171/18276171/exterior_rear_passenger-1774510021580.jpg saved to cache
2026-03-29 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 35f8854b-6974-5339-842f-48649375a541
2026-03-29 20:15:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=900&page=25&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4330/20494330/20494330-interior_front_seats-modified-1774784608572.jpeg> (referer: None)
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0179%252F20490179%252Finterior_dashboard-1774710158770.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0179/20490179/interior_dashboard-1774710158770.jpg not downloaded yet
2026-03-29 20:15:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14548428.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/12120509.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20383556.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0179%252F20490179%252Finstrument_cluster-1774710211312.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0179/20490179/instrument_cluster-1774710211312.jpg not downloaded yet
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659bca450>
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35f8854b-6974-5339-842f-48649375a541/35f8854b-6974-5339-842f-48649375a541_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6171%252F18276171%252Fdocs_service_history-1774552387392.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D16f9510c49702aa9423f4d8685320f7e') HTTP/1.1" 204 0
2026-03-29 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6171/18276171/docs_service_history-1774552387392.jpg?ixlib=js-3.8.0&auto=format&s=16f9510c49702aa9423f4d8685320f7e saved to cache
2026-03-29 20:15:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 35f8854b-6974-5339-842f-48649375a541
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0179%252F20490179%252Finterior_boot-1774710166171.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0179/20490179/interior_boot-1774710166171.jpg not downloaded yet
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0179%252F20490179%252Fdamage_scratches-1774772938897.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0179/20490179/damage_scratches-1774772938897.jpg not downloaded yet
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0179%252F20490179%252Fwheels_front_driver-1774709813534.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0179/20490179/wheels_front_driver-1774709813534.jpg not downloaded yet
2026-03-29 20:15:10 [motorway.uk] INFO: Found listing with ID: 19778480
2026-03-29 20:15:10 [motorway.uk] INFO: Found listing with ID: 20022290
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720022290%27 HTTP/1.1" 200 None
2026-03-29 20:15:10 [motorway.uk] INFO: Scrape type for 20022290: 1
2026-03-29 20:15:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658430210>
2026-03-29 20:15:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68c9dbc7-080a-5572-ab67-081994e9686f/68c9dbc7-080a-5572-ab67-081994e9686f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4330%252F20494330%252F20494330-interior_front_seats-modified-1774784608572.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4330/20494330/20494330-interior_front_seats-modified-1774784608572.jpeg saved to cache
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 68c9dbc7-080a-5572-ab67-081994e9686f
2026-03-29 20:15:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70a06957-6bc7-5c57-98bd-fb63a5d25c0b with identifier: 14548428
2026-03-29 20:15:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70a06957-6bc7-5c57-98bd-fb63a5d25c0b with scrape type 1
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 70a06957-6bc7-5c57-98bd-fb63a5d25c0b
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8428%252F14548428%252Fexterior_front_driver-1774780690589.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8428/14548428/exterior_front_driver-1774780690589.jpg not downloaded yet
2026-03-29 20:15:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b566b518-6526-51b6-8ffc-02e1d475958d with identifier: 12120509
2026-03-29 20:15:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b566b518-6526-51b6-8ffc-02e1d475958d with scrape type 1
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b566b518-6526-51b6-8ffc-02e1d475958d
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0509%252F12120509%252Fexterior_front_driver-1774701022889.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0509/12120509/exterior_front_driver-1774701022889.jpg not downloaded yet
2026-03-29 20:15:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25744ea6-7c38-5da4-bb94-01ececcb6b09 with identifier: 20383556
2026-03-29 20:15:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25744ea6-7c38-5da4-bb94-01ececcb6b09 with scrape type 1
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 25744ea6-7c38-5da4-bb94-01ececcb6b09
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3556%252F20383556%252Fexterior_front_driver-1774633948715.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3556/20383556/exterior_front_driver-1774633948715.jpg not downloaded yet
2026-03-29 20:15:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4330/20494330/20494330-interior_dashboard-modified-1774784646148.jpeg> (referer: None)
2026-03-29 20:15:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20498788.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5939/20345939/interior_dashboard-1774620486347.jpg> (referer: None)
2026-03-29 20:15:10 [motorway.uk] INFO: Found listing with ID: 13467302
2026-03-29 20:15:10 [motorway.uk] INFO: Found listing with ID: 19297070
2026-03-29 20:15:10 [motorway.uk] INFO: Found listing with ID: 20020700
2026-03-29 20:15:10 [motorway.uk] INFO: Found listing with ID: 11255946
2026-03-29 20:15:10 [motorway.uk] INFO: Found listing with ID: 19632065
2026-03-29 20:15:10 [motorway.uk] INFO: Found listing with ID: 17285204
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717285204%27 HTTP/1.1" 200 None
2026-03-29 20:15:10 [motorway.uk] INFO: Scrape type for 17285204: 1
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8428%252F14548428%252Fexterior_rear_driver-1774780713088.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8428/14548428/exterior_rear_driver-1774780713088.jpg not downloaded yet
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0509%252F12120509%252Fexterior_rear_driver-1774701027761.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0509/12120509/exterior_rear_driver-1774701027761.jpg not downloaded yet
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3556%252F20383556%252Fexterior_rear_driver-1774634598204.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3556/20383556/exterior_rear_driver-1774634598204.jpg not downloaded yet
2026-03-29 20:15:10 [motorway.uk] INFO: Found listing with ID: 16536787
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716536787%27 HTTP/1.1" 200 None
2026-03-29 20:15:10 [motorway.uk] INFO: Scrape type for 16536787: 1
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8428%252F14548428%252Fexterior_front_passenger-1774780734669.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8428/14548428/exterior_front_passenger-1774780734669.jpg not downloaded yet
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0509%252F12120509%252Fexterior_front_passenger-1774701025030.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0509/12120509/exterior_front_passenger-1774701025030.jpg not downloaded yet
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3556%252F20383556%252Fexterior_front_passenger-1774634602384.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3556/20383556/exterior_front_passenger-1774634602384.jpg not downloaded yet
2026-03-29 20:15:10 [motorway.uk] INFO: Found listing with ID: 1653589
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%271653589%27 HTTP/1.1" 200 None
2026-03-29 20:15:10 [motorway.uk] INFO: Scrape type for 1653589: 1
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8428%252F14548428%252Fexterior_rear_passenger-1774780723393.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8428/14548428/exterior_rear_passenger-1774780723393.jpg not downloaded yet
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0509%252F12120509%252Fexterior_rear_passenger-1774701021212.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0509/12120509/exterior_rear_passenger-1774701021212.jpg not downloaded yet
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3556%252F20383556%252Fexterior_rear_passenger-1774634600091.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3556/20383556/exterior_rear_passenger-1774634600091.jpg not downloaded yet
2026-03-29 20:15:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ac6fd0>
2026-03-29 20:15:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68c9dbc7-080a-5572-ab67-081994e9686f/68c9dbc7-080a-5572-ab67-081994e9686f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4330%252F20494330%252F20494330-interior_dashboard-modified-1774784646148.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4330/20494330/20494330-interior_dashboard-modified-1774784646148.jpeg saved to cache
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 68c9dbc7-080a-5572-ab67-081994e9686f
2026-03-29 20:15:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e28989b9-b12f-584e-b2a2-c00666707967 with identifier: 20498788
2026-03-29 20:15:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e28989b9-b12f-584e-b2a2-c00666707967 with scrape type 1
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e28989b9-b12f-584e-b2a2-c00666707967
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8788%252F20498788%252Fexterior_front_driver-1774767286616.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8788/20498788/exterior_front_driver-1774767286616.jpg not downloaded yet
2026-03-29 20:15:10 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:15:10 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:15:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:15:10 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:27 14:06:04\x00'
2026-03-29 20:15:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:15:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:15:10 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:15:10 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: b'SM-A156E\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:15:10 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 270 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:15:10 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 302 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:15:10 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:15:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'N\x01\x00\x00'
2026-03-29 20:15:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:15:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584c96d0>
2026-03-29 20:15:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64ffc591-7874-5442-a409-b295765bcff0/64ffc591-7874-5442-a409-b295765bcff0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5939%252F20345939%252Finterior_dashboard-1774620486347.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5939/20345939/interior_dashboard-1774620486347.jpg saved to cache
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 64ffc591-7874-5442-a409-b295765bcff0
2026-03-29 20:15:11 [motorway.uk] INFO: Found listing with ID: 20323347
2026-03-29 20:15:11 [motorway.uk] INFO: Found listing with ID: 20483472
2026-03-29 20:15:11 [motorway.uk] INFO: Found listing with ID: 17018395
2026-03-29 20:15:11 [motorway.uk] INFO: Found listing with ID: 4109910
2026-03-29 20:15:11 [motorway.uk] INFO: Found listing with ID: 19834070
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719834070%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [motorway.uk] INFO: Scrape type for 19834070: 1
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8428%252F14548428%252Finterior_front_seats-1774780962051.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8428/14548428/interior_front_seats-1774780962051.jpg not downloaded yet
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0509%252F12120509%252Finterior_front_seats-1774706988655.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0509/12120509/interior_front_seats-1774706988655.jpg not downloaded yet
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3556%252F20383556%252Finterior_front_seats-1774634638888.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3556/20383556/interior_front_seats-1774634638888.jpg not downloaded yet
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8788%252F20498788%252Fexterior_rear_driver-1774767942214.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8788/20498788/exterior_rear_driver-1774767942214.jpg not downloaded yet
2026-03-29 20:15:11 [motorway.uk] INFO: Found listing with ID: 20450033
2026-03-29 20:15:11 [motorway.uk] INFO: Found listing with ID: 20441111
2026-03-29 20:15:11 [motorway.uk] INFO: Found listing with ID: 15806242
2026-03-29 20:15:11 [motorway.uk] INFO: Found listing with ID: 20168276
2026-03-29 20:15:11 [motorway.uk] INFO: Found listing with ID: 13753529
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713753529%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [motorway.uk] INFO: Scrape type for 13753529: 1
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8428%252F14548428%252Finterior_rear_seats-1774780973932.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8428/14548428/interior_rear_seats-1774780973932.jpg not downloaded yet
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0509%252F12120509%252Finterior_rear_seats-1774701841622.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0509/12120509/interior_rear_seats-1774701841622.jpg not downloaded yet
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3556%252F20383556%252Finterior_rear_seats-1774634639627.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3556/20383556/interior_rear_seats-1774634639627.jpg not downloaded yet
2026-03-29 20:15:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8788%252F20498788%252Fexterior_front_passenger-1774767332912.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8788/20498788/exterior_front_passenger-1774767332912.jpg not downloaded yet
2026-03-29 20:15:11 [motorway.uk] INFO: Found listing with ID: 15549773
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715549773%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [motorway.uk] INFO: Scrape type for 15549773: 1
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8428%252F14548428%252Finterior_dashboard-1774781008389.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8428/14548428/interior_dashboard-1774781008389.jpg not downloaded yet
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0509%252F12120509%252Finterior_dashboard-1774701863057.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0509/12120509/interior_dashboard-1774701863057.jpg not downloaded yet
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3556%252F20383556%252F20383556-interior_dashboard-modified-1774635708566.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3556/20383556/20383556-interior_dashboard-modified-1774635708566.jpeg not downloaded yet
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8788%252F20498788%252Fexterior_rear_passenger-1774767319076.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8788/20498788/exterior_rear_passenger-1774767319076.jpg not downloaded yet
2026-03-29 20:15:11 [motorway.uk] INFO: Found listing with ID: 15733189
2026-03-29 20:15:11 [motorway.uk] INFO: Found listing with ID: 14461251
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714461251%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [motorway.uk] INFO: Scrape type for 14461251: 1
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8428%252F14548428%252Finstrument_cluster-1774781075133.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8428/14548428/instrument_cluster-1774781075133.jpg not downloaded yet
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0509%252F12120509%252Finterior_boot-1774706924641.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0509/12120509/interior_boot-1774706924641.jpg not downloaded yet
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3556%252F20383556%252Finstrument_cluster-1774634812112.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3556/20383556/instrument_cluster-1774634812112.jpg not downloaded yet
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8788%252F20498788%252Finterior_front_seats-1774767614411.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8788/20498788/interior_front_seats-1774767614411.jpg not downloaded yet
2026-03-29 20:15:11 [motorway.uk] INFO: Found listing with ID: 20474635
2026-03-29 20:15:11 [motorway.uk] INFO: Found listing with ID: 19400973
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719400973%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [motorway.uk] INFO: Scrape type for 19400973: 1
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8428%252F14548428%252Finterior_boot-1774782629790.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8428/14548428/interior_boot-1774782629790.jpg not downloaded yet
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0509%252F12120509%252Fdocs_service_history-1774701950000.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd7f71fdcea8a258e743194d7fe731683%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0509/12120509/docs_service_history-1774701950000.jpg?ixlib=js-3.8.0&auto=format&s=d7f71fdcea8a258e743194d7fe731683 not downloaded yet
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3556%252F20383556%252Finterior_boot-1774634641465.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3556/20383556/interior_boot-1774634641465.jpg not downloaded yet
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8788%252F20498788%252Finterior_rear_seats-1774767626317.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8788/20498788/interior_rear_seats-1774767626317.jpg not downloaded yet
2026-03-29 20:15:11 [motorway.uk] INFO: Found listing with ID: 20423010
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720423010%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [motorway.uk] INFO: Scrape type for 20423010: 1
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8428%252F14548428%252Fdocs_service_history-1774781091216.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc39cfef9bb2dbee4ac7aa1afda04e0c5%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8428/14548428/docs_service_history-1774781091216.jpg?ixlib=js-3.8.0&auto=format&s=c39cfef9bb2dbee4ac7aa1afda04e0c5 not downloaded yet
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0509%252F12120509%252Fdamage_scratches-1774701128378.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0509/12120509/damage_scratches-1774701128378.jpg not downloaded yet
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3556%252F20383556%252Fdocs_service_history-1774634722613.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5df8ae2c02412c61ecd697c0b0bb1e6d%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3556/20383556/docs_service_history-1774634722613.jpg?ixlib=js-3.8.0&auto=format&s=5df8ae2c02412c61ecd697c0b0bb1e6d not downloaded yet
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8788%252F20498788%252Finterior_dashboard-1774771603873.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8788/20498788/interior_dashboard-1774771603873.jpg not downloaded yet
2026-03-29 20:15:11 [motorway.uk] INFO: Found listing with ID: 20470703
2026-03-29 20:15:11 [motorway.uk] INFO: Found listing with ID: 10736639
2026-03-29 20:15:11 [motorway.uk] INFO: Found listing with ID: 20469304
2026-03-29 20:15:11 [motorway.uk] INFO: Found listing with ID: 19886474
2026-03-29 20:15:11 [motorway.uk] INFO: Found listing with ID: 18670827
2026-03-29 20:15:11 [motorway.uk] INFO: Found listing with ID: 19915940
2026-03-29 20:15:11 [motorway.uk] INFO: Found listing with ID: 14572470
2026-03-29 20:15:11 [motorway.uk] INFO: Found listing with ID: 20268898
2026-03-29 20:15:11 [motorway.uk] INFO: Found listing with ID: 20241032
2026-03-29 20:15:11 [motorway.uk] INFO: Found listing with ID: 20251701
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8788%252F20498788%252Finstrument_cluster-1774767721851.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8788/20498788/instrument_cluster-1774767721851.jpg not downloaded yet
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8788%252F20498788%252Finterior_boot-1774771614932.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8788/20498788/interior_boot-1774771614932.jpg not downloaded yet
2026-03-29 20:15:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6171/18276171/instrument_cluster-1774550107812.jpg> (referer: None)
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8788%252F20498788%252Fdocs_service_history-1774767798289.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df8181b8812a81e94e366c996a6096e00%27 HTTP/1.1" 200 None
2026-03-29 20:15:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8788/20498788/docs_service_history-1774767798289.jpg?ixlib=js-3.8.0&auto=format&s=f8181b8812a81e94e366c996a6096e00 not downloaded yet
2026-03-29 20:15:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0509/12120509/exterior_rear_passenger-1774701021212.jpg> (referer: None)
2026-03-29 20:15:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0509/12120509/interior_front_seats-1774706988655.jpg> (referer: None)
2026-03-29 20:15:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6171/18276171/interior_boot-1774550131571.jpg> (referer: None)
2026-03-29 20:15:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0509/12120509/exterior_front_passenger-1774701025030.jpg> (referer: None)
2026-03-29 20:15:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3556/20383556/exterior_rear_passenger-1774634600091.jpg> (referer: None)
2026-03-29 20:15:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3556/20383556/exterior_front_passenger-1774634602384.jpg> (referer: None)
2026-03-29 20:15:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8428/14548428/exterior_front_passenger-1774780734669.jpg> (referer: None)
2026-03-29 20:15:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8788/20498788/exterior_front_driver-1774767286616.jpg> (referer: None)
2026-03-29 20:15:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8428/14548428/exterior_rear_passenger-1774780723393.jpg> (referer: None)
2026-03-29 20:15:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8428/14548428/interior_front_seats-1774780962051.jpg> (referer: None)
2026-03-29 20:15:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a0fe50>
2026-03-29 20:15:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35f8854b-6974-5339-842f-48649375a541/35f8854b-6974-5339-842f-48649375a541_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6171%252F18276171%252Finstrument_cluster-1774550107812.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6171/18276171/instrument_cluster-1774550107812.jpg saved to cache
2026-03-29 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 35f8854b-6974-5339-842f-48649375a541
2026-03-29 20:15:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3556/20383556/interior_front_seats-1774634638888.jpg> (referer: None)
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599ce6d0>
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b566b518-6526-51b6-8ffc-02e1d475958d/b566b518-6526-51b6-8ffc-02e1d475958d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0509%252F12120509%252Fexterior_rear_passenger-1774701021212.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0509/12120509/exterior_rear_passenger-1774701021212.jpg saved to cache
2026-03-29 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b566b518-6526-51b6-8ffc-02e1d475958d
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658504450>
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b566b518-6526-51b6-8ffc-02e1d475958d/b566b518-6526-51b6-8ffc-02e1d475958d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0509%252F12120509%252Finterior_front_seats-1774706988655.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0509/12120509/interior_front_seats-1774706988655.jpg saved to cache
2026-03-29 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b566b518-6526-51b6-8ffc-02e1d475958d
2026-03-29 20:15:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6590140d0>
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35f8854b-6974-5339-842f-48649375a541/35f8854b-6974-5339-842f-48649375a541_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6171%252F18276171%252Finterior_boot-1774550131571.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6171/18276171/interior_boot-1774550131571.jpg saved to cache
2026-03-29 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 35f8854b-6974-5339-842f-48649375a541
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658507790>
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b566b518-6526-51b6-8ffc-02e1d475958d/b566b518-6526-51b6-8ffc-02e1d475958d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0509%252F12120509%252Fexterior_front_passenger-1774701025030.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0509/12120509/exterior_front_passenger-1774701025030.jpg saved to cache
2026-03-29 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b566b518-6526-51b6-8ffc-02e1d475958d
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6585797d0>
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25744ea6-7c38-5da4-bb94-01ececcb6b09/25744ea6-7c38-5da4-bb94-01ececcb6b09_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3556%252F20383556%252Fexterior_rear_passenger-1774634600091.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3556/20383556/exterior_rear_passenger-1774634600091.jpg saved to cache
2026-03-29 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 25744ea6-7c38-5da4-bb94-01ececcb6b09
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a100d0>
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25744ea6-7c38-5da4-bb94-01ececcb6b09/25744ea6-7c38-5da4-bb94-01ececcb6b09_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3556%252F20383556%252Fexterior_front_passenger-1774634602384.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3556/20383556/exterior_front_passenger-1774634602384.jpg saved to cache
2026-03-29 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 25744ea6-7c38-5da4-bb94-01ececcb6b09
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d45a10>
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70a06957-6bc7-5c57-98bd-fb63a5d25c0b/70a06957-6bc7-5c57-98bd-fb63a5d25c0b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8428%252F14548428%252Fexterior_front_passenger-1774780734669.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8428/14548428/exterior_front_passenger-1774780734669.jpg saved to cache
2026-03-29 20:15:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 70a06957-6bc7-5c57-98bd-fb63a5d25c0b
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659017510>
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e28989b9-b12f-584e-b2a2-c00666707967/e28989b9-b12f-584e-b2a2-c00666707967_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8788%252F20498788%252Fexterior_front_driver-1774767286616.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8788/20498788/exterior_front_driver-1774767286616.jpg saved to cache
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e28989b9-b12f-584e-b2a2-c00666707967
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bcb650>
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70a06957-6bc7-5c57-98bd-fb63a5d25c0b/70a06957-6bc7-5c57-98bd-fb63a5d25c0b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8428%252F14548428%252Fexterior_rear_passenger-1774780723393.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8428/14548428/exterior_rear_passenger-1774780723393.jpg saved to cache
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 70a06957-6bc7-5c57-98bd-fb63a5d25c0b
2026-03-29 20:15:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a10150>
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70a06957-6bc7-5c57-98bd-fb63a5d25c0b/70a06957-6bc7-5c57-98bd-fb63a5d25c0b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8428%252F14548428%252Finterior_front_seats-1774780962051.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8428/14548428/interior_front_seats-1774780962051.jpg saved to cache
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 70a06957-6bc7-5c57-98bd-fb63a5d25c0b
2026-03-29 20:15:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8788/20498788/docs_service_history-1774767798289.jpg?ixlib=js-3.8.0&auto=format&s=f8181b8812a81e94e366c996a6096e00> (referer: None)
2026-03-29 20:15:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583e6710>
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25744ea6-7c38-5da4-bb94-01ececcb6b09/25744ea6-7c38-5da4-bb94-01ececcb6b09_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3556%252F20383556%252Finterior_front_seats-1774634638888.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3556/20383556/interior_front_seats-1774634638888.jpg saved to cache
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 25744ea6-7c38-5da4-bb94-01ececcb6b09
2026-03-29 20:15:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583e4490>
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e28989b9-b12f-584e-b2a2-c00666707967/e28989b9-b12f-584e-b2a2-c00666707967_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8788%252F20498788%252Fdocs_service_history-1774767798289.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df8181b8812a81e94e366c996a6096e00') HTTP/1.1" 204 0
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8788/20498788/docs_service_history-1774767798289.jpg?ixlib=js-3.8.0&auto=format&s=f8181b8812a81e94e366c996a6096e00 saved to cache
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e28989b9-b12f-584e-b2a2-c00666707967
2026-03-29 20:15:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8788/20498788/instrument_cluster-1774767721851.jpg> (referer: None)
2026-03-29 20:15:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8788/20498788/interior_boot-1774771614932.jpg> (referer: None)
2026-03-29 20:15:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a07390>
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e28989b9-b12f-584e-b2a2-c00666707967/e28989b9-b12f-584e-b2a2-c00666707967_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8788%252F20498788%252Finstrument_cluster-1774767721851.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8788/20498788/instrument_cluster-1774767721851.jpg saved to cache
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e28989b9-b12f-584e-b2a2-c00666707967
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b2da10>
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e28989b9-b12f-584e-b2a2-c00666707967/e28989b9-b12f-584e-b2a2-c00666707967_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8788%252F20498788%252Finterior_boot-1774771614932.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8788/20498788/interior_boot-1774771614932.jpg saved to cache
2026-03-29 20:15:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e28989b9-b12f-584e-b2a2-c00666707967
2026-03-29 20:15:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0509/12120509/damage_scratches-1774701128378.jpg> (referer: None)
2026-03-29 20:15:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0509/12120509/docs_service_history-1774701950000.jpg?ixlib=js-3.8.0&auto=format&s=d7f71fdcea8a258e743194d7fe731683> (referer: None)
2026-03-29 20:15:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8788/20498788/interior_dashboard-1774771603873.jpg> (referer: None)
2026-03-29 20:15:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8788/20498788/interior_rear_seats-1774767626317.jpg> (referer: None)
2026-03-29 20:15:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8788/20498788/interior_front_seats-1774767614411.jpg> (referer: None)
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598dc410>
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b566b518-6526-51b6-8ffc-02e1d475958d/b566b518-6526-51b6-8ffc-02e1d475958d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0509%252F12120509%252Fdamage_scratches-1774701128378.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0509/12120509/damage_scratches-1774701128378.jpg saved to cache
2026-03-29 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b566b518-6526-51b6-8ffc-02e1d475958d
2026-03-29 20:15:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8428/14548428/interior_boot-1774782629790.jpg> (referer: None)
2026-03-29 20:15:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3556/20383556/interior_boot-1774634641465.jpg> (referer: None)
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658131910>
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b566b518-6526-51b6-8ffc-02e1d475958d/b566b518-6526-51b6-8ffc-02e1d475958d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0509%252F12120509%252Fdocs_service_history-1774701950000.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd7f71fdcea8a258e743194d7fe731683') HTTP/1.1" 204 0
2026-03-29 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0509/12120509/docs_service_history-1774701950000.jpg?ixlib=js-3.8.0&auto=format&s=d7f71fdcea8a258e743194d7fe731683 saved to cache
2026-03-29 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b566b518-6526-51b6-8ffc-02e1d475958d
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c58950>
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e28989b9-b12f-584e-b2a2-c00666707967/e28989b9-b12f-584e-b2a2-c00666707967_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8788%252F20498788%252Finterior_dashboard-1774771603873.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8788/20498788/interior_dashboard-1774771603873.jpg saved to cache
2026-03-29 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e28989b9-b12f-584e-b2a2-c00666707967
2026-03-29 20:15:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf9c690>
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e28989b9-b12f-584e-b2a2-c00666707967/e28989b9-b12f-584e-b2a2-c00666707967_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8788%252F20498788%252Finterior_rear_seats-1774767626317.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8788/20498788/interior_rear_seats-1774767626317.jpg saved to cache
2026-03-29 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e28989b9-b12f-584e-b2a2-c00666707967
2026-03-29 20:15:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e2b350>
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e28989b9-b12f-584e-b2a2-c00666707967/e28989b9-b12f-584e-b2a2-c00666707967_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8788%252F20498788%252Finterior_front_seats-1774767614411.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8788/20498788/interior_front_seats-1774767614411.jpg saved to cache
2026-03-29 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e28989b9-b12f-584e-b2a2-c00666707967
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfc61d0>
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70a06957-6bc7-5c57-98bd-fb63a5d25c0b/70a06957-6bc7-5c57-98bd-fb63a5d25c0b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8428%252F14548428%252Finterior_boot-1774782629790.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8428/14548428/interior_boot-1774782629790.jpg saved to cache
2026-03-29 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 70a06957-6bc7-5c57-98bd-fb63a5d25c0b
2026-03-29 20:15:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c24c90>
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25744ea6-7c38-5da4-bb94-01ececcb6b09/25744ea6-7c38-5da4-bb94-01ececcb6b09_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3556%252F20383556%252Finterior_boot-1774634641465.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3556/20383556/interior_boot-1774634641465.jpg saved to cache
2026-03-29 20:15:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 25744ea6-7c38-5da4-bb94-01ececcb6b09
2026-03-29 20:15:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0509/12120509/interior_boot-1774706924641.jpg> (referer: None)
2026-03-29 20:15:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3556/20383556/docs_service_history-1774634722613.jpg?ixlib=js-3.8.0&auto=format&s=5df8ae2c02412c61ecd697c0b0bb1e6d> (referer: None)
2026-03-29 20:15:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3556/20383556/instrument_cluster-1774634812112.jpg> (referer: None)
2026-03-29 20:15:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8428/14548428/docs_service_history-1774781091216.jpg?ixlib=js-3.8.0&auto=format&s=c39cfef9bb2dbee4ac7aa1afda04e0c5> (referer: None)
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582c6f90>
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b566b518-6526-51b6-8ffc-02e1d475958d/b566b518-6526-51b6-8ffc-02e1d475958d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0509%252F12120509%252Finterior_boot-1774706924641.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0509/12120509/interior_boot-1774706924641.jpg saved to cache
2026-03-29 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b566b518-6526-51b6-8ffc-02e1d475958d
2026-03-29 20:15:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:15:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:15 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b45810>
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25744ea6-7c38-5da4-bb94-01ececcb6b09/25744ea6-7c38-5da4-bb94-01ececcb6b09_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3556%252F20383556%252Fdocs_service_history-1774634722613.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5df8ae2c02412c61ecd697c0b0bb1e6d') HTTP/1.1" 204 0
2026-03-29 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3556/20383556/docs_service_history-1774634722613.jpg?ixlib=js-3.8.0&auto=format&s=5df8ae2c02412c61ecd697c0b0bb1e6d saved to cache
2026-03-29 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 25744ea6-7c38-5da4-bb94-01ececcb6b09
2026-03-29 20:15:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582cc190>
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25744ea6-7c38-5da4-bb94-01ececcb6b09/25744ea6-7c38-5da4-bb94-01ececcb6b09_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3556%252F20383556%252Finstrument_cluster-1774634812112.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3556/20383556/instrument_cluster-1774634812112.jpg saved to cache
2026-03-29 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 25744ea6-7c38-5da4-bb94-01ececcb6b09
2026-03-29 20:15:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:15:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a04350>
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70a06957-6bc7-5c57-98bd-fb63a5d25c0b/70a06957-6bc7-5c57-98bd-fb63a5d25c0b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8428%252F14548428%252Fdocs_service_history-1774781091216.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc39cfef9bb2dbee4ac7aa1afda04e0c5') HTTP/1.1" 204 0
2026-03-29 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8428/14548428/docs_service_history-1774781091216.jpg?ixlib=js-3.8.0&auto=format&s=c39cfef9bb2dbee4ac7aa1afda04e0c5 saved to cache
2026-03-29 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 70a06957-6bc7-5c57-98bd-fb63a5d25c0b
2026-03-29 20:15:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19834070.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8788/20498788/exterior_rear_passenger-1774767319076.jpg> (referer: None)
2026-03-29 20:15:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8428/14548428/interior_dashboard-1774781008389.jpg> (referer: None)
2026-03-29 20:15:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0509/12120509/interior_dashboard-1774701863057.jpg> (referer: None)
2026-03-29 20:15:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3556/20383556/20383556-interior_dashboard-modified-1774635708566.jpeg> (referer: None)
2026-03-29 20:15:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8428/14548428/instrument_cluster-1774781075133.jpg> (referer: None)
2026-03-29 20:15:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4a699a3-de89-58aa-8020-63f23d635dcc with identifier: 19834070
2026-03-29 20:15:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4a699a3-de89-58aa-8020-63f23d635dcc with scrape type 1
2026-03-29 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c4a699a3-de89-58aa-8020-63f23d635dcc
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4070%252F19834070%252Fexterior_front_driver-1774536433020.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4070/19834070/exterior_front_driver-1774536433020.jpg not downloaded yet
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4070%252F19834070%252Fexterior_rear_driver-1774536470929.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4070/19834070/exterior_rear_driver-1774536470929.jpg not downloaded yet
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4070%252F19834070%252Fexterior_front_passenger-1774536519798.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4070/19834070/exterior_front_passenger-1774536519798.jpg not downloaded yet
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c4ab50>
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e28989b9-b12f-584e-b2a2-c00666707967/e28989b9-b12f-584e-b2a2-c00666707967_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8788%252F20498788%252Fexterior_rear_passenger-1774767319076.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8788/20498788/exterior_rear_passenger-1774767319076.jpg saved to cache
2026-03-29 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e28989b9-b12f-584e-b2a2-c00666707967
2026-03-29 20:15:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658492790>
2026-03-29 20:15:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70a06957-6bc7-5c57-98bd-fb63a5d25c0b/70a06957-6bc7-5c57-98bd-fb63a5d25c0b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8428%252F14548428%252Finterior_dashboard-1774781008389.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8428/14548428/interior_dashboard-1774781008389.jpg saved to cache
2026-03-29 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 70a06957-6bc7-5c57-98bd-fb63a5d25c0b
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4070%252F19834070%252Fexterior_rear_passenger-1774536494569.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4070/19834070/exterior_rear_passenger-1774536494569.jpg not downloaded yet
2026-03-29 20:15:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/1653589.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659bfef50>
2026-03-29 20:15:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b566b518-6526-51b6-8ffc-02e1d475958d/b566b518-6526-51b6-8ffc-02e1d475958d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0509%252F12120509%252Finterior_dashboard-1774701863057.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0509/12120509/interior_dashboard-1774701863057.jpg saved to cache
2026-03-29 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b566b518-6526-51b6-8ffc-02e1d475958d
2026-03-29 20:15:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599d7410>
2026-03-29 20:15:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25744ea6-7c38-5da4-bb94-01ececcb6b09/25744ea6-7c38-5da4-bb94-01ececcb6b09_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3556%252F20383556%252F20383556-interior_dashboard-modified-1774635708566.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3556/20383556/20383556-interior_dashboard-modified-1774635708566.jpeg saved to cache
2026-03-29 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 25744ea6-7c38-5da4-bb94-01ececcb6b09
2026-03-29 20:15:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a9e150>
2026-03-29 20:15:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70a06957-6bc7-5c57-98bd-fb63a5d25c0b/70a06957-6bc7-5c57-98bd-fb63a5d25c0b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8428%252F14548428%252Finstrument_cluster-1774781075133.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8428/14548428/instrument_cluster-1774781075133.jpg saved to cache
2026-03-29 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 70a06957-6bc7-5c57-98bd-fb63a5d25c0b
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4070%252F19834070%252Finterior_front_seats-1774537387065.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4070/19834070/interior_front_seats-1774537387065.jpg not downloaded yet
2026-03-29 20:15:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4070%252F19834070%252Finterior_rear_seats-1774537199588.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4070/19834070/interior_rear_seats-1774537199588.jpg not downloaded yet
2026-03-29 20:15:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=936&page=26&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f535feb1-02eb-5562-a753-95d072447d8d with identifier: 1653589
2026-03-29 20:15:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f535feb1-02eb-5562-a753-95d072447d8d with scrape type 1
2026-03-29 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f535feb1-02eb-5562-a753-95d072447d8d
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3589%252F1653589%252Fexterior_front_driver-1774709664523.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3589/1653589/exterior_front_driver-1774709664523.jpg not downloaded yet
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4070%252F19834070%252Finterior_dashboard-1774537314134.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4070/19834070/interior_dashboard-1774537314134.jpg not downloaded yet
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3589%252F1653589%252Fexterior_rear_driver-1774709678227.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3589/1653589/exterior_rear_driver-1774709678227.jpg not downloaded yet
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4070%252F19834070%252Finterior_boot-1774537246965.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4070/19834070/interior_boot-1774537246965.jpg not downloaded yet
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3589%252F1653589%252Fexterior_front_passenger-1774711814764.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3589/1653589/exterior_front_passenger-1774711814764.jpg not downloaded yet
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4070%252F19834070%252Fdamage_scratches-1774536554474.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4070/19834070/damage_scratches-1774536554474.jpg not downloaded yet
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3589%252F1653589%252Fexterior_rear_passenger-1774709688594.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3589/1653589/exterior_rear_passenger-1774709688594.jpg not downloaded yet
2026-03-29 20:15:16 [motorway.uk] INFO: Found listing with ID: 8035510
2026-03-29 20:15:16 [motorway.uk] INFO: Found listing with ID: 20487217
2026-03-29 20:15:16 [motorway.uk] INFO: Found listing with ID: 9709671
2026-03-29 20:15:16 [motorway.uk] INFO: Found listing with ID: 18815814
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718815814%27 HTTP/1.1" 200 None
2026-03-29 20:15:16 [motorway.uk] INFO: Scrape type for 18815814: 1
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4070%252F19834070%252Fdamage_scratches-1774536581219.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4070/19834070/damage_scratches-1774536581219.jpg not downloaded yet
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3589%252F1653589%252Finterior_front_seats-1774710015140.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3589/1653589/interior_front_seats-1774710015140.jpg not downloaded yet
2026-03-29 20:15:16 [motorway.uk] INFO: Found listing with ID: 20223018
2026-03-29 20:15:16 [motorway.uk] INFO: Found listing with ID: 20483589
2026-03-29 20:15:16 [motorway.uk] INFO: Found listing with ID: 12179919
2026-03-29 20:15:16 [motorway.uk] INFO: Found listing with ID: 20468816
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720468816%27 HTTP/1.1" 200 None
2026-03-29 20:15:16 [motorway.uk] INFO: Scrape type for 20468816: 1
2026-03-29 20:15:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19400973.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3589%252F1653589%252Finterior_rear_seats-1774710072180.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3589/1653589/interior_rear_seats-1774710072180.jpg not downloaded yet
2026-03-29 20:15:16 [motorway.uk] INFO: Found listing with ID: 20377393
2026-03-29 20:15:16 [motorway.uk] INFO: Found listing with ID: 17155088
2026-03-29 20:15:16 [motorway.uk] INFO: Found listing with ID: 20267868
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720267868%27 HTTP/1.1" 200 None
2026-03-29 20:15:16 [motorway.uk] INFO: Scrape type for 20267868: 1
2026-03-29 20:15:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3589%252F1653589%252Finterior_dashboard-1774711844404.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3589/1653589/interior_dashboard-1774711844404.jpg not downloaded yet
2026-03-29 20:15:16 [motorway.uk] INFO: Found listing with ID: 3064694
2026-03-29 20:15:16 [motorway.uk] INFO: Found listing with ID: 19938092
2026-03-29 20:15:16 [motorway.uk] INFO: Found listing with ID: 20502804
2026-03-29 20:15:16 [motorway.uk] INFO: Found listing with ID: 19713153
2026-03-29 20:15:16 [motorway.uk] INFO: Found listing with ID: 19838319
2026-03-29 20:15:16 [motorway.uk] INFO: Found listing with ID: 20050031
2026-03-29 20:15:16 [motorway.uk] INFO: Found listing with ID: 16344729
2026-03-29 20:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716344729%27 HTTP/1.1" 200 None
2026-03-29 20:15:17 [motorway.uk] INFO: Scrape type for 16344729: 1
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3589%252F1653589%252Finstrument_cluster-1774710127305.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3589/1653589/instrument_cluster-1774710127305.jpg not downloaded yet
2026-03-29 20:15:17 [motorway.uk] INFO: Found listing with ID: 20490281
2026-03-29 20:15:17 [motorway.uk] INFO: Found listing with ID: 16868488
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716868488%27 HTTP/1.1" 200 None
2026-03-29 20:15:17 [motorway.uk] INFO: Scrape type for 16868488: 1
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3589%252F1653589%252Finterior_boot-1774710118895.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3589/1653589/interior_boot-1774710118895.jpg not downloaded yet
2026-03-29 20:15:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0509/12120509/interior_rear_seats-1774701841622.jpg> (referer: None)
2026-03-29 20:15:17 [motorway.uk] INFO: Found listing with ID: 19871523
2026-03-29 20:15:17 [motorway.uk] INFO: Found listing with ID: 20412314
2026-03-29 20:15:17 [motorway.uk] INFO: Found listing with ID: 20415492
2026-03-29 20:15:17 [motorway.uk] INFO: Found listing with ID: 17316820
2026-03-29 20:15:17 [motorway.uk] INFO: Found listing with ID: 20175981
2026-03-29 20:15:17 [motorway.uk] INFO: Found listing with ID: 20453641
2026-03-29 20:15:17 [motorway.uk] INFO: Found listing with ID: 20478408
2026-03-29 20:15:17 [motorway.uk] INFO: Found listing with ID: 20469298
2026-03-29 20:15:17 [motorway.uk] INFO: Found listing with ID: 20319525
2026-03-29 20:15:17 [motorway.uk] INFO: Found listing with ID: 16548854
2026-03-29 20:15:17 [motorway.uk] INFO: Found listing with ID: 20052855
2026-03-29 20:15:17 [motorway.uk] INFO: Found listing with ID: 20374311
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720374311%27 HTTP/1.1" 200 None
2026-03-29 20:15:17 [motorway.uk] INFO: Scrape type for 20374311: 1
2026-03-29 20:15:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd1de0bf-5880-5cda-97c4-1646c7058c53 with identifier: 19400973
2026-03-29 20:15:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd1de0bf-5880-5cda-97c4-1646c7058c53 with scrape type 1
2026-03-29 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fd1de0bf-5880-5cda-97c4-1646c7058c53
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0973%252F19400973%252Fexterior_front_driver-1774773410083.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0973/19400973/exterior_front_driver-1774773410083.jpg not downloaded yet
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3589%252F1653589%252Fdocs_service_history-1774711269588-1.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc0da7631b6596bd94cc5ac56c1ca63f6%27 HTTP/1.1" 200 None
2026-03-29 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3589/1653589/docs_service_history-1774711269588-1.jpeg?ixlib=js-3.8.0&auto=format&s=c0da7631b6596bd94cc5ac56c1ca63f6 not downloaded yet
2026-03-29 20:15:17 [motorway.uk] INFO: Found listing with ID: 17186648
2026-03-29 20:15:17 [motorway.uk] INFO: Found listing with ID: 17160787
2026-03-29 20:15:17 [motorway.uk] INFO: Found listing with ID: 20384196
2026-03-29 20:15:17 [motorway.uk] INFO: Found listing with ID: 20037779
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0973%252F19400973%252Fexterior_rear_driver-1774773437999.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0973/19400973/exterior_rear_driver-1774773437999.jpg not downloaded yet
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0973%252F19400973%252Fexterior_front_passenger-1774434802681.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0973/19400973/exterior_front_passenger-1774434802681.jpg not downloaded yet
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0973%252F19400973%252Fexterior_rear_passenger-1774773349658.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0973/19400973/exterior_rear_passenger-1774773349658.jpg not downloaded yet
2026-03-29 20:15:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ae5a10>
2026-03-29 20:15:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b566b518-6526-51b6-8ffc-02e1d475958d/b566b518-6526-51b6-8ffc-02e1d475958d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0509%252F12120509%252Finterior_rear_seats-1774701841622.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0509/12120509/interior_rear_seats-1774701841622.jpg saved to cache
2026-03-29 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b566b518-6526-51b6-8ffc-02e1d475958d
2026-03-29 20:15:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8788/20498788/exterior_front_passenger-1774767332912.jpg> (referer: None)
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0973%252F19400973%252Finterior_front_seats-1774773333076.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0973/19400973/interior_front_seats-1774773333076.jpg not downloaded yet
2026-03-29 20:15:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4070/19834070/exterior_front_driver-1774536433020.jpg> (referer: None)
2026-03-29 20:15:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20423010.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0973%252F19400973%252Finterior_rear_seats-1774770217358.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0973/19400973/interior_rear_seats-1774770217358.jpg not downloaded yet
2026-03-29 20:15:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4070/19834070/exterior_rear_driver-1774536470929.jpg> (referer: None)
2026-03-29 20:15:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4070/19834070/exterior_rear_passenger-1774536494569.jpg> (referer: None)
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0973%252F19400973%252Finterior_dashboard-1774773285793.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0973/19400973/interior_dashboard-1774773285793.jpg not downloaded yet
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0973%252F19400973%252Finterior_boot-1774770608918.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0973/19400973/interior_boot-1774770608918.jpg not downloaded yet
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0973%252F19400973%252Fwheels_front_driver-1774434835211.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0973/19400973/wheels_front_driver-1774434835211.jpg not downloaded yet
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0973%252F19400973%252Fwheels_rear_driver-1774434843844.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0973/19400973/wheels_rear_driver-1774434843844.jpg not downloaded yet
2026-03-29 20:15:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658795390>
2026-03-29 20:15:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e28989b9-b12f-584e-b2a2-c00666707967/e28989b9-b12f-584e-b2a2-c00666707967_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8788%252F20498788%252Fexterior_front_passenger-1774767332912.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8788/20498788/exterior_front_passenger-1774767332912.jpg saved to cache
2026-03-29 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e28989b9-b12f-584e-b2a2-c00666707967
2026-03-29 20:15:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3556/20383556/interior_rear_seats-1774634639627.jpg> (referer: None)
2026-03-29 20:15:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8428/14548428/interior_rear_seats-1774780973932.jpg> (referer: None)
2026-03-29 20:15:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4070/19834070/exterior_front_passenger-1774536519798.jpg> (referer: None)
2026-03-29 20:15:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f9f590>
2026-03-29 20:15:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4a699a3-de89-58aa-8020-63f23d635dcc/c4a699a3-de89-58aa-8020-63f23d635dcc_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4070%252F19834070%252Fexterior_front_driver-1774536433020.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4070/19834070/exterior_front_driver-1774536433020.jpg saved to cache
2026-03-29 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c4a699a3-de89-58aa-8020-63f23d635dcc
2026-03-29 20:15:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07afad79-1ed3-56c3-967b-ea430e663f99 with identifier: 20423010
2026-03-29 20:15:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07afad79-1ed3-56c3-967b-ea430e663f99 with scrape type 1
2026-03-29 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 07afad79-1ed3-56c3-967b-ea430e663f99
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3010%252F20423010%252Fexterior_front_driver-1774706995204.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3010/20423010/exterior_front_driver-1774706995204.jpg not downloaded yet
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3010%252F20423010%252Fexterior_rear_driver-1774707114912.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3010/20423010/exterior_rear_driver-1774707114912.jpg not downloaded yet
2026-03-29 20:15:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659eabd90>
2026-03-29 20:15:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4a699a3-de89-58aa-8020-63f23d635dcc/c4a699a3-de89-58aa-8020-63f23d635dcc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4070%252F19834070%252Fexterior_rear_driver-1774536470929.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4070/19834070/exterior_rear_driver-1774536470929.jpg saved to cache
2026-03-29 20:15:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c4a699a3-de89-58aa-8020-63f23d635dcc
2026-03-29 20:15:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b09b50>
2026-03-29 20:15:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4a699a3-de89-58aa-8020-63f23d635dcc/c4a699a3-de89-58aa-8020-63f23d635dcc_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4070%252F19834070%252Fexterior_rear_passenger-1774536494569.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4070/19834070/exterior_rear_passenger-1774536494569.jpg saved to cache
2026-03-29 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c4a699a3-de89-58aa-8020-63f23d635dcc
2026-03-29 20:15:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65813d150>
2026-03-29 20:15:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25744ea6-7c38-5da4-bb94-01ececcb6b09/25744ea6-7c38-5da4-bb94-01ececcb6b09_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3556%252F20383556%252Finterior_rear_seats-1774634639627.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3556/20383556/interior_rear_seats-1774634639627.jpg saved to cache
2026-03-29 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 25744ea6-7c38-5da4-bb94-01ececcb6b09
2026-03-29 20:15:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ac3790>
2026-03-29 20:15:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70a06957-6bc7-5c57-98bd-fb63a5d25c0b/70a06957-6bc7-5c57-98bd-fb63a5d25c0b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8428%252F14548428%252Finterior_rear_seats-1774780973932.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8428/14548428/interior_rear_seats-1774780973932.jpg saved to cache
2026-03-29 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 70a06957-6bc7-5c57-98bd-fb63a5d25c0b
2026-03-29 20:15:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ac2d50>
2026-03-29 20:15:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4a699a3-de89-58aa-8020-63f23d635dcc/c4a699a3-de89-58aa-8020-63f23d635dcc_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4070%252F19834070%252Fexterior_front_passenger-1774536519798.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4070/19834070/exterior_front_passenger-1774536519798.jpg saved to cache
2026-03-29 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c4a699a3-de89-58aa-8020-63f23d635dcc
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3010%252F20423010%252Fexterior_front_passenger-1774707065426.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3010/20423010/exterior_front_passenger-1774707065426.jpg not downloaded yet
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3010%252F20423010%252Fexterior_rear_passenger-1774707174123.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3010/20423010/exterior_rear_passenger-1774707174123.jpg not downloaded yet
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3010%252F20423010%252Finterior_front_seats-1774708280723.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3010/20423010/interior_front_seats-1774708280723.jpg not downloaded yet
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3010%252F20423010%252Finterior_rear_seats-1774708362929.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3010/20423010/interior_rear_seats-1774708362929.jpg not downloaded yet
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3010%252F20423010%252Finterior_dashboard-1774708189313.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3010/20423010/interior_dashboard-1774708189313.jpg not downloaded yet
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3010%252F20423010%252Finstrument_cluster-1774708123935.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3010/20423010/instrument_cluster-1774708123935.jpg not downloaded yet
2026-03-29 20:15:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4070/19834070/interior_front_seats-1774537387065.jpg> (referer: None)
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3010%252F20423010%252Finterior_boot-1774708161388.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3010/20423010/interior_boot-1774708161388.jpg not downloaded yet
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3010%252F20423010%252Fdocs_service_history-1774715237503.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D930f0c92df4cec2de76a11469000ce82%27 HTTP/1.1" 200 None
2026-03-29 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3010/20423010/docs_service_history-1774715237503.jpg?ixlib=js-3.8.0&auto=format&s=930f0c92df4cec2de76a11469000ce82 not downloaded yet
2026-03-29 20:15:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0973/19400973/exterior_front_passenger-1774434802681.jpg> (referer: None)
2026-03-29 20:15:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0973/19400973/exterior_rear_passenger-1774773349658.jpg> (referer: None)
2026-03-29 20:15:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0973/19400973/interior_front_seats-1774773333076.jpg> (referer: None)
2026-03-29 20:15:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0973/19400973/wheels_front_driver-1774434835211.jpg> (referer: None)
2026-03-29 20:15:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fed0d0>
2026-03-29 20:15:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4a699a3-de89-58aa-8020-63f23d635dcc/c4a699a3-de89-58aa-8020-63f23d635dcc_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4070%252F19834070%252Finterior_front_seats-1774537387065.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4070/19834070/interior_front_seats-1774537387065.jpg saved to cache
2026-03-29 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c4a699a3-de89-58aa-8020-63f23d635dcc
2026-03-29 20:15:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e35050>
2026-03-29 20:15:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd1de0bf-5880-5cda-97c4-1646c7058c53/fd1de0bf-5880-5cda-97c4-1646c7058c53_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0973%252F19400973%252Fexterior_front_passenger-1774434802681.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0973/19400973/exterior_front_passenger-1774434802681.jpg saved to cache
2026-03-29 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fd1de0bf-5880-5cda-97c4-1646c7058c53
2026-03-29 20:15:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a30d10>
2026-03-29 20:15:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd1de0bf-5880-5cda-97c4-1646c7058c53/fd1de0bf-5880-5cda-97c4-1646c7058c53_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0973%252F19400973%252Fexterior_rear_passenger-1774773349658.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0973/19400973/exterior_rear_passenger-1774773349658.jpg saved to cache
2026-03-29 20:15:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fd1de0bf-5880-5cda-97c4-1646c7058c53
2026-03-29 20:15:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c97390>
2026-03-29 20:15:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd1de0bf-5880-5cda-97c4-1646c7058c53/fd1de0bf-5880-5cda-97c4-1646c7058c53_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0973%252F19400973%252Finterior_front_seats-1774773333076.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0973/19400973/interior_front_seats-1774773333076.jpg saved to cache
2026-03-29 20:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fd1de0bf-5880-5cda-97c4-1646c7058c53
2026-03-29 20:15:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658adb250>
2026-03-29 20:15:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd1de0bf-5880-5cda-97c4-1646c7058c53/fd1de0bf-5880-5cda-97c4-1646c7058c53_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0973%252F19400973%252Fwheels_front_driver-1774434835211.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0973/19400973/wheels_front_driver-1774434835211.jpg saved to cache
2026-03-29 20:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fd1de0bf-5880-5cda-97c4-1646c7058c53
2026-03-29 20:15:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0973/19400973/wheels_rear_driver-1774434843844.jpg> (referer: None)
2026-03-29 20:15:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3010/20423010/exterior_front_driver-1774706995204.jpg> (referer: None)
2026-03-29 20:15:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3010/20423010/docs_service_history-1774715237503.jpg?ixlib=js-3.8.0&auto=format&s=930f0c92df4cec2de76a11469000ce82> (referer: None)
2026-03-29 20:15:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3010/20423010/exterior_front_passenger-1774707065426.jpg> (referer: None)
2026-03-29 20:15:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3010/20423010/exterior_rear_driver-1774707114912.jpg> (referer: None)
2026-03-29 20:15:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3010/20423010/interior_dashboard-1774708189313.jpg> (referer: None)
2026-03-29 20:15:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f7c590>
2026-03-29 20:15:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd1de0bf-5880-5cda-97c4-1646c7058c53/fd1de0bf-5880-5cda-97c4-1646c7058c53_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0973%252F19400973%252Fwheels_rear_driver-1774434843844.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0973/19400973/wheels_rear_driver-1774434843844.jpg saved to cache
2026-03-29 20:15:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fd1de0bf-5880-5cda-97c4-1646c7058c53
2026-03-29 20:15:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19288331.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a8e250>
2026-03-29 20:15:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07afad79-1ed3-56c3-967b-ea430e663f99/07afad79-1ed3-56c3-967b-ea430e663f99_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3010%252F20423010%252Fexterior_front_driver-1774706995204.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3010/20423010/exterior_front_driver-1774706995204.jpg saved to cache
2026-03-29 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 07afad79-1ed3-56c3-967b-ea430e663f99
2026-03-29 20:15:20 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\x048'
2026-03-29 20:15:20 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\th'
2026-03-29 20:15:20 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 46 - Data Location: 74 - value: <table: 38 bytes>
2026-03-29 20:15:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00p'
2026-03-29 20:15:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: long (4) - value: b'\x00\x00\x00\x00'
2026-03-29 20:15:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ec7210>
2026-03-29 20:15:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07afad79-1ed3-56c3-967b-ea430e663f99/07afad79-1ed3-56c3-967b-ea430e663f99_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3010%252F20423010%252Fdocs_service_history-1774715237503.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D930f0c92df4cec2de76a11469000ce82') HTTP/1.1" 204 0
2026-03-29 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3010/20423010/docs_service_history-1774715237503.jpg?ixlib=js-3.8.0&auto=format&s=930f0c92df4cec2de76a11469000ce82 saved to cache
2026-03-29 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 07afad79-1ed3-56c3-967b-ea430e663f99
2026-03-29 20:15:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658814210>
2026-03-29 20:15:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07afad79-1ed3-56c3-967b-ea430e663f99/07afad79-1ed3-56c3-967b-ea430e663f99_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3010%252F20423010%252Fexterior_front_passenger-1774707065426.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3010/20423010/exterior_front_passenger-1774707065426.jpg saved to cache
2026-03-29 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 07afad79-1ed3-56c3-967b-ea430e663f99
2026-03-29 20:15:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659992690>
2026-03-29 20:15:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07afad79-1ed3-56c3-967b-ea430e663f99/07afad79-1ed3-56c3-967b-ea430e663f99_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3010%252F20423010%252Fexterior_rear_driver-1774707114912.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3010/20423010/exterior_rear_driver-1774707114912.jpg saved to cache
2026-03-29 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 07afad79-1ed3-56c3-967b-ea430e663f99
2026-03-29 20:15:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658309b50>
2026-03-29 20:15:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07afad79-1ed3-56c3-967b-ea430e663f99/07afad79-1ed3-56c3-967b-ea430e663f99_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3010%252F20423010%252Finterior_dashboard-1774708189313.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3010/20423010/interior_dashboard-1774708189313.jpg saved to cache
2026-03-29 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 07afad79-1ed3-56c3-967b-ea430e663f99
2026-03-29 20:15:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13753529.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16868488.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15549773.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69703630-8ae1-5a70-b157-fbd013ce258a with identifier: 19288331
2026-03-29 20:15:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69703630-8ae1-5a70-b157-fbd013ce258a with scrape type 1
2026-03-29 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 69703630-8ae1-5a70-b157-fbd013ce258a
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8331%252F19288331%252Fexterior_front_driver-1774699384007.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8331/19288331/exterior_front_driver-1774699384007.jpg not downloaded yet
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8331%252F19288331%252Fexterior_rear_driver-1774699767718.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8331/19288331/exterior_rear_driver-1774699767718.jpg not downloaded yet
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8331%252F19288331%252Fexterior_front_passenger-1774699774384.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8331/19288331/exterior_front_passenger-1774699774384.jpg not downloaded yet
2026-03-29 20:15:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28040276-8ab4-51fc-b135-c3c9ad692553 with identifier: 13753529
2026-03-29 20:15:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28040276-8ab4-51fc-b135-c3c9ad692553 with scrape type 1
2026-03-29 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 28040276-8ab4-51fc-b135-c3c9ad692553
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3529%252F13753529%252Fexterior_front_driver-1774630102804.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3529/13753529/exterior_front_driver-1774630102804.jpg not downloaded yet
2026-03-29 20:15:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87090821-ad15-57c6-a877-d4bdb258a2f0 with identifier: 16868488
2026-03-29 20:15:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87090821-ad15-57c6-a877-d4bdb258a2f0 with scrape type 1
2026-03-29 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 87090821-ad15-57c6-a877-d4bdb258a2f0
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8488%252F16868488%252Fexterior_front_driver-1774714971852.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8488/16868488/exterior_front_driver-1774714971852.jpg not downloaded yet
2026-03-29 20:15:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1ec0514-12f4-5e33-9320-8c123503b733 with identifier: 15549773
2026-03-29 20:15:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1ec0514-12f4-5e33-9320-8c123503b733 with scrape type 1
2026-03-29 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e1ec0514-12f4-5e33-9320-8c123503b733
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9773%252F15549773%252F15549773-exterior_front_driver-default-1774614774734.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9773/15549773/15549773-exterior_front_driver-default-1774614774734.jpg not downloaded yet
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8331%252F19288331%252Fexterior_rear_passenger-1774699782106.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8331/19288331/exterior_rear_passenger-1774699782106.jpg not downloaded yet
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3529%252F13753529%252Fexterior_rear_driver-1774630121293.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3529/13753529/exterior_rear_driver-1774630121293.jpg not downloaded yet
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8488%252F16868488%252Fexterior_rear_driver-1774714992001.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8488/16868488/exterior_rear_driver-1774714992001.jpg not downloaded yet
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9773%252F15549773%252F15549773-exterior_rear_driver-default-1774614776387.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9773/15549773/15549773-exterior_rear_driver-default-1774614776387.jpg not downloaded yet
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8331%252F19288331%252Finterior_front_seats-1774700467573.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8331/19288331/interior_front_seats-1774700467573.jpg not downloaded yet
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3529%252F13753529%252Fexterior_front_passenger-1774631955701.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3529/13753529/exterior_front_passenger-1774631955701.jpg not downloaded yet
2026-03-29 20:15:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8488%252F16868488%252Fexterior_front_passenger-1774715017017.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8488/16868488/exterior_front_passenger-1774715017017.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9773%252F15549773%252F15549773-exterior_front_passenger-default-1774614785309.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9773/15549773/15549773-exterior_front_passenger-default-1774614785309.jpg not downloaded yet
2026-03-29 20:15:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3010/20423010/instrument_cluster-1774708123935.jpg> (referer: None)
2026-03-29 20:15:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3589/1653589/docs_service_history-1774711269588-1.jpeg?ixlib=js-3.8.0&auto=format&s=c0da7631b6596bd94cc5ac56c1ca63f6> (referer: None)
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8331%252F19288331%252Finterior_rear_seats-1774700463299.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8331/19288331/interior_rear_seats-1774700463299.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3529%252F13753529%252Fexterior_rear_passenger-1774631199694.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3529/13753529/exterior_rear_passenger-1774631199694.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8488%252F16868488%252Fexterior_rear_passenger-1774715004003.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8488/16868488/exterior_rear_passenger-1774715004003.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9773%252F15549773%252F15549773-exterior_rear_passenger-default-1774614787786.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9773/15549773/15549773-exterior_rear_passenger-default-1774614787786.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8331%252F19288331%252Finterior_dashboard-1774701180053.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8331/19288331/interior_dashboard-1774701180053.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3529%252F13753529%252Finterior_front_seats-1774630532492.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3529/13753529/interior_front_seats-1774630532492.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8488%252F16868488%252Finterior_front_seats-1774715469056.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8488/16868488/interior_front_seats-1774715469056.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9773%252F15549773%252F15549773-interior_front_seats-default-1774614835617.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9773/15549773/15549773-interior_front_seats-default-1774614835617.jpg not downloaded yet
2026-03-29 20:15:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3010/20423010/exterior_rear_passenger-1774707174123.jpg> (referer: None)
2026-03-29 20:15:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3010/20423010/interior_rear_seats-1774708362929.jpg> (referer: None)
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8331%252F19288331%252Finterior_boot-1774701032024.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8331/19288331/interior_boot-1774701032024.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3529%252F13753529%252Finterior_rear_seats-1774630547944.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3529/13753529/interior_rear_seats-1774630547944.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8488%252F16868488%252Finterior_rear_seats-1774715498852.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8488/16868488/interior_rear_seats-1774715498852.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9773%252F15549773%252F15549773-interior_rear_seats-default-1774614833746.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9773/15549773/15549773-interior_rear_seats-default-1774614833746.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8331%252F19288331%252Fdamage_paintwork-1774699869745.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8331/19288331/damage_paintwork-1774699869745.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3529%252F13753529%252Finterior_dashboard-1774630787102.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3529/13753529/interior_dashboard-1774630787102.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8488%252F16868488%252Finterior_dashboard-1774715529086.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8488/16868488/interior_dashboard-1774715529086.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9773%252F15549773%252F15549773-interior_dashboard-default-1774614852861.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9773/15549773/15549773-interior_dashboard-default-1774614852861.jpg not downloaded yet
2026-03-29 20:15:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65999c4d0>
2026-03-29 20:15:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07afad79-1ed3-56c3-967b-ea430e663f99/07afad79-1ed3-56c3-967b-ea430e663f99_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3010%252F20423010%252Finstrument_cluster-1774708123935.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3010/20423010/instrument_cluster-1774708123935.jpg saved to cache
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 07afad79-1ed3-56c3-967b-ea430e663f99
2026-03-29 20:15:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bef3310>
2026-03-29 20:15:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f535feb1-02eb-5562-a753-95d072447d8d/f535feb1-02eb-5562-a753-95d072447d8d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3589%252F1653589%252Fdocs_service_history-1774711269588-1.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc0da7631b6596bd94cc5ac56c1ca63f6') HTTP/1.1" 204 0
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3589/1653589/docs_service_history-1774711269588-1.jpeg?ixlib=js-3.8.0&auto=format&s=c0da7631b6596bd94cc5ac56c1ca63f6 saved to cache
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f535feb1-02eb-5562-a753-95d072447d8d
2026-03-29 20:15:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3010/20423010/interior_front_seats-1774708280723.jpg> (referer: None)
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8331%252F19288331%252Fdamage_paintwork-1774699916665.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8331/19288331/damage_paintwork-1774699916665.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3529%252F13753529%252Finstrument_cluster-1774630650883.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3529/13753529/instrument_cluster-1774630650883.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8488%252F16868488%252Finstrument_cluster-1774715563592.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8488/16868488/instrument_cluster-1774715563592.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9773%252F15549773%252F15549773-instrument_cluster-default-1774622853294.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9773/15549773/15549773-instrument_cluster-default-1774622853294.jpg not downloaded yet
2026-03-29 20:15:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e96990>
2026-03-29 20:15:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07afad79-1ed3-56c3-967b-ea430e663f99/07afad79-1ed3-56c3-967b-ea430e663f99_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3010%252F20423010%252Fexterior_rear_passenger-1774707174123.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3010/20423010/exterior_rear_passenger-1774707174123.jpg saved to cache
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 07afad79-1ed3-56c3-967b-ea430e663f99
2026-03-29 20:15:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bed5dd0>
2026-03-29 20:15:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07afad79-1ed3-56c3-967b-ea430e663f99/07afad79-1ed3-56c3-967b-ea430e663f99_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3010%252F20423010%252Finterior_rear_seats-1774708362929.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3010/20423010/interior_rear_seats-1774708362929.jpg saved to cache
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 07afad79-1ed3-56c3-967b-ea430e663f99
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3529%252F13753529%252Finterior_boot-1774630618892.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3529/13753529/interior_boot-1774630618892.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8488%252F16868488%252Finterior_boot-1774715556879.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8488/16868488/interior_boot-1774715556879.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9773%252F15549773%252F15549773-interior_boot-default-1774614829535.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9773/15549773/15549773-interior_boot-default-1774614829535.jpg not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3529%252F13753529%252Fdocs_service_history-1774631921701.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D346c2bdb4bb3c91c6a60d59b93590fbe%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3529/13753529/docs_service_history-1774631921701.jpg?ixlib=js-3.8.0&auto=format&s=346c2bdb4bb3c91c6a60d59b93590fbe not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8488%252F16868488%252Fdocs_service_history-1774715608286.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D787e2f6606ca6f1ed02b93331490d9cd%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8488/16868488/docs_service_history-1774715608286.jpg?ixlib=js-3.8.0&auto=format&s=787e2f6606ca6f1ed02b93331490d9cd not downloaded yet
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9773%252F15549773%252F15549773-docs_service_history-modified-1746269209204.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7be296cb78f8c8c8d685c0082f3a1314%27 HTTP/1.1" 200 None
2026-03-29 20:15:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9773/15549773/15549773-docs_service_history-modified-1746269209204.jpeg?ixlib=js-3.8.0&auto=format&s=7be296cb78f8c8c8d685c0082f3a1314 not downloaded yet
2026-03-29 20:15:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a23e90>
2026-03-29 20:15:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07afad79-1ed3-56c3-967b-ea430e663f99/07afad79-1ed3-56c3-967b-ea430e663f99_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3010%252F20423010%252Finterior_front_seats-1774708280723.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3010/20423010/interior_front_seats-1774708280723.jpg saved to cache
2026-03-29 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 07afad79-1ed3-56c3-967b-ea430e663f99
2026-03-29 20:15:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9773/15549773/15549773-exterior_rear_driver-default-1774614776387.jpg> (referer: None)
2026-03-29 20:15:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3010/20423010/interior_boot-1774708161388.jpg> (referer: None)
2026-03-29 20:15:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9773/15549773/15549773-exterior_rear_passenger-default-1774614787786.jpg> (referer: None)
2026-03-29 20:15:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0973/19400973/interior_dashboard-1774773285793.jpg> (referer: None)
2026-03-29 20:15:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0973/19400973/exterior_rear_driver-1774773437999.jpg> (referer: None)
2026-03-29 20:15:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0973/19400973/interior_boot-1774770608918.jpg> (referer: None)
2026-03-29 20:15:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0973/19400973/exterior_front_driver-1774773410083.jpg> (referer: None)
2026-03-29 20:15:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8488/16868488/exterior_rear_driver-1774714992001.jpg> (referer: None)
2026-03-29 20:15:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0973/19400973/interior_rear_seats-1774770217358.jpg> (referer: None)
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a01f90>
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ec0514-12f4-5e33-9320-8c123503b733/e1ec0514-12f4-5e33-9320-8c123503b733_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9773%252F15549773%252F15549773-exterior_rear_driver-default-1774614776387.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9773/15549773/15549773-exterior_rear_driver-default-1774614776387.jpg saved to cache
2026-03-29 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e1ec0514-12f4-5e33-9320-8c123503b733
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a01b50>
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07afad79-1ed3-56c3-967b-ea430e663f99/07afad79-1ed3-56c3-967b-ea430e663f99_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3010%252F20423010%252Finterior_boot-1774708161388.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3010/20423010/interior_boot-1774708161388.jpg saved to cache
2026-03-29 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 07afad79-1ed3-56c3-967b-ea430e663f99
2026-03-29 20:15:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 07afad79-1ed3-56c3-967b-ea430e663f99, skipping ID generation
2026-03-29 20:15:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07afad79-1ed3-56c3-967b-ea430e663f99 with scrape type 1
2026-03-29 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 07afad79-1ed3-56c3-967b-ea430e663f99 sending to next pipeline
2026-03-29 20:15:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 07afad79-1ed3-56c3-967b-ea430e663f99, identifier: 20423010
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a019d0>
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ec0514-12f4-5e33-9320-8c123503b733/e1ec0514-12f4-5e33-9320-8c123503b733_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9773%252F15549773%252F15549773-exterior_rear_passenger-default-1774614787786.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9773/15549773/15549773-exterior_rear_passenger-default-1774614787786.jpg saved to cache
2026-03-29 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e1ec0514-12f4-5e33-9320-8c123503b733
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf37010>
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd1de0bf-5880-5cda-97c4-1646c7058c53/fd1de0bf-5880-5cda-97c4-1646c7058c53_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0973%252F19400973%252Finterior_dashboard-1774773285793.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0973/19400973/interior_dashboard-1774773285793.jpg saved to cache
2026-03-29 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fd1de0bf-5880-5cda-97c4-1646c7058c53
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b396d0>
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd1de0bf-5880-5cda-97c4-1646c7058c53/fd1de0bf-5880-5cda-97c4-1646c7058c53_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0973%252F19400973%252Fexterior_rear_driver-1774773437999.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0973/19400973/exterior_rear_driver-1774773437999.jpg saved to cache
2026-03-29 20:15:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fd1de0bf-5880-5cda-97c4-1646c7058c53
2026-03-29 20:15:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658524c90>
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd1de0bf-5880-5cda-97c4-1646c7058c53/fd1de0bf-5880-5cda-97c4-1646c7058c53_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0973%252F19400973%252Finterior_boot-1774770608918.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0973/19400973/interior_boot-1774770608918.jpg saved to cache
2026-03-29 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fd1de0bf-5880-5cda-97c4-1646c7058c53
2026-03-29 20:15:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a7a010>
2026-03-29 20:15:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd1de0bf-5880-5cda-97c4-1646c7058c53/fd1de0bf-5880-5cda-97c4-1646c7058c53_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0973%252F19400973%252Fexterior_front_driver-1774773410083.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0973/19400973/exterior_front_driver-1774773410083.jpg saved to cache
2026-03-29 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd1de0bf-5880-5cda-97c4-1646c7058c53
2026-03-29 20:15:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf354d0>
2026-03-29 20:15:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87090821-ad15-57c6-a877-d4bdb258a2f0/87090821-ad15-57c6-a877-d4bdb258a2f0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8488%252F16868488%252Fexterior_rear_driver-1774714992001.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8488/16868488/exterior_rear_driver-1774714992001.jpg saved to cache
2026-03-29 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 87090821-ad15-57c6-a877-d4bdb258a2f0
2026-03-29 20:15:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658dd5090>
2026-03-29 20:15:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd1de0bf-5880-5cda-97c4-1646c7058c53/fd1de0bf-5880-5cda-97c4-1646c7058c53_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0973%252F19400973%252Finterior_rear_seats-1774770217358.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0973/19400973/interior_rear_seats-1774770217358.jpg saved to cache
2026-03-29 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fd1de0bf-5880-5cda-97c4-1646c7058c53
2026-03-29 20:15:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd1de0bf-5880-5cda-97c4-1646c7058c53, skipping ID generation
2026-03-29 20:15:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd1de0bf-5880-5cda-97c4-1646c7058c53 with scrape type 1
2026-03-29 20:15:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd1de0bf-5880-5cda-97c4-1646c7058c53 sending to next pipeline
2026-03-29 20:15:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: fd1de0bf-5880-5cda-97c4-1646c7058c53, identifier: 19400973
2026-03-29 20:15:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 07afad79-1ed3-56c3-967b-ea430e663f99 with identifier: 20423010
2026-03-29 20:15:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 07afad79-1ed3-56c3-967b-ea430e663f99 with identifier: 20423010
2026-03-29 20:15:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 07afad79-1ed3-56c3-967b-ea430e663f99 with identifier: 20423010 to the API
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/3010/20423010/interior_boot-1774708161388.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '07afad79-1ed3-56c3-967b-ea430e663f99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YH69 UKN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20423010',
'listing': 'auction',
'location': 'Antrim Crumlin',
'make': 'Jaguar',
'model': 'XE Series',
'odometer': 53313,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07afad79-1ed3-56c3-967b-ea430e663f99/07afad79-1ed3-56c3-967b-ea430e663f99_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1486344,
'Height': 2579,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3010/20423010/exterior_front_driver-1774706995204.jpg',
'Width': 3439},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07afad79-1ed3-56c3-967b-ea430e663f99/07afad79-1ed3-56c3-967b-ea430e663f99_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1555771,
'Height': 2772,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3010/20423010/exterior_rear_driver-1774707114912.jpg',
'Width': 3696},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07afad79-1ed3-56c3-967b-ea430e663f99/07afad79-1ed3-56c3-967b-ea430e663f99_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1323234,
'Height': 2547,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3010/20423010/exterior_front_passenger-1774707065426.jpg',
'Width': 3396},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07afad79-1ed3-56c3-967b-ea430e663f99/07afad79-1ed3-56c3-967b-ea430e663f99_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1321071,
'Height': 2447,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3010/20423010/exterior_rear_passenger-1774707174123.jpg',
'Width': 3263},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07afad79-1ed3-56c3-967b-ea430e663f99/07afad79-1ed3-56c3-967b-ea430e663f99_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1664122,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/3010/20423010/interior_front_seats-1774708280723.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07afad79-1ed3-56c3-967b-ea430e663f99/07afad79-1ed3-56c3-967b-ea430e663f99_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1375986,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/3010/20423010/interior_rear_seats-1774708362929.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07afad79-1ed3-56c3-967b-ea430e663f99/07afad79-1ed3-56c3-967b-ea430e663f99_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1262324,
'Height': 2891,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3010/20423010/interior_dashboard-1774708189313.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07afad79-1ed3-56c3-967b-ea430e663f99/07afad79-1ed3-56c3-967b-ea430e663f99_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1073787,
'Height': 2891,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3010/20423010/instrument_cluster-1774708123935.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07afad79-1ed3-56c3-967b-ea430e663f99/07afad79-1ed3-56c3-967b-ea430e663f99_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2160417,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/3010/20423010/interior_boot-1774708161388.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07afad79-1ed3-56c3-967b-ea430e663f99/07afad79-1ed3-56c3-967b-ea430e663f99_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386527,
'Height': 2408,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3010/20423010/docs_service_history-1774715237503.jpg?ixlib=js-3.8.0&auto=format&s=930f0c92df4cec2de76a11469000ce82',
'Width': 1080}],
'price': 10885,
'price_includes_vat': False,
'registration_date': '2019-09-27',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar XE R-DYNAMIC S D Auto',
'transmission': 'automatic',
'trim': 'XE R-DYNAMIC S D Auto',
'vin': 'SAJAB4AN9LCP59587',
'year': 2019}
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720423010%27 HTTP/1.1" 200 None
2026-03-29 20:15:24 [motorway.uk] INFO: Saving data for 20423010: {'created_time': 1774815324.041665, 'last_price_update_time': 1774815324.041677, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20423010') HTTP/1.1" 204 0
2026-03-29 20:15:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: fd1de0bf-5880-5cda-97c4-1646c7058c53 with identifier: 19400973
2026-03-29 20:15:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: fd1de0bf-5880-5cda-97c4-1646c7058c53 with identifier: 19400973
2026-03-29 20:15:24 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: fd1de0bf-5880-5cda-97c4-1646c7058c53 with identifier: 19400973 to the API
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/0973/19400973/interior_rear_seats-1774770217358.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'fd1de0bf-5880-5cda-97c4-1646c7058c53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'TA14 NKA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19400973',
'listing': 'auction',
'location': 'Swansea Swansea',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 75718,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd1de0bf-5880-5cda-97c4-1646c7058c53/fd1de0bf-5880-5cda-97c4-1646c7058c53_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2880435,
'Height': 2746,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0973/19400973/exterior_front_driver-1774773410083.jpg',
'Width': 3661},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd1de0bf-5880-5cda-97c4-1646c7058c53/fd1de0bf-5880-5cda-97c4-1646c7058c53_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1877395,
'Height': 2403,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0973/19400973/exterior_rear_driver-1774773437999.jpg',
'Width': 3204},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd1de0bf-5880-5cda-97c4-1646c7058c53/fd1de0bf-5880-5cda-97c4-1646c7058c53_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1433461,
'Height': 2318,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0973/19400973/exterior_front_passenger-1774434802681.jpg',
'Width': 3090},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd1de0bf-5880-5cda-97c4-1646c7058c53/fd1de0bf-5880-5cda-97c4-1646c7058c53_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2258600,
'Height': 2680,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0973/19400973/exterior_rear_passenger-1774773349658.jpg',
'Width': 3573},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd1de0bf-5880-5cda-97c4-1646c7058c53/fd1de0bf-5880-5cda-97c4-1646c7058c53_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2335232,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0973/19400973/interior_front_seats-1774773333076.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd1de0bf-5880-5cda-97c4-1646c7058c53/fd1de0bf-5880-5cda-97c4-1646c7058c53_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3082064,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0973/19400973/interior_rear_seats-1774770217358.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd1de0bf-5880-5cda-97c4-1646c7058c53/fd1de0bf-5880-5cda-97c4-1646c7058c53_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2350873,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0973/19400973/interior_dashboard-1774773285793.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd1de0bf-5880-5cda-97c4-1646c7058c53/fd1de0bf-5880-5cda-97c4-1646c7058c53_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3669902,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0973/19400973/interior_boot-1774770608918.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd1de0bf-5880-5cda-97c4-1646c7058c53/fd1de0bf-5880-5cda-97c4-1646c7058c53_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375483,
'Height': 1287,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0973/19400973/wheels_front_driver-1774434835211.jpg',
'Width': 1716},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd1de0bf-5880-5cda-97c4-1646c7058c53/fd1de0bf-5880-5cda-97c4-1646c7058c53_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 427483,
'Height': 1280,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0973/19400973/wheels_rear_driver-1774434843844.jpg',
'Width': 1707}],
'price': 6367,
'price_includes_vat': False,
'registration_date': '2018-12-19',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Polo Beats TSI',
'transmission': 'manual',
'trim': 'Beats TSI',
'vin': 'WVWZZZAWZKU018415',
'year': 2018}
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719400973%27 HTTP/1.1" 200 None
2026-03-29 20:15:24 [motorway.uk] INFO: Saving data for 19400973: {'created_time': 1774815324.587549, 'last_price_update_time': 1774815324.587561, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19400973') HTTP/1.1" 204 0
2026-03-29 20:15:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=972&page=27&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8488/16868488/docs_service_history-1774715608286.jpg?ixlib=js-3.8.0&auto=format&s=787e2f6606ca6f1ed02b93331490d9cd> (referer: None)
2026-03-29 20:15:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/9773/15549773/15549773-docs_service_history-modified-1746269209204.jpeg?ixlib=js-3.8.0&auto=format&s=7be296cb78f8c8c8d685c0082f3a1314> (referer: None)
2026-03-29 20:15:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9773/15549773/15549773-interior_boot-default-1774614829535.jpg> (referer: None)
2026-03-29 20:15:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3529/13753529/interior_boot-1774630618892.jpg> (referer: None)
2026-03-29 20:15:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8488/16868488/interior_boot-1774715556879.jpg> (referer: None)
2026-03-29 20:15:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/3529/13753529/docs_service_history-1774631921701.jpg?ixlib=js-3.8.0&auto=format&s=346c2bdb4bb3c91c6a60d59b93590fbe> (referer: None)
2026-03-29 20:15:24 [motorway.uk] INFO: Found listing with ID: 20411853
2026-03-29 20:15:24 [motorway.uk] INFO: Found listing with ID: 18697582
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718697582%27 HTTP/1.1" 200 None
2026-03-29 20:15:24 [motorway.uk] INFO: Scrape type for 18697582: 1
2026-03-29 20:15:24 [motorway.uk] INFO: Found listing with ID: 3263792
2026-03-29 20:15:24 [motorway.uk] INFO: Found listing with ID: 20388810
2026-03-29 20:15:24 [motorway.uk] INFO: Found listing with ID: 20267620
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720267620%27 HTTP/1.1" 200 None
2026-03-29 20:15:24 [motorway.uk] INFO: Scrape type for 20267620: 2
2026-03-29 20:15:24 [motorway.uk] INFO: Found listing with ID: 20355104
2026-03-29 20:15:24 [motorway.uk] INFO: Found listing with ID: 16997942
2026-03-29 20:15:24 [motorway.uk] INFO: Found listing with ID: 20235987
2026-03-29 20:15:24 [motorway.uk] INFO: Found listing with ID: 20327167
2026-03-29 20:15:24 [motorway.uk] INFO: Found listing with ID: 18355209
2026-03-29 20:15:24 [motorway.uk] INFO: Found listing with ID: 20500674
2026-03-29 20:15:24 [motorway.uk] INFO: Found listing with ID: 20417268
2026-03-29 20:15:24 [motorway.uk] INFO: Found listing with ID: 20488448
2026-03-29 20:15:24 [motorway.uk] INFO: Found listing with ID: 4592998
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%274592998%27 HTTP/1.1" 200 None
2026-03-29 20:15:24 [motorway.uk] INFO: Scrape type for 4592998: 1
2026-03-29 20:15:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf35210>
2026-03-29 20:15:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87090821-ad15-57c6-a877-d4bdb258a2f0/87090821-ad15-57c6-a877-d4bdb258a2f0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8488%252F16868488%252Fdocs_service_history-1774715608286.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D787e2f6606ca6f1ed02b93331490d9cd') HTTP/1.1" 204 0
2026-03-29 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8488/16868488/docs_service_history-1774715608286.jpg?ixlib=js-3.8.0&auto=format&s=787e2f6606ca6f1ed02b93331490d9cd saved to cache
2026-03-29 20:15:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 87090821-ad15-57c6-a877-d4bdb258a2f0
2026-03-29 20:15:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:24 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:15:24 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-S928B\x00'
2026-03-29 20:15:24 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:15:24 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'S928BXXS4AYB6\x00'
2026-03-29 20:15:24 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:15:24 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:15:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:24 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2025:05:02 16:02:52\x00'
2026-03-29 20:15:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f86ad0>
2026-03-29 20:15:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ec0514-12f4-5e33-9320-8c123503b733/e1ec0514-12f4-5e33-9320-8c123503b733_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9773%252F15549773%252F15549773-docs_service_history-modified-1746269209204.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7be296cb78f8c8c8d685c0082f3a1314') HTTP/1.1" 204 0
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9773/15549773/15549773-docs_service_history-modified-1746269209204.jpeg?ixlib=js-3.8.0&auto=format&s=7be296cb78f8c8c8d685c0082f3a1314 saved to cache
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e1ec0514-12f4-5e33-9320-8c123503b733
2026-03-29 20:15:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583e5110>
2026-03-29 20:15:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ec0514-12f4-5e33-9320-8c123503b733/e1ec0514-12f4-5e33-9320-8c123503b733_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9773%252F15549773%252F15549773-interior_boot-default-1774614829535.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9773/15549773/15549773-interior_boot-default-1774614829535.jpg saved to cache
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e1ec0514-12f4-5e33-9320-8c123503b733
2026-03-29 20:15:25 [motorway.uk] INFO: Found listing with ID: 20289196
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720289196%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [motorway.uk] INFO: Scrape type for 20289196: 1
2026-03-29 20:15:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20468816.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20374311.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14461251.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658718f90>
2026-03-29 20:15:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28040276-8ab4-51fc-b135-c3c9ad692553/28040276-8ab4-51fc-b135-c3c9ad692553_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3529%252F13753529%252Finterior_boot-1774630618892.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3529/13753529/interior_boot-1774630618892.jpg saved to cache
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 28040276-8ab4-51fc-b135-c3c9ad692553
2026-03-29 20:15:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a1a990>
2026-03-29 20:15:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87090821-ad15-57c6-a877-d4bdb258a2f0/87090821-ad15-57c6-a877-d4bdb258a2f0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8488%252F16868488%252Finterior_boot-1774715556879.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8488/16868488/interior_boot-1774715556879.jpg saved to cache
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 87090821-ad15-57c6-a877-d4bdb258a2f0
2026-03-29 20:15:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598c8390>
2026-03-29 20:15:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28040276-8ab4-51fc-b135-c3c9ad692553/28040276-8ab4-51fc-b135-c3c9ad692553_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3529%252F13753529%252Fdocs_service_history-1774631921701.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D346c2bdb4bb3c91c6a60d59b93590fbe') HTTP/1.1" 204 0
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3529/13753529/docs_service_history-1774631921701.jpg?ixlib=js-3.8.0&auto=format&s=346c2bdb4bb3c91c6a60d59b93590fbe saved to cache
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 28040276-8ab4-51fc-b135-c3c9ad692553
2026-03-29 20:15:25 [motorway.uk] INFO: Found listing with ID: 17884848
2026-03-29 20:15:25 [motorway.uk] INFO: Found listing with ID: 20406554
2026-03-29 20:15:25 [motorway.uk] INFO: Found listing with ID: 20396431
2026-03-29 20:15:25 [motorway.uk] INFO: Found listing with ID: 20479789
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720479789%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [motorway.uk] INFO: Scrape type for 20479789: 1
2026-03-29 20:15:25 [motorway.uk] INFO: Found listing with ID: 20496248
2026-03-29 20:15:25 [motorway.uk] INFO: Found listing with ID: 16533872
2026-03-29 20:15:25 [motorway.uk] INFO: Found listing with ID: 20491744
2026-03-29 20:15:25 [motorway.uk] INFO: Found listing with ID: 19390207
2026-03-29 20:15:25 [motorway.uk] INFO: Found listing with ID: 20065341
2026-03-29 20:15:25 [motorway.uk] INFO: Found listing with ID: 20491588
2026-03-29 20:15:25 [motorway.uk] INFO: Found listing with ID: 19412192
2026-03-29 20:15:25 [motorway.uk] INFO: Found listing with ID: 8144237
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278144237%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [motorway.uk] INFO: Scrape type for 8144237: 2
2026-03-29 20:15:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3ab6001-7e65-50e4-afb0-6e937d41facf with identifier: 20468816
2026-03-29 20:15:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3ab6001-7e65-50e4-afb0-6e937d41facf with scrape type 1
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a3ab6001-7e65-50e4-afb0-6e937d41facf
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8816%252F20468816%252Fexterior_front_driver-1774696513054.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8816/20468816/exterior_front_driver-1774696513054.jpg not downloaded yet
2026-03-29 20:15:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1111c056-716a-52c0-9a16-54165e019ccb with identifier: 20374311
2026-03-29 20:15:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1111c056-716a-52c0-9a16-54165e019ccb with scrape type 1
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1111c056-716a-52c0-9a16-54165e019ccb
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4311%252F20374311%252Fexterior_front_driver-1774695505963.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4311/20374311/exterior_front_driver-1774695505963.jpg not downloaded yet
2026-03-29 20:15:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03671cb9-2521-560d-ad98-688930550de3 with identifier: 14461251
2026-03-29 20:15:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03671cb9-2521-560d-ad98-688930550de3 with scrape type 1
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 03671cb9-2521-560d-ad98-688930550de3
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1251%252F14461251%252Fexterior_front_driver-1774602117508.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1251/14461251/exterior_front_driver-1774602117508.jpg not downloaded yet
2026-03-29 20:15:25 [motorway.uk] INFO: Found listing with ID: 20178701
2026-03-29 20:15:25 [motorway.uk] INFO: Found listing with ID: 9608672
2026-03-29 20:15:25 [motorway.uk] INFO: Found listing with ID: 20487398
2026-03-29 20:15:25 [motorway.uk] INFO: Found listing with ID: 20473693
2026-03-29 20:15:25 [motorway.uk] INFO: Found listing with ID: 19953302
2026-03-29 20:15:25 [motorway.uk] INFO: Found listing with ID: 20149199
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720149199%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [motorway.uk] INFO: Scrape type for 20149199: 1
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8816%252F20468816%252Fexterior_rear_driver-1774693967698.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8816/20468816/exterior_rear_driver-1774693967698.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4311%252F20374311%252Fexterior_rear_driver-1774695930793.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4311/20374311/exterior_rear_driver-1774695930793.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1251%252F14461251%252Fexterior_rear_driver-1774602277299.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1251/14461251/exterior_rear_driver-1774602277299.jpg not downloaded yet
2026-03-29 20:15:25 [motorway.uk] INFO: Found listing with ID: 20426141
2026-03-29 20:15:25 [motorway.uk] INFO: Found listing with ID: 10536049
2026-03-29 20:15:25 [motorway.uk] INFO: Found listing with ID: 20307524
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8816%252F20468816%252Fexterior_front_passenger-1774694217051.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8816/20468816/exterior_front_passenger-1774694217051.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4311%252F20374311%252Fexterior_front_passenger-1774695541026.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4311/20374311/exterior_front_passenger-1774695541026.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1251%252F14461251%252Fexterior_front_passenger-1774602196970.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1251/14461251/exterior_front_passenger-1774602196970.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8816%252F20468816%252Fexterior_rear_passenger-1774693886152.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8816/20468816/exterior_rear_passenger-1774693886152.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4311%252F20374311%252Fexterior_rear_passenger-1774695868664.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4311/20374311/exterior_rear_passenger-1774695868664.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1251%252F14461251%252Fexterior_rear_passenger-1774602156058.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1251/14461251/exterior_rear_passenger-1774602156058.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8816%252F20468816%252Finterior_front_seats-1774694886907.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8816/20468816/interior_front_seats-1774694886907.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4311%252F20374311%252Finterior_front_seats-1774694004253.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4311/20374311/interior_front_seats-1774694004253.jpg not downloaded yet
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1251%252F14461251%252Finterior_front_seats-1774603581184.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1251/14461251/interior_front_seats-1774603581184.jpg not downloaded yet
2026-03-29 20:15:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9773/15549773/15549773-interior_rear_seats-default-1774614833746.jpg> (referer: None)
2026-03-29 20:15:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9773/15549773/15549773-instrument_cluster-default-1774622853294.jpg> (referer: None)
2026-03-29 20:15:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9773/15549773/15549773-interior_dashboard-default-1774614852861.jpg> (referer: None)
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8816%252F20468816%252Finterior_rear_seats-1774694783671.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8816/20468816/interior_rear_seats-1774694783671.jpg not downloaded yet
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4311%252F20374311%252Finterior_rear_seats-1774693846989.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4311/20374311/interior_rear_seats-1774693846989.jpg not downloaded yet
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1251%252F14461251%252Finterior_rear_seats-1774603539530.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1251/14461251/interior_rear_seats-1774603539530.jpg not downloaded yet
2026-03-29 20:15:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8331/19288331/damage_paintwork-1774699869745.jpg> (referer: None)
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8816%252F20468816%252Finterior_dashboard-1774696597453.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8816/20468816/interior_dashboard-1774696597453.jpg not downloaded yet
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4311%252F20374311%252Finterior_dashboard-1774695562236.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4311/20374311/interior_dashboard-1774695562236.jpg not downloaded yet
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1251%252F14461251%252Finterior_dashboard-1774610952979.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1251/14461251/interior_dashboard-1774610952979.jpg not downloaded yet
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8816%252F20468816%252Finterior_boot-1774694829859.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8816/20468816/interior_boot-1774694829859.jpg not downloaded yet
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4311%252F20374311%252Finstrument_cluster-1774693823026.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4311/20374311/instrument_cluster-1774693823026.jpg not downloaded yet
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1251%252F14461251%252Finterior_boot-1774692955699.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1251/14461251/interior_boot-1774692955699.jpg not downloaded yet
2026-03-29 20:15:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8331/19288331/damage_paintwork-1774699916665.jpg> (referer: None)
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8816%252F20468816%252Fdocs_service_history-1774695448847.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De614aa6f64c019c8ca1da79a3543f4ed%27 HTTP/1.1" 200 None
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8816/20468816/docs_service_history-1774695448847.jpg?ixlib=js-3.8.0&auto=format&s=e614aa6f64c019c8ca1da79a3543f4ed not downloaded yet
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4311%252F20374311%252Finterior_boot-1774693954759.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4311/20374311/interior_boot-1774693954759.jpg not downloaded yet
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1251%252F14461251%252Fdocs_service_history-1774692942791.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6a249f19977a3bc1230ce0de855edde4%27 HTTP/1.1" 200 None
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1251/14461251/docs_service_history-1774692942791.jpg?ixlib=js-3.8.0&auto=format&s=6a249f19977a3bc1230ce0de855edde4 not downloaded yet
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b85110>
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ec0514-12f4-5e33-9320-8c123503b733/e1ec0514-12f4-5e33-9320-8c123503b733_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9773%252F15549773%252F15549773-interior_rear_seats-default-1774614833746.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9773/15549773/15549773-interior_rear_seats-default-1774614833746.jpg saved to cache
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e1ec0514-12f4-5e33-9320-8c123503b733
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582bd250>
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ec0514-12f4-5e33-9320-8c123503b733/e1ec0514-12f4-5e33-9320-8c123503b733_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9773%252F15549773%252F15549773-instrument_cluster-default-1774622853294.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9773/15549773/15549773-instrument_cluster-default-1774622853294.jpg saved to cache
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e1ec0514-12f4-5e33-9320-8c123503b733
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be84810>
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ec0514-12f4-5e33-9320-8c123503b733/e1ec0514-12f4-5e33-9320-8c123503b733_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9773%252F15549773%252F15549773-interior_dashboard-default-1774614852861.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9773/15549773/15549773-interior_dashboard-default-1774614852861.jpg saved to cache
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e1ec0514-12f4-5e33-9320-8c123503b733
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8816%252F20468816%252Fdocs_service_history-1774695450575.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da571d7e77d2af85e31c6e8bcc82dc3cc%27 HTTP/1.1" 200 None
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8816/20468816/docs_service_history-1774695450575.jpg?ixlib=js-3.8.0&auto=format&s=a571d7e77d2af85e31c6e8bcc82dc3cc not downloaded yet
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4311%252F20374311%252Fdocs_service_history-1774694098431.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dec07355ba5f623e010a21a61d934ec9a%27 HTTP/1.1" 200 None
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4311/20374311/docs_service_history-1774694098431.jpg?ixlib=js-3.8.0&auto=format&s=ec07355ba5f623e010a21a61d934ec9a not downloaded yet
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1251%252F14461251%252Fwheels_front_driver-1774602421134.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1251/14461251/wheels_front_driver-1774602421134.jpg not downloaded yet
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be43f90>
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69703630-8ae1-5a70-b157-fbd013ce258a/69703630-8ae1-5a70-b157-fbd013ce258a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8331%252F19288331%252Fdamage_paintwork-1774699869745.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8331/19288331/damage_paintwork-1774699869745.jpg saved to cache
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 69703630-8ae1-5a70-b157-fbd013ce258a
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fa84d0>
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69703630-8ae1-5a70-b157-fbd013ce258a/69703630-8ae1-5a70-b157-fbd013ce258a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8331%252F19288331%252Fdamage_paintwork-1774699916665.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8331/19288331/damage_paintwork-1774699916665.jpg saved to cache
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 69703630-8ae1-5a70-b157-fbd013ce258a
2026-03-29 20:15:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3529/13753529/interior_dashboard-1774630787102.jpg> (referer: None)
2026-03-29 20:15:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8488/16868488/instrument_cluster-1774715563592.jpg> (referer: None)
2026-03-29 20:15:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3529/13753529/instrument_cluster-1774630650883.jpg> (referer: None)
2026-03-29 20:15:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8488/16868488/interior_dashboard-1774715529086.jpg> (referer: None)
2026-03-29 20:15:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1251/14461251/interior_front_seats-1774603581184.jpg> (referer: None)
2026-03-29 20:15:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8488/16868488/interior_rear_seats-1774715498852.jpg> (referer: None)
2026-03-29 20:15:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4311/20374311/interior_front_seats-1774694004253.jpg> (referer: None)
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a7a2d0>
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28040276-8ab4-51fc-b135-c3c9ad692553/28040276-8ab4-51fc-b135-c3c9ad692553_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3529%252F13753529%252Finterior_dashboard-1774630787102.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3529/13753529/interior_dashboard-1774630787102.jpg saved to cache
2026-03-29 20:15:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 28040276-8ab4-51fc-b135-c3c9ad692553
2026-03-29 20:15:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658118510>
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87090821-ad15-57c6-a877-d4bdb258a2f0/87090821-ad15-57c6-a877-d4bdb258a2f0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8488%252F16868488%252Finstrument_cluster-1774715563592.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8488/16868488/instrument_cluster-1774715563592.jpg saved to cache
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 87090821-ad15-57c6-a877-d4bdb258a2f0
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a1ae90>
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28040276-8ab4-51fc-b135-c3c9ad692553/28040276-8ab4-51fc-b135-c3c9ad692553_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3529%252F13753529%252Finstrument_cluster-1774630650883.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3529/13753529/instrument_cluster-1774630650883.jpg saved to cache
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 28040276-8ab4-51fc-b135-c3c9ad692553
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c1ab50>
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87090821-ad15-57c6-a877-d4bdb258a2f0/87090821-ad15-57c6-a877-d4bdb258a2f0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8488%252F16868488%252Finterior_dashboard-1774715529086.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8488/16868488/interior_dashboard-1774715529086.jpg saved to cache
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 87090821-ad15-57c6-a877-d4bdb258a2f0
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a30d90>
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03671cb9-2521-560d-ad98-688930550de3/03671cb9-2521-560d-ad98-688930550de3_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1251%252F14461251%252Finterior_front_seats-1774603581184.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1251/14461251/interior_front_seats-1774603581184.jpg saved to cache
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 03671cb9-2521-560d-ad98-688930550de3
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b5ab50>
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87090821-ad15-57c6-a877-d4bdb258a2f0/87090821-ad15-57c6-a877-d4bdb258a2f0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8488%252F16868488%252Finterior_rear_seats-1774715498852.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8488/16868488/interior_rear_seats-1774715498852.jpg saved to cache
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 87090821-ad15-57c6-a877-d4bdb258a2f0
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a41850>
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1111c056-716a-52c0-9a16-54165e019ccb/1111c056-716a-52c0-9a16-54165e019ccb_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4311%252F20374311%252Finterior_front_seats-1774694004253.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4311/20374311/interior_front_seats-1774694004253.jpg saved to cache
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1111c056-716a-52c0-9a16-54165e019ccb
2026-03-29 20:15:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8816/20468816/interior_front_seats-1774694886907.jpg> (referer: None)
2026-03-29 20:15:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1251/14461251/wheels_front_driver-1774602421134.jpg> (referer: None)
2026-03-29 20:15:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4311/20374311/interior_boot-1774693954759.jpg> (referer: None)
2026-03-29 20:15:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/1251/14461251/docs_service_history-1774692942791.jpg?ixlib=js-3.8.0&auto=format&s=6a249f19977a3bc1230ce0de855edde4> (referer: None)
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a31250>
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ab6001-7e65-50e4-afb0-6e937d41facf/a3ab6001-7e65-50e4-afb0-6e937d41facf_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8816%252F20468816%252Finterior_front_seats-1774694886907.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8816/20468816/interior_front_seats-1774694886907.jpg saved to cache
2026-03-29 20:15:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a3ab6001-7e65-50e4-afb0-6e937d41facf
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658378c50>
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03671cb9-2521-560d-ad98-688930550de3/03671cb9-2521-560d-ad98-688930550de3_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1251%252F14461251%252Fwheels_front_driver-1774602421134.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1251/14461251/wheels_front_driver-1774602421134.jpg saved to cache
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 03671cb9-2521-560d-ad98-688930550de3
2026-03-29 20:15:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a41150>
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1111c056-716a-52c0-9a16-54165e019ccb/1111c056-716a-52c0-9a16-54165e019ccb_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4311%252F20374311%252Finterior_boot-1774693954759.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4311/20374311/interior_boot-1774693954759.jpg saved to cache
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1111c056-716a-52c0-9a16-54165e019ccb
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf00850>
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03671cb9-2521-560d-ad98-688930550de3/03671cb9-2521-560d-ad98-688930550de3_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1251%252F14461251%252Fdocs_service_history-1774692942791.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6a249f19977a3bc1230ce0de855edde4') HTTP/1.1" 204 0
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1251/14461251/docs_service_history-1774692942791.jpg?ixlib=js-3.8.0&auto=format&s=6a249f19977a3bc1230ce0de855edde4 saved to cache
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 03671cb9-2521-560d-ad98-688930550de3
2026-03-29 20:15:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20479789.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8816/20468816/docs_service_history-1774695448847.jpg?ixlib=js-3.8.0&auto=format&s=e614aa6f64c019c8ca1da79a3543f4ed> (referer: None)
2026-03-29 20:15:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8816/20468816/docs_service_history-1774695450575.jpg?ixlib=js-3.8.0&auto=format&s=a571d7e77d2af85e31c6e8bcc82dc3cc> (referer: None)
2026-03-29 20:15:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1251/14461251/interior_boot-1774692955699.jpg> (referer: None)
2026-03-29 20:15:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1251/14461251/interior_dashboard-1774610952979.jpg> (referer: None)
2026-03-29 20:15:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8816/20468816/interior_boot-1774694829859.jpg> (referer: None)
2026-03-29 20:15:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4311/20374311/interior_dashboard-1774695562236.jpg> (referer: None)
2026-03-29 20:15:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dd682f8-6a8c-5def-83d3-e7e073cae6be with identifier: 20479789
2026-03-29 20:15:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dd682f8-6a8c-5def-83d3-e7e073cae6be with scrape type 1
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9dd682f8-6a8c-5def-83d3-e7e073cae6be
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9789%252F20479789%252Fexterior_front_driver-1774688229663.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9789/20479789/exterior_front_driver-1774688229663.jpg not downloaded yet
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9789%252F20479789%252Fexterior_rear_driver-1774688237050.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9789/20479789/exterior_rear_driver-1774688237050.jpg not downloaded yet
2026-03-29 20:15:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4311/20374311/instrument_cluster-1774693823026.jpg> (referer: None)
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9789%252F20479789%252Fexterior_front_passenger-1774688242491.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9789/20479789/exterior_front_passenger-1774688242491.jpg not downloaded yet
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bec96d0>
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ab6001-7e65-50e4-afb0-6e937d41facf/a3ab6001-7e65-50e4-afb0-6e937d41facf_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8816%252F20468816%252Fdocs_service_history-1774695448847.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De614aa6f64c019c8ca1da79a3543f4ed') HTTP/1.1" 204 0
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8816/20468816/docs_service_history-1774695448847.jpg?ixlib=js-3.8.0&auto=format&s=e614aa6f64c019c8ca1da79a3543f4ed saved to cache
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a3ab6001-7e65-50e4-afb0-6e937d41facf
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658dae6d0>
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ab6001-7e65-50e4-afb0-6e937d41facf/a3ab6001-7e65-50e4-afb0-6e937d41facf_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8816%252F20468816%252Fdocs_service_history-1774695450575.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da571d7e77d2af85e31c6e8bcc82dc3cc') HTTP/1.1" 204 0
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8816/20468816/docs_service_history-1774695450575.jpg?ixlib=js-3.8.0&auto=format&s=a571d7e77d2af85e31c6e8bcc82dc3cc saved to cache
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a3ab6001-7e65-50e4-afb0-6e937d41facf
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6585160d0>
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03671cb9-2521-560d-ad98-688930550de3/03671cb9-2521-560d-ad98-688930550de3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1251%252F14461251%252Finterior_boot-1774692955699.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1251/14461251/interior_boot-1774692955699.jpg saved to cache
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 03671cb9-2521-560d-ad98-688930550de3
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fac450>
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03671cb9-2521-560d-ad98-688930550de3/03671cb9-2521-560d-ad98-688930550de3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1251%252F14461251%252Finterior_dashboard-1774610952979.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1251/14461251/interior_dashboard-1774610952979.jpg saved to cache
2026-03-29 20:15:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 03671cb9-2521-560d-ad98-688930550de3
2026-03-29 20:15:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658daea10>
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ab6001-7e65-50e4-afb0-6e937d41facf/a3ab6001-7e65-50e4-afb0-6e937d41facf_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8816%252F20468816%252Finterior_boot-1774694829859.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8816/20468816/interior_boot-1774694829859.jpg saved to cache
2026-03-29 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a3ab6001-7e65-50e4-afb0-6e937d41facf
2026-03-29 20:15:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658541210>
2026-03-29 20:15:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1111c056-716a-52c0-9a16-54165e019ccb/1111c056-716a-52c0-9a16-54165e019ccb_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4311%252F20374311%252Finterior_dashboard-1774695562236.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4311/20374311/interior_dashboard-1774695562236.jpg saved to cache
2026-03-29 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1111c056-716a-52c0-9a16-54165e019ccb
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9789%252F20479789%252Fexterior_rear_passenger-1774688221384.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9789/20479789/exterior_rear_passenger-1774688221384.jpg not downloaded yet
2026-03-29 20:15:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20267620.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9789%252F20479789%252Finterior_front_seats-1774688972322.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9789/20479789/interior_front_seats-1774688972322.jpg not downloaded yet
2026-03-29 20:15:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a90550>
2026-03-29 20:15:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1111c056-716a-52c0-9a16-54165e019ccb/1111c056-716a-52c0-9a16-54165e019ccb_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4311%252F20374311%252Finstrument_cluster-1774693823026.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4311/20374311/instrument_cluster-1774693823026.jpg saved to cache
2026-03-29 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1111c056-716a-52c0-9a16-54165e019ccb
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9789%252F20479789%252Finterior_rear_seats-1774688973916.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9789/20479789/interior_rear_seats-1774688973916.jpg not downloaded yet
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9789%252F20479789%252Finterior_dashboard-1774688983065.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9789/20479789/interior_dashboard-1774688983065.jpg not downloaded yet
2026-03-29 20:15:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4a2f893-5c05-5995-a017-9be366f13f54 with identifier: 20267620
2026-03-29 20:15:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4a2f893-5c05-5995-a017-9be366f13f54 with scrape type 2
2026-03-29 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4a2f893-5c05-5995-a017-9be366f13f54 with scrape type 2
2026-03-29 20:15:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a4a2f893-5c05-5995-a017-9be366f13f54, identifier: 20267620
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9789%252F20479789%252Finstrument_cluster-1774691006260.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9789/20479789/instrument_cluster-1774691006260.jpg not downloaded yet
2026-03-29 20:15:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a4a2f893-5c05-5995-a017-9be366f13f54 with identifier: 20267620
2026-03-29 20:15:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a4a2f893-5c05-5995-a017-9be366f13f54 with identifier: 20267620
2026-03-29 20:15:29 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a4a2f893-5c05-5995-a017-9be366f13f54 with identifier: 20267620 to the API
2026-03-29 20:15:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20267620.json>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'a4a2f893-5c05-5995-a017-9be366f13f54',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'EY65 UWO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20267620',
'listing': 'auction',
'location': 'Essex London',
'make': 'Nissan',
'model': 'Micra',
'odometer': 10000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 3300,
'price_includes_vat': False,
'registration_date': '2015-09-17',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Micra Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'vin': 'MDHFBUK13U0834744',
'year': 2015}
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720267620%27 HTTP/1.1" 200 None
2026-03-29 20:15:30 [motorway.uk] INFO: Saving data for 20267620: {'auction_closing_time': 1774884600.0, 'created_time': 1773778339.817475, 'last_price_update_time': 1774815330.155741}
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20267620') HTTP/1.1" 204 0
2026-03-29 20:15:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/4592998.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18697582.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9789%252F20479789%252Finterior_boot-1774690472498.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9789/20479789/interior_boot-1774690472498.jpg not downloaded yet
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9789%252F20479789%252Fdocs_service_history-1774690073189.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfca820aa30279d07be2d282852e8a3a9%27 HTTP/1.1" 200 None
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9789/20479789/docs_service_history-1774690073189.jpg?ixlib=js-3.8.0&auto=format&s=fca820aa30279d07be2d282852e8a3a9 not downloaded yet
2026-03-29 20:15:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1251/14461251/interior_rear_seats-1774603539530.jpg> (referer: None)
2026-03-29 20:15:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1251/14461251/exterior_rear_passenger-1774602156058.jpg> (referer: None)
2026-03-29 20:15:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9789/20479789/exterior_front_driver-1774688229663.jpg> (referer: None)
2026-03-29 20:15:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4311/20374311/exterior_rear_passenger-1774695868664.jpg> (referer: None)
2026-03-29 20:15:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1251/14461251/exterior_front_passenger-1774602196970.jpg> (referer: None)
2026-03-29 20:15:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8685caed-6806-523c-b8a6-17064c1c4136 with identifier: 4592998
2026-03-29 20:15:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8685caed-6806-523c-b8a6-17064c1c4136 with scrape type 1
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8685caed-6806-523c-b8a6-17064c1c4136
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2998%252F4592998%252Fexterior_front_driver-1774705825784.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2998/4592998/exterior_front_driver-1774705825784.jpg not downloaded yet
2026-03-29 20:15:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48ef0219-1a18-57df-b264-e5890f5bb363 with identifier: 18697582
2026-03-29 20:15:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48ef0219-1a18-57df-b264-e5890f5bb363 with scrape type 1
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 48ef0219-1a18-57df-b264-e5890f5bb363
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7582%252F18697582%252Fexterior_front_driver-1774631810119.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7582/18697582/exterior_front_driver-1774631810119.jpeg not downloaded yet
2026-03-29 20:15:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9789/20479789/exterior_rear_driver-1774688237050.jpg> (referer: None)
2026-03-29 20:15:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9789/20479789/exterior_front_passenger-1774688242491.jpg> (referer: None)
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2998%252F4592998%252Fexterior_rear_driver-1774705981350.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2998/4592998/exterior_rear_driver-1774705981350.jpg not downloaded yet
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7582%252F18697582%252Fexterior_rear_driver-1774631880352.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7582/18697582/exterior_rear_driver-1774631880352.jpeg not downloaded yet
2026-03-29 20:15:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8816/20468816/exterior_rear_passenger-1774693886152.jpg> (referer: None)
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2998%252F4592998%252Fexterior_front_passenger-1774705866486.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2998/4592998/exterior_front_passenger-1774705866486.jpg not downloaded yet
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7582%252F18697582%252Fexterior_front_passenger-1774631838017.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7582/18697582/exterior_front_passenger-1774631838017.jpeg not downloaded yet
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658dedd10>
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03671cb9-2521-560d-ad98-688930550de3/03671cb9-2521-560d-ad98-688930550de3_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1251%252F14461251%252Finterior_rear_seats-1774603539530.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1251/14461251/interior_rear_seats-1774603539530.jpg saved to cache
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 03671cb9-2521-560d-ad98-688930550de3
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a78ad0>
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03671cb9-2521-560d-ad98-688930550de3/03671cb9-2521-560d-ad98-688930550de3_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1251%252F14461251%252Fexterior_rear_passenger-1774602156058.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1251/14461251/exterior_rear_passenger-1774602156058.jpg saved to cache
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 03671cb9-2521-560d-ad98-688930550de3
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ce5010>
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd682f8-6a8c-5def-83d3-e7e073cae6be/9dd682f8-6a8c-5def-83d3-e7e073cae6be_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9789%252F20479789%252Fexterior_front_driver-1774688229663.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9789/20479789/exterior_front_driver-1774688229663.jpg saved to cache
2026-03-29 20:15:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9dd682f8-6a8c-5def-83d3-e7e073cae6be
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c3ed50>
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1111c056-716a-52c0-9a16-54165e019ccb/1111c056-716a-52c0-9a16-54165e019ccb_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4311%252F20374311%252Fexterior_rear_passenger-1774695868664.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4311/20374311/exterior_rear_passenger-1774695868664.jpg saved to cache
2026-03-29 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1111c056-716a-52c0-9a16-54165e019ccb
2026-03-29 20:15:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65886be10>
2026-03-29 20:15:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03671cb9-2521-560d-ad98-688930550de3/03671cb9-2521-560d-ad98-688930550de3_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1251%252F14461251%252Fexterior_front_passenger-1774602196970.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1251/14461251/exterior_front_passenger-1774602196970.jpg saved to cache
2026-03-29 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 03671cb9-2521-560d-ad98-688930550de3
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2998%252F4592998%252Fexterior_rear_passenger-1774705906660.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2998/4592998/exterior_rear_passenger-1774705906660.jpg not downloaded yet
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7582%252F18697582%252Fexterior_rear_passenger-1774631858832.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7582/18697582/exterior_rear_passenger-1774631858832.jpeg not downloaded yet
2026-03-29 20:15:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18656000.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2998%252F4592998%252F4592998-interior_front_seats-modified-1774708526644.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2998/4592998/4592998-interior_front_seats-modified-1774708526644.jpeg not downloaded yet
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7582%252F18697582%252Finterior_front_seats-1774631924999.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7582/18697582/interior_front_seats-1774631924999.jpeg not downloaded yet
2026-03-29 20:15:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8816/20468816/interior_dashboard-1774696597453.jpg> (referer: None)
2026-03-29 20:15:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e29350>
2026-03-29 20:15:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd682f8-6a8c-5def-83d3-e7e073cae6be/9dd682f8-6a8c-5def-83d3-e7e073cae6be_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9789%252F20479789%252Fexterior_rear_driver-1774688237050.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9789/20479789/exterior_rear_driver-1774688237050.jpg saved to cache
2026-03-29 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9dd682f8-6a8c-5def-83d3-e7e073cae6be
2026-03-29 20:15:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e73190>
2026-03-29 20:15:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd682f8-6a8c-5def-83d3-e7e073cae6be/9dd682f8-6a8c-5def-83d3-e7e073cae6be_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9789%252F20479789%252Fexterior_front_passenger-1774688242491.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9789/20479789/exterior_front_passenger-1774688242491.jpg saved to cache
2026-03-29 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9dd682f8-6a8c-5def-83d3-e7e073cae6be
2026-03-29 20:15:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582d5e10>
2026-03-29 20:15:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ab6001-7e65-50e4-afb0-6e937d41facf/a3ab6001-7e65-50e4-afb0-6e937d41facf_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8816%252F20468816%252Fexterior_rear_passenger-1774693886152.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8816/20468816/exterior_rear_passenger-1774693886152.jpg saved to cache
2026-03-29 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a3ab6001-7e65-50e4-afb0-6e937d41facf
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2998%252F4592998%252Finterior_rear_seats-1774706471688.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2998/4592998/interior_rear_seats-1774706471688.jpg not downloaded yet
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7582%252F18697582%252Finterior_rear_seats-1774633506271.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7582/18697582/interior_rear_seats-1774633506271.jpeg not downloaded yet
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2998%252F4592998%252F4592998-interior_dashboard-modified-1774708325410.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2998/4592998/4592998-interior_dashboard-modified-1774708325410.jpeg not downloaded yet
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7582%252F18697582%252F18697582-interior_dashboard-modified-1774690902215.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7582/18697582/18697582-interior_dashboard-modified-1774690902215.jpeg not downloaded yet
2026-03-29 20:15:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5d436d5-7276-545d-b6e2-f135f5d72f3a with identifier: 18656000
2026-03-29 20:15:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5d436d5-7276-545d-b6e2-f135f5d72f3a with scrape type 1
2026-03-29 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e5d436d5-7276-545d-b6e2-f135f5d72f3a
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6000%252F18656000%252Fexterior_front_driver-1774618046464.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6000/18656000/exterior_front_driver-1774618046464.jpg not downloaded yet
2026-03-29 20:15:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e73f10>
2026-03-29 20:15:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ab6001-7e65-50e4-afb0-6e937d41facf/a3ab6001-7e65-50e4-afb0-6e937d41facf_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8816%252F20468816%252Finterior_dashboard-1774696597453.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8816/20468816/interior_dashboard-1774696597453.jpg saved to cache
2026-03-29 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a3ab6001-7e65-50e4-afb0-6e937d41facf
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2998%252F4592998%252Finstrument_cluster-1774706486920.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2998/4592998/instrument_cluster-1774706486920.jpg not downloaded yet
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7582%252F18697582%252F18697582-instrument_cluster-modified-1774690816228.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7582/18697582/18697582-instrument_cluster-modified-1774690816228.jpeg not downloaded yet
2026-03-29 20:15:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9789/20479789/instrument_cluster-1774691006260.jpg> (referer: None)
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6000%252F18656000%252Fexterior_rear_driver-1774618062792.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6000/18656000/exterior_rear_driver-1774618062792.jpg not downloaded yet
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2998%252F4592998%252Finterior_boot-1774706517651.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2998/4592998/interior_boot-1774706517651.jpg not downloaded yet
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7582%252F18697582%252F18697582-interior_boot-modified-1774690922509.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7582/18697582/18697582-interior_boot-modified-1774690922509.jpeg not downloaded yet
2026-03-29 20:15:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9789/20479789/interior_boot-1774690472498.jpg> (referer: None)
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6000%252F18656000%252Fexterior_front_passenger-1774618113797.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6000/18656000/exterior_front_passenger-1774618113797.jpg not downloaded yet
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252F2998%252F4592998%252Fdocs_service_history-1699533692700.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da6ab80e72e759a778725345077cbc42d%27 HTTP/1.1" 200 None
2026-03-29 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/2998/4592998/docs_service_history-1699533692700.jpg?ixlib=js-3.8.0&auto=format&s=a6ab80e72e759a778725345077cbc42d not downloaded yet
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7582%252F18697582%252Fdocs_service_history-1774690389263.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D755d227aa15222b8673ad4ebe81e0de6%27 HTTP/1.1" 200 None
2026-03-29 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7582/18697582/docs_service_history-1774690389263.jpeg?ixlib=js-3.8.0&auto=format&s=755d227aa15222b8673ad4ebe81e0de6 not downloaded yet
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6000%252F18656000%252Fexterior_rear_passenger-1774618072497.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6000/18656000/exterior_rear_passenger-1774618072497.jpg not downloaded yet
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6000%252F18656000%252Finterior_front_seats-1774620401992.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6000/18656000/interior_front_seats-1774620401992.jpg not downloaded yet
2026-03-29 20:15:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c707d0>
2026-03-29 20:15:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd682f8-6a8c-5def-83d3-e7e073cae6be/9dd682f8-6a8c-5def-83d3-e7e073cae6be_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9789%252F20479789%252Finstrument_cluster-1774691006260.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9789/20479789/instrument_cluster-1774691006260.jpg saved to cache
2026-03-29 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9dd682f8-6a8c-5def-83d3-e7e073cae6be
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6000%252F18656000%252Finterior_rear_seats-1774620414919.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6000/18656000/interior_rear_seats-1774620414919.jpg not downloaded yet
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6000%252F18656000%252Finterior_dashboard-1774620523014.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6000/18656000/interior_dashboard-1774620523014.jpg not downloaded yet
2026-03-29 20:15:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f3d8d0>
2026-03-29 20:15:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd682f8-6a8c-5def-83d3-e7e073cae6be/9dd682f8-6a8c-5def-83d3-e7e073cae6be_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9789%252F20479789%252Finterior_boot-1774690472498.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9789/20479789/interior_boot-1774690472498.jpg saved to cache
2026-03-29 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9dd682f8-6a8c-5def-83d3-e7e073cae6be
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6000%252F18656000%252Finstrument_cluster-1774620499882.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6000/18656000/instrument_cluster-1774620499882.jpg not downloaded yet
2026-03-29 20:15:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9789/20479789/interior_rear_seats-1774688973916.jpg> (referer: None)
2026-03-29 20:15:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4311/20374311/docs_service_history-1774694098431.jpg?ixlib=js-3.8.0&auto=format&s=ec07355ba5f623e010a21a61d934ec9a> (referer: None)
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6000%252F18656000%252Finterior_boot-1774620444849.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6000/18656000/interior_boot-1774620444849.jpg not downloaded yet
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6000%252F18656000%252Fdamage_scratches-1774618150273.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6000/18656000/damage_scratches-1774618150273.jpg not downloaded yet
2026-03-29 20:15:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8816/20468816/interior_rear_seats-1774694783671.jpg> (referer: None)
2026-03-29 20:15:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9789/20479789/docs_service_history-1774690073189.jpg?ixlib=js-3.8.0&auto=format&s=fca820aa30279d07be2d282852e8a3a9> (referer: None)
2026-03-29 20:15:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2998/4592998/interior_rear_seats-1774706471688.jpg> (referer: None)
2026-03-29 20:15:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4311/20374311/interior_rear_seats-1774693846989.jpg> (referer: None)
2026-03-29 20:15:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7582/18697582/exterior_front_passenger-1774631838017.jpeg> (referer: None)
2026-03-29 20:15:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2998/4592998/exterior_rear_passenger-1774705906660.jpg> (referer: None)
2026-03-29 20:15:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9789/20479789/interior_dashboard-1774688983065.jpg> (referer: None)
2026-03-29 20:15:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6000/18656000/exterior_front_driver-1774618046464.jpg> (referer: None)
2026-03-29 20:15:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7582/18697582/exterior_rear_passenger-1774631858832.jpeg> (referer: None)
2026-03-29 20:15:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7582/18697582/interior_rear_seats-1774633506271.jpeg> (referer: None)
2026-03-29 20:15:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7582/18697582/interior_front_seats-1774631924999.jpeg> (referer: None)
2026-03-29 20:15:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fd8490>
2026-03-29 20:15:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd682f8-6a8c-5def-83d3-e7e073cae6be/9dd682f8-6a8c-5def-83d3-e7e073cae6be_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9789%252F20479789%252Finterior_rear_seats-1774688973916.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9789/20479789/interior_rear_seats-1774688973916.jpg saved to cache
2026-03-29 20:15:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9dd682f8-6a8c-5def-83d3-e7e073cae6be
2026-03-29 20:15:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:32 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:15:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658dd7790>
2026-03-29 20:15:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1111c056-716a-52c0-9a16-54165e019ccb/1111c056-716a-52c0-9a16-54165e019ccb_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4311%252F20374311%252Fdocs_service_history-1774694098431.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dec07355ba5f623e010a21a61d934ec9a') HTTP/1.1" 204 0
2026-03-29 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4311/20374311/docs_service_history-1774694098431.jpg?ixlib=js-3.8.0&auto=format&s=ec07355ba5f623e010a21a61d934ec9a saved to cache
2026-03-29 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1111c056-716a-52c0-9a16-54165e019ccb
2026-03-29 20:15:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bedfc50>
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ab6001-7e65-50e4-afb0-6e937d41facf/a3ab6001-7e65-50e4-afb0-6e937d41facf_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8816%252F20468816%252Finterior_rear_seats-1774694783671.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8816/20468816/interior_rear_seats-1774694783671.jpg saved to cache
2026-03-29 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a3ab6001-7e65-50e4-afb0-6e937d41facf
2026-03-29 20:15:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-29 20:15:33 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:15:33 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:15:33 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x1c:\xe3\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01X;\x00\x1c38\x00\x00\x00\x00'
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfd2150>
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd682f8-6a8c-5def-83d3-e7e073cae6be/9dd682f8-6a8c-5def-83d3-e7e073cae6be_image_9.mpo HTTP/1.1" 201 0
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9789%252F20479789%252Fdocs_service_history-1774690073189.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfca820aa30279d07be2d282852e8a3a9') HTTP/1.1" 204 0
2026-03-29 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9789/20479789/docs_service_history-1774690073189.jpg?ixlib=js-3.8.0&auto=format&s=fca820aa30279d07be2d282852e8a3a9 saved to cache
2026-03-29 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9dd682f8-6a8c-5def-83d3-e7e073cae6be
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599dddd0>
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8685caed-6806-523c-b8a6-17064c1c4136/8685caed-6806-523c-b8a6-17064c1c4136_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2998%252F4592998%252Finterior_rear_seats-1774706471688.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2998/4592998/interior_rear_seats-1774706471688.jpg saved to cache
2026-03-29 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8685caed-6806-523c-b8a6-17064c1c4136
2026-03-29 20:15:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659eaaf90>
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1111c056-716a-52c0-9a16-54165e019ccb/1111c056-716a-52c0-9a16-54165e019ccb_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4311%252F20374311%252Finterior_rear_seats-1774693846989.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4311/20374311/interior_rear_seats-1774693846989.jpg saved to cache
2026-03-29 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1111c056-716a-52c0-9a16-54165e019ccb
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d0a1d0>
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48ef0219-1a18-57df-b264-e5890f5bb363/48ef0219-1a18-57df-b264-e5890f5bb363_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7582%252F18697582%252Fexterior_front_passenger-1774631838017.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7582/18697582/exterior_front_passenger-1774631838017.jpeg saved to cache
2026-03-29 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 48ef0219-1a18-57df-b264-e5890f5bb363
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658dd6c90>
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8685caed-6806-523c-b8a6-17064c1c4136/8685caed-6806-523c-b8a6-17064c1c4136_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2998%252F4592998%252Fexterior_rear_passenger-1774705906660.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2998/4592998/exterior_rear_passenger-1774705906660.jpg saved to cache
2026-03-29 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8685caed-6806-523c-b8a6-17064c1c4136
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a8d110>
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd682f8-6a8c-5def-83d3-e7e073cae6be/9dd682f8-6a8c-5def-83d3-e7e073cae6be_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9789%252F20479789%252Finterior_dashboard-1774688983065.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9789/20479789/interior_dashboard-1774688983065.jpg saved to cache
2026-03-29 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9dd682f8-6a8c-5def-83d3-e7e073cae6be
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfd1b50>
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d436d5-7276-545d-b6e2-f135f5d72f3a/e5d436d5-7276-545d-b6e2-f135f5d72f3a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6000%252F18656000%252Fexterior_front_driver-1774618046464.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6000/18656000/exterior_front_driver-1774618046464.jpg saved to cache
2026-03-29 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e5d436d5-7276-545d-b6e2-f135f5d72f3a
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65902b8d0>
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48ef0219-1a18-57df-b264-e5890f5bb363/48ef0219-1a18-57df-b264-e5890f5bb363_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7582%252F18697582%252Fexterior_rear_passenger-1774631858832.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7582/18697582/exterior_rear_passenger-1774631858832.jpeg saved to cache
2026-03-29 20:15:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 48ef0219-1a18-57df-b264-e5890f5bb363
2026-03-29 20:15:33 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:15:33 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:15:33 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00$\xfae\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\x12\xa4\x00$\xf0\x8b\x00\x00\x00\x00'
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfd0dd0>
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48ef0219-1a18-57df-b264-e5890f5bb363/48ef0219-1a18-57df-b264-e5890f5bb363_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7582%252F18697582%252Finterior_rear_seats-1774633506271.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7582/18697582/interior_rear_seats-1774633506271.jpeg saved to cache
2026-03-29 20:15:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 48ef0219-1a18-57df-b264-e5890f5bb363
2026-03-29 20:15:34 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:15:34 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:15:34 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x000\xc8V\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02px\x000\xbe|\x00\x00\x00\x00'
2026-03-29 20:15:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fdb250>
2026-03-29 20:15:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48ef0219-1a18-57df-b264-e5890f5bb363/48ef0219-1a18-57df-b264-e5890f5bb363_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7582%252F18697582%252Finterior_front_seats-1774631924999.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7582/18697582/interior_front_seats-1774631924999.jpeg saved to cache
2026-03-29 20:15:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 48ef0219-1a18-57df-b264-e5890f5bb363
2026-03-29 20:15:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7582/18697582/18697582-interior_boot-modified-1774690922509.jpeg> (referer: None)
2026-03-29 20:15:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2998/4592998/4592998-interior_front_seats-modified-1774708526644.jpeg> (referer: None)
2026-03-29 20:15:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6000/18656000/interior_dashboard-1774620523014.jpg> (referer: None)
2026-03-29 20:15:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6580fa1d0>
2026-03-29 20:15:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48ef0219-1a18-57df-b264-e5890f5bb363/48ef0219-1a18-57df-b264-e5890f5bb363_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7582%252F18697582%252F18697582-interior_boot-modified-1774690922509.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7582/18697582/18697582-interior_boot-modified-1774690922509.jpeg saved to cache
2026-03-29 20:15:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 48ef0219-1a18-57df-b264-e5890f5bb363
2026-03-29 20:15:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658b45e10>
2026-03-29 20:15:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8685caed-6806-523c-b8a6-17064c1c4136/8685caed-6806-523c-b8a6-17064c1c4136_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2998%252F4592998%252F4592998-interior_front_seats-modified-1774708526644.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2998/4592998/4592998-interior_front_seats-modified-1774708526644.jpeg saved to cache
2026-03-29 20:15:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8685caed-6806-523c-b8a6-17064c1c4136
2026-03-29 20:15:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d8bd50>
2026-03-29 20:15:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d436d5-7276-545d-b6e2-f135f5d72f3a/e5d436d5-7276-545d-b6e2-f135f5d72f3a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6000%252F18656000%252Finterior_dashboard-1774620523014.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6000/18656000/interior_dashboard-1774620523014.jpg saved to cache
2026-03-29 20:15:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e5d436d5-7276-545d-b6e2-f135f5d72f3a
2026-03-29 20:15:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2998/4592998/interior_boot-1774706517651.jpg> (referer: None)
2026-03-29 20:15:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6000/18656000/exterior_rear_passenger-1774618072497.jpg> (referer: None)
2026-03-29 20:15:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7582/18697582/18697582-instrument_cluster-modified-1774690816228.jpeg> (referer: None)
2026-03-29 20:15:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6000/18656000/exterior_front_passenger-1774618113797.jpg> (referer: None)
2026-03-29 20:15:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2998/4592998/instrument_cluster-1774706486920.jpg> (referer: None)
2026-03-29 20:15:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6000/18656000/exterior_rear_driver-1774618062792.jpg> (referer: None)
2026-03-29 20:15:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2998/4592998/4592998-interior_dashboard-modified-1774708325410.jpeg> (referer: None)
2026-03-29 20:15:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6000/18656000/interior_rear_seats-1774620414919.jpg> (referer: None)
2026-03-29 20:15:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6000/18656000/damage_scratches-1774618150273.jpg> (referer: None)
2026-03-29 20:15:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6000/18656000/instrument_cluster-1774620499882.jpg> (referer: None)
2026-03-29 20:15:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7582/18697582/docs_service_history-1774690389263.jpeg?ixlib=js-3.8.0&auto=format&s=755d227aa15222b8673ad4ebe81e0de6> (referer: None)
2026-03-29 20:15:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6000/18656000/interior_boot-1774620444849.jpg> (referer: None)
2026-03-29 20:15:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6000/18656000/interior_front_seats-1774620401992.jpg> (referer: None)
2026-03-29 20:15:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f25c90>
2026-03-29 20:15:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8685caed-6806-523c-b8a6-17064c1c4136/8685caed-6806-523c-b8a6-17064c1c4136_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2998%252F4592998%252Finterior_boot-1774706517651.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2998/4592998/interior_boot-1774706517651.jpg saved to cache
2026-03-29 20:15:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8685caed-6806-523c-b8a6-17064c1c4136
2026-03-29 20:15:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587943d0>
2026-03-29 20:15:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d436d5-7276-545d-b6e2-f135f5d72f3a/e5d436d5-7276-545d-b6e2-f135f5d72f3a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6000%252F18656000%252Fexterior_rear_passenger-1774618072497.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6000/18656000/exterior_rear_passenger-1774618072497.jpg saved to cache
2026-03-29 20:15:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e5d436d5-7276-545d-b6e2-f135f5d72f3a
2026-03-29 20:15:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658542290>
2026-03-29 20:15:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48ef0219-1a18-57df-b264-e5890f5bb363/48ef0219-1a18-57df-b264-e5890f5bb363_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7582%252F18697582%252F18697582-instrument_cluster-modified-1774690816228.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7582/18697582/18697582-instrument_cluster-modified-1774690816228.jpeg saved to cache
2026-03-29 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 48ef0219-1a18-57df-b264-e5890f5bb363
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a09550>
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d436d5-7276-545d-b6e2-f135f5d72f3a/e5d436d5-7276-545d-b6e2-f135f5d72f3a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6000%252F18656000%252Fexterior_front_passenger-1774618113797.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6000/18656000/exterior_front_passenger-1774618113797.jpg saved to cache
2026-03-29 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e5d436d5-7276-545d-b6e2-f135f5d72f3a
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658467ed0>
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8685caed-6806-523c-b8a6-17064c1c4136/8685caed-6806-523c-b8a6-17064c1c4136_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2998%252F4592998%252Finstrument_cluster-1774706486920.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2998/4592998/instrument_cluster-1774706486920.jpg saved to cache
2026-03-29 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8685caed-6806-523c-b8a6-17064c1c4136
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a08050>
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d436d5-7276-545d-b6e2-f135f5d72f3a/e5d436d5-7276-545d-b6e2-f135f5d72f3a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6000%252F18656000%252Fexterior_rear_driver-1774618062792.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6000/18656000/exterior_rear_driver-1774618062792.jpg saved to cache
2026-03-29 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e5d436d5-7276-545d-b6e2-f135f5d72f3a
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a09cd0>
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8685caed-6806-523c-b8a6-17064c1c4136/8685caed-6806-523c-b8a6-17064c1c4136_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2998%252F4592998%252F4592998-interior_dashboard-modified-1774708325410.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2998/4592998/4592998-interior_dashboard-modified-1774708325410.jpeg saved to cache
2026-03-29 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8685caed-6806-523c-b8a6-17064c1c4136
2026-03-29 20:15:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583092d0>
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d436d5-7276-545d-b6e2-f135f5d72f3a/e5d436d5-7276-545d-b6e2-f135f5d72f3a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6000%252F18656000%252Finterior_rear_seats-1774620414919.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6000/18656000/interior_rear_seats-1774620414919.jpg saved to cache
2026-03-29 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e5d436d5-7276-545d-b6e2-f135f5d72f3a
2026-03-29 20:15:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:15:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658425ad0>
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d436d5-7276-545d-b6e2-f135f5d72f3a/e5d436d5-7276-545d-b6e2-f135f5d72f3a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6000%252F18656000%252Fdamage_scratches-1774618150273.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6000/18656000/damage_scratches-1774618150273.jpg saved to cache
2026-03-29 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e5d436d5-7276-545d-b6e2-f135f5d72f3a
2026-03-29 20:15:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a0bc10>
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d436d5-7276-545d-b6e2-f135f5d72f3a/e5d436d5-7276-545d-b6e2-f135f5d72f3a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6000%252F18656000%252Finstrument_cluster-1774620499882.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6000/18656000/instrument_cluster-1774620499882.jpg saved to cache
2026-03-29 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e5d436d5-7276-545d-b6e2-f135f5d72f3a
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e1e850>
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48ef0219-1a18-57df-b264-e5890f5bb363/48ef0219-1a18-57df-b264-e5890f5bb363_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7582%252F18697582%252Fdocs_service_history-1774690389263.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D755d227aa15222b8673ad4ebe81e0de6') HTTP/1.1" 204 0
2026-03-29 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7582/18697582/docs_service_history-1774690389263.jpeg?ixlib=js-3.8.0&auto=format&s=755d227aa15222b8673ad4ebe81e0de6 saved to cache
2026-03-29 20:15:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 48ef0219-1a18-57df-b264-e5890f5bb363
2026-03-29 20:15:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a08450>
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d436d5-7276-545d-b6e2-f135f5d72f3a/e5d436d5-7276-545d-b6e2-f135f5d72f3a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6000%252F18656000%252Finterior_boot-1774620444849.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6000/18656000/interior_boot-1774620444849.jpg saved to cache
2026-03-29 20:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e5d436d5-7276-545d-b6e2-f135f5d72f3a
2026-03-29 20:15:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a08510>
2026-03-29 20:15:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d436d5-7276-545d-b6e2-f135f5d72f3a/e5d436d5-7276-545d-b6e2-f135f5d72f3a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6000%252F18656000%252Finterior_front_seats-1774620401992.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6000/18656000/interior_front_seats-1774620401992.jpg saved to cache
2026-03-29 20:15:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e5d436d5-7276-545d-b6e2-f135f5d72f3a
2026-03-29 20:15:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e5d436d5-7276-545d-b6e2-f135f5d72f3a, skipping ID generation
2026-03-29 20:15:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5d436d5-7276-545d-b6e2-f135f5d72f3a with scrape type 1
2026-03-29 20:15:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e5d436d5-7276-545d-b6e2-f135f5d72f3a sending to next pipeline
2026-03-29 20:15:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e5d436d5-7276-545d-b6e2-f135f5d72f3a, identifier: 18656000
2026-03-29 20:15:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e5d436d5-7276-545d-b6e2-f135f5d72f3a with identifier: 18656000
2026-03-29 20:15:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e5d436d5-7276-545d-b6e2-f135f5d72f3a with identifier: 18656000
2026-03-29 20:15:36 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e5d436d5-7276-545d-b6e2-f135f5d72f3a with identifier: 18656000 to the API
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/6000/18656000/interior_front_seats-1774620401992.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '2.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'e5d436d5-7276-545d-b6e2-f135f5d72f3a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'ML08 VMX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18656000',
'listing': 'auction',
'location': 'Greater London Uxbridge',
'make': 'Lexus',
'model': 'IS 250',
'odometer': 121200,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 30,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5d436d5-7276-545d-b6e2-f135f5d72f3a/e5d436d5-7276-545d-b6e2-f135f5d72f3a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1401803,
'Height': 2401,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6000/18656000/exterior_front_driver-1774618046464.jpg',
'Width': 3201},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5d436d5-7276-545d-b6e2-f135f5d72f3a/e5d436d5-7276-545d-b6e2-f135f5d72f3a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1514744,
'Height': 2504,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6000/18656000/exterior_rear_driver-1774618062792.jpg',
'Width': 3339},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5d436d5-7276-545d-b6e2-f135f5d72f3a/e5d436d5-7276-545d-b6e2-f135f5d72f3a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 861008,
'Height': 2703,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6000/18656000/exterior_front_passenger-1774618113797.jpg',
'Width': 3604},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5d436d5-7276-545d-b6e2-f135f5d72f3a/e5d436d5-7276-545d-b6e2-f135f5d72f3a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 775867,
'Height': 2414,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6000/18656000/exterior_rear_passenger-1774618072497.jpg',
'Width': 3219},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5d436d5-7276-545d-b6e2-f135f5d72f3a/e5d436d5-7276-545d-b6e2-f135f5d72f3a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2589977,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6000/18656000/interior_front_seats-1774620401992.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5d436d5-7276-545d-b6e2-f135f5d72f3a/e5d436d5-7276-545d-b6e2-f135f5d72f3a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2001818,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6000/18656000/interior_rear_seats-1774620414919.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5d436d5-7276-545d-b6e2-f135f5d72f3a/e5d436d5-7276-545d-b6e2-f135f5d72f3a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1977130,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6000/18656000/interior_dashboard-1774620523014.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5d436d5-7276-545d-b6e2-f135f5d72f3a/e5d436d5-7276-545d-b6e2-f135f5d72f3a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2730197,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6000/18656000/instrument_cluster-1774620499882.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5d436d5-7276-545d-b6e2-f135f5d72f3a/e5d436d5-7276-545d-b6e2-f135f5d72f3a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3464691,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6000/18656000/interior_boot-1774620444849.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5d436d5-7276-545d-b6e2-f135f5d72f3a/e5d436d5-7276-545d-b6e2-f135f5d72f3a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2611896,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6000/18656000/damage_scratches-1774618150273.jpg',
'Width': 4032}],
'price': 1100,
'price_includes_vat': False,
'registration_date': '2008-05-17',
'seats_number': None,
'seller_name': None,
'title': 'Lexus IS 250 SE Auto',
'transmission': 'automatic',
'trim': 'SE Auto',
'vin': 'JTHBK262805070760',
'year': 2008}
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718656000%27 HTTP/1.1" 200 None
2026-03-29 20:15:36 [motorway.uk] INFO: Saving data for 18656000: {'created_time': 1774815336.903027, 'last_price_update_time': 1774815336.903037, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18656000') HTTP/1.1" 204 0
2026-03-29 20:15:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20289196.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7582/18697582/18697582-interior_dashboard-modified-1774690902215.jpeg> (referer: None)
2026-03-29 20:15:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2998/4592998/exterior_front_driver-1774705825784.jpg> (referer: None)
2026-03-29 20:15:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2998/4592998/exterior_front_passenger-1774705866486.jpg> (referer: None)
2026-03-29 20:15:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/2998/4592998/docs_service_history-1699533692700.jpg?ixlib=js-3.8.0&auto=format&s=a6ab80e72e759a778725345077cbc42d> (referer: None)
2026-03-29 20:15:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2998/4592998/exterior_rear_driver-1774705981350.jpg> (referer: None)
2026-03-29 20:15:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7582/18697582/exterior_front_driver-1774631810119.jpeg> (referer: None)
2026-03-29 20:15:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7582/18697582/exterior_rear_driver-1774631880352.jpeg> (referer: None)
2026-03-29 20:15:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fd63841-264c-56ac-8ef4-94dcf5ce832d with identifier: 20289196
2026-03-29 20:15:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fd63841-264c-56ac-8ef4-94dcf5ce832d with scrape type 1
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3fd63841-264c-56ac-8ef4-94dcf5ce832d
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9196%252F20289196%252Fexterior_front_driver-1774714777125.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9196/20289196/exterior_front_driver-1774714777125.jpg not downloaded yet
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9196%252F20289196%252Fexterior_rear_driver-1774714787001.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9196/20289196/exterior_rear_driver-1774714787001.jpg not downloaded yet
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9196%252F20289196%252Fexterior_front_passenger-1774714810016.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9196/20289196/exterior_front_passenger-1774714810016.jpg not downloaded yet
2026-03-29 20:15:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658424a10>
2026-03-29 20:15:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48ef0219-1a18-57df-b264-e5890f5bb363/48ef0219-1a18-57df-b264-e5890f5bb363_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7582%252F18697582%252F18697582-interior_dashboard-modified-1774690902215.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7582/18697582/18697582-interior_dashboard-modified-1774690902215.jpeg saved to cache
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 48ef0219-1a18-57df-b264-e5890f5bb363
2026-03-29 20:15:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ae1b50>
2026-03-29 20:15:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8685caed-6806-523c-b8a6-17064c1c4136/8685caed-6806-523c-b8a6-17064c1c4136_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2998%252F4592998%252Fexterior_front_driver-1774705825784.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2998/4592998/exterior_front_driver-1774705825784.jpg saved to cache
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8685caed-6806-523c-b8a6-17064c1c4136
2026-03-29 20:15:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658125a10>
2026-03-29 20:15:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8685caed-6806-523c-b8a6-17064c1c4136/8685caed-6806-523c-b8a6-17064c1c4136_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2998%252F4592998%252Fexterior_front_passenger-1774705866486.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2998/4592998/exterior_front_passenger-1774705866486.jpg saved to cache
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8685caed-6806-523c-b8a6-17064c1c4136
2026-03-29 20:15:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 146 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 154 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:37 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xa0'
2026-03-29 20:15:37 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 162 - value: b'M2101K6G\x00'
2026-03-29 20:15:37 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xb8'
2026-03-29 20:15:37 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 82 - Data Location: 171 - value: b'Xiaomi\x00'
2026-03-29 20:15:37 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xc6'
2026-03-29 20:15:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:15:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:37 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 142 - Data Location: 178 - value: b'2023:11:09 12:41:27\x00'
2026-03-29 20:15:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f8dcd0>
2026-03-29 20:15:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8685caed-6806-523c-b8a6-17064c1c4136/8685caed-6806-523c-b8a6-17064c1c4136_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252F2998%252F4592998%252Fdocs_service_history-1699533692700.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da6ab80e72e759a778725345077cbc42d') HTTP/1.1" 204 0
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/2998/4592998/docs_service_history-1699533692700.jpg?ixlib=js-3.8.0&auto=format&s=a6ab80e72e759a778725345077cbc42d saved to cache
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8685caed-6806-523c-b8a6-17064c1c4136
2026-03-29 20:15:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65840b010>
2026-03-29 20:15:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8685caed-6806-523c-b8a6-17064c1c4136/8685caed-6806-523c-b8a6-17064c1c4136_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2998%252F4592998%252Fexterior_rear_driver-1774705981350.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2998/4592998/exterior_rear_driver-1774705981350.jpg saved to cache
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8685caed-6806-523c-b8a6-17064c1c4136
2026-03-29 20:15:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8685caed-6806-523c-b8a6-17064c1c4136, skipping ID generation
2026-03-29 20:15:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8685caed-6806-523c-b8a6-17064c1c4136 with scrape type 1
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8685caed-6806-523c-b8a6-17064c1c4136 sending to next pipeline
2026-03-29 20:15:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8685caed-6806-523c-b8a6-17064c1c4136, identifier: 4592998
2026-03-29 20:15:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658b455d0>
2026-03-29 20:15:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48ef0219-1a18-57df-b264-e5890f5bb363/48ef0219-1a18-57df-b264-e5890f5bb363_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7582%252F18697582%252Fexterior_front_driver-1774631810119.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7582/18697582/exterior_front_driver-1774631810119.jpeg saved to cache
2026-03-29 20:15:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 48ef0219-1a18-57df-b264-e5890f5bb363
2026-03-29 20:15:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a04510>
2026-03-29 20:15:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48ef0219-1a18-57df-b264-e5890f5bb363/48ef0219-1a18-57df-b264-e5890f5bb363_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7582%252F18697582%252Fexterior_rear_driver-1774631880352.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7582/18697582/exterior_rear_driver-1774631880352.jpeg saved to cache
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 48ef0219-1a18-57df-b264-e5890f5bb363
2026-03-29 20:15:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 48ef0219-1a18-57df-b264-e5890f5bb363, skipping ID generation
2026-03-29 20:15:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48ef0219-1a18-57df-b264-e5890f5bb363 with scrape type 1
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 48ef0219-1a18-57df-b264-e5890f5bb363 sending to next pipeline
2026-03-29 20:15:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 48ef0219-1a18-57df-b264-e5890f5bb363, identifier: 18697582
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9196%252F20289196%252Fexterior_rear_passenger-1774714793092.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9196/20289196/exterior_rear_passenger-1774714793092.jpg not downloaded yet
2026-03-29 20:15:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8685caed-6806-523c-b8a6-17064c1c4136 with identifier: 4592998
2026-03-29 20:15:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8685caed-6806-523c-b8a6-17064c1c4136 with identifier: 4592998
2026-03-29 20:15:38 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8685caed-6806-523c-b8a6-17064c1c4136 with identifier: 4592998 to the API
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2998/4592998/exterior_rear_driver-1774705981350.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '8685caed-6806-523c-b8a6-17064c1c4136',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'RX68 RWK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/4592998',
'listing': 'auction',
'location': 'Essex Chelmsford',
'make': 'BMW',
'model': '5 Series',
'odometer': 60932,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8685caed-6806-523c-b8a6-17064c1c4136/8685caed-6806-523c-b8a6-17064c1c4136_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1100352,
'Height': 1697,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2998/4592998/exterior_front_driver-1774705825784.jpg',
'Width': 2263},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8685caed-6806-523c-b8a6-17064c1c4136/8685caed-6806-523c-b8a6-17064c1c4136_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1300910,
'Height': 2070,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2998/4592998/exterior_rear_driver-1774705981350.jpg',
'Width': 2760},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8685caed-6806-523c-b8a6-17064c1c4136/8685caed-6806-523c-b8a6-17064c1c4136_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1214695,
'Height': 1867,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2998/4592998/exterior_front_passenger-1774705866486.jpg',
'Width': 2489},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8685caed-6806-523c-b8a6-17064c1c4136/8685caed-6806-523c-b8a6-17064c1c4136_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1437086,
'Height': 2164,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2998/4592998/exterior_rear_passenger-1774705906660.jpg',
'Width': 2885},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8685caed-6806-523c-b8a6-17064c1c4136/8685caed-6806-523c-b8a6-17064c1c4136_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1609103,
'Height': 2448,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2998/4592998/4592998-interior_front_seats-modified-1774708526644.jpeg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8685caed-6806-523c-b8a6-17064c1c4136/8685caed-6806-523c-b8a6-17064c1c4136_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1190236,
'Height': 2448,
'OriginUrl': 'https://motorway-photos.imgix.net/2998/4592998/interior_rear_seats-1774706471688.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8685caed-6806-523c-b8a6-17064c1c4136/8685caed-6806-523c-b8a6-17064c1c4136_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1552803,
'Height': 2448,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2998/4592998/4592998-interior_dashboard-modified-1774708325410.jpeg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8685caed-6806-523c-b8a6-17064c1c4136/8685caed-6806-523c-b8a6-17064c1c4136_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 981706,
'Height': 2448,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2998/4592998/instrument_cluster-1774706486920.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8685caed-6806-523c-b8a6-17064c1c4136/8685caed-6806-523c-b8a6-17064c1c4136_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1394574,
'Height': 2448,
'OriginUrl': 'https://motorway-photos.imgix.net/2998/4592998/interior_boot-1774706517651.jpg',
'Width': 3264},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8685caed-6806-523c-b8a6-17064c1c4136/8685caed-6806-523c-b8a6-17064c1c4136_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3717435,
'Height': 3000,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/2998/4592998/docs_service_history-1699533692700.jpg?ixlib=js-3.8.0&auto=format&s=a6ab80e72e759a778725345077cbc42d',
'Width': 4000}],
'price': 14444,
'price_includes_vat': False,
'registration_date': '2018-11-30',
'seats_number': None,
'seller_name': None,
'title': 'BMW 520d M Sport Auto',
'transmission': 'automatic',
'trim': '520d M Sport Auto',
'vin': 'WBAJF320X0BP88143',
'year': 2018}
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%274592998%27 HTTP/1.1" 200 None
2026-03-29 20:15:38 [motorway.uk] INFO: Saving data for 4592998: {'created_time': 1774815338.666712, 'last_price_update_time': 1774815338.666723, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='4592998') HTTP/1.1" 204 0
2026-03-29 20:15:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 48ef0219-1a18-57df-b264-e5890f5bb363 with identifier: 18697582
2026-03-29 20:15:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 48ef0219-1a18-57df-b264-e5890f5bb363 with identifier: 18697582
2026-03-29 20:15:38 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 48ef0219-1a18-57df-b264-e5890f5bb363 with identifier: 18697582 to the API
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7582/18697582/exterior_rear_driver-1774631880352.jpeg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '48ef0219-1a18-57df-b264-e5890f5bb363',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'BW21 URG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18697582',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Nissan',
'model': 'Juke',
'odometer': 27400,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48ef0219-1a18-57df-b264-e5890f5bb363/48ef0219-1a18-57df-b264-e5890f5bb363_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2070919,
'Height': 3016,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7582/18697582/exterior_front_driver-1774631810119.jpeg',
'Width': 4021},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48ef0219-1a18-57df-b264-e5890f5bb363/48ef0219-1a18-57df-b264-e5890f5bb363_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1940694,
'Height': 2741,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7582/18697582/exterior_rear_driver-1774631880352.jpeg',
'Width': 3655},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48ef0219-1a18-57df-b264-e5890f5bb363/48ef0219-1a18-57df-b264-e5890f5bb363_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1858809,
'Height': 2833,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7582/18697582/exterior_front_passenger-1774631838017.jpeg',
'Width': 3777},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48ef0219-1a18-57df-b264-e5890f5bb363/48ef0219-1a18-57df-b264-e5890f5bb363_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2268979,
'Height': 2878,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7582/18697582/exterior_rear_passenger-1774631858832.jpeg',
'Width': 3837},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48ef0219-1a18-57df-b264-e5890f5bb363/48ef0219-1a18-57df-b264-e5890f5bb363_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3356878,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7582/18697582/interior_front_seats-1774631924999.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48ef0219-1a18-57df-b264-e5890f5bb363/48ef0219-1a18-57df-b264-e5890f5bb363_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2493705,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7582/18697582/interior_rear_seats-1774633506271.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48ef0219-1a18-57df-b264-e5890f5bb363/48ef0219-1a18-57df-b264-e5890f5bb363_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2697770,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7582/18697582/18697582-interior_dashboard-modified-1774690902215.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48ef0219-1a18-57df-b264-e5890f5bb363/48ef0219-1a18-57df-b264-e5890f5bb363_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 891567,
'Height': 1776,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7582/18697582/18697582-instrument_cluster-modified-1774690816228.jpeg',
'Width': 2369},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48ef0219-1a18-57df-b264-e5890f5bb363/48ef0219-1a18-57df-b264-e5890f5bb363_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1245957,
'Height': 2019,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7582/18697582/18697582-interior_boot-modified-1774690922509.jpeg',
'Width': 2692},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48ef0219-1a18-57df-b264-e5890f5bb363/48ef0219-1a18-57df-b264-e5890f5bb363_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1997130,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7582/18697582/docs_service_history-1774690389263.jpeg?ixlib=js-3.8.0&auto=format&s=755d227aa15222b8673ad4ebe81e0de6',
'Width': 4032}],
'price': 11917,
'price_includes_vat': False,
'registration_date': '2021-08-31',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Juke N-Connecta DiG-T S-A',
'transmission': 'automatic',
'trim': 'N-Connecta DiG-T S-A',
'vin': 'SJNFAAF16U1135676',
'year': 2021}
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718697582%27 HTTP/1.1" 200 None
2026-03-29 20:15:39 [motorway.uk] INFO: Saving data for 18697582: {'created_time': 1774815339.086521, 'last_price_update_time': 1774815339.086532, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18697582') HTTP/1.1" 204 0
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9196%252F20289196%252Finterior_front_seats-1774714978981.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9196/20289196/interior_front_seats-1774714978981.jpg not downloaded yet
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9196%252F20289196%252Finterior_rear_seats-1774715003423.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9196/20289196/interior_rear_seats-1774715003423.jpg not downloaded yet
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9196%252F20289196%252Finterior_dashboard-1774715044687.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9196/20289196/interior_dashboard-1774715044687.jpg not downloaded yet
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9196%252F20289196%252Finstrument_cluster-1774715076069.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9196/20289196/instrument_cluster-1774715076069.jpg not downloaded yet
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9196%252F20289196%252Finterior_boot-1774715060907.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9196/20289196/interior_boot-1774715060907.jpg not downloaded yet
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9196%252F20289196%252Fdocs_service_history-1774718558882.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9b07e8ce6c4dcce470973d33056f0c2d%27 HTTP/1.1" 200 None
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9196/20289196/docs_service_history-1774718558882.jpg?ixlib=js-3.8.0&auto=format&s=9b07e8ce6c4dcce470973d33056f0c2d not downloaded yet
2026-03-29 20:15:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1251/14461251/exterior_front_driver-1774602117508.jpg> (referer: None)
2026-03-29 20:15:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4311/20374311/exterior_front_driver-1774695505963.jpg> (referer: None)
2026-03-29 20:15:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9789/20479789/exterior_rear_passenger-1774688221384.jpg> (referer: None)
2026-03-29 20:15:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1251/14461251/exterior_rear_driver-1774602277299.jpg> (referer: None)
2026-03-29 20:15:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9789/20479789/interior_front_seats-1774688972322.jpg> (referer: None)
2026-03-29 20:15:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4311/20374311/exterior_front_passenger-1774695541026.jpg> (referer: None)
2026-03-29 20:15:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4311/20374311/exterior_rear_driver-1774695930793.jpg> (referer: None)
2026-03-29 20:15:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8816/20468816/exterior_rear_driver-1774693967698.jpg> (referer: None)
2026-03-29 20:15:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8816/20468816/exterior_front_passenger-1774694217051.jpg> (referer: None)
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cfbcd0>
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03671cb9-2521-560d-ad98-688930550de3/03671cb9-2521-560d-ad98-688930550de3_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1251%252F14461251%252Fexterior_front_driver-1774602117508.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1251/14461251/exterior_front_driver-1774602117508.jpg saved to cache
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 03671cb9-2521-560d-ad98-688930550de3
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587b8610>
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1111c056-716a-52c0-9a16-54165e019ccb/1111c056-716a-52c0-9a16-54165e019ccb_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4311%252F20374311%252Fexterior_front_driver-1774695505963.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4311/20374311/exterior_front_driver-1774695505963.jpg saved to cache
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1111c056-716a-52c0-9a16-54165e019ccb
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfcad90>
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd682f8-6a8c-5def-83d3-e7e073cae6be/9dd682f8-6a8c-5def-83d3-e7e073cae6be_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9789%252F20479789%252Fexterior_rear_passenger-1774688221384.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9789/20479789/exterior_rear_passenger-1774688221384.jpg saved to cache
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9dd682f8-6a8c-5def-83d3-e7e073cae6be
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c231d0>
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03671cb9-2521-560d-ad98-688930550de3/03671cb9-2521-560d-ad98-688930550de3_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1251%252F14461251%252Fexterior_rear_driver-1774602277299.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1251/14461251/exterior_rear_driver-1774602277299.jpg saved to cache
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 03671cb9-2521-560d-ad98-688930550de3
2026-03-29 20:15:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 03671cb9-2521-560d-ad98-688930550de3, skipping ID generation
2026-03-29 20:15:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03671cb9-2521-560d-ad98-688930550de3 with scrape type 1
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 03671cb9-2521-560d-ad98-688930550de3 sending to next pipeline
2026-03-29 20:15:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 03671cb9-2521-560d-ad98-688930550de3, identifier: 14461251
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598bfd90>
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd682f8-6a8c-5def-83d3-e7e073cae6be/9dd682f8-6a8c-5def-83d3-e7e073cae6be_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9789%252F20479789%252Finterior_front_seats-1774688972322.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9789/20479789/interior_front_seats-1774688972322.jpg saved to cache
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9dd682f8-6a8c-5def-83d3-e7e073cae6be
2026-03-29 20:15:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9dd682f8-6a8c-5def-83d3-e7e073cae6be, skipping ID generation
2026-03-29 20:15:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dd682f8-6a8c-5def-83d3-e7e073cae6be with scrape type 1
2026-03-29 20:15:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9dd682f8-6a8c-5def-83d3-e7e073cae6be sending to next pipeline
2026-03-29 20:15:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9dd682f8-6a8c-5def-83d3-e7e073cae6be, identifier: 20479789
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582c5d50>
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1111c056-716a-52c0-9a16-54165e019ccb/1111c056-716a-52c0-9a16-54165e019ccb_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4311%252F20374311%252Fexterior_front_passenger-1774695541026.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4311/20374311/exterior_front_passenger-1774695541026.jpg saved to cache
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1111c056-716a-52c0-9a16-54165e019ccb
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfcab50>
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1111c056-716a-52c0-9a16-54165e019ccb/1111c056-716a-52c0-9a16-54165e019ccb_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4311%252F20374311%252Fexterior_rear_driver-1774695930793.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4311/20374311/exterior_rear_driver-1774695930793.jpg saved to cache
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1111c056-716a-52c0-9a16-54165e019ccb
2026-03-29 20:15:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1111c056-716a-52c0-9a16-54165e019ccb, skipping ID generation
2026-03-29 20:15:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1111c056-716a-52c0-9a16-54165e019ccb with scrape type 1
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1111c056-716a-52c0-9a16-54165e019ccb sending to next pipeline
2026-03-29 20:15:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 1111c056-716a-52c0-9a16-54165e019ccb, identifier: 20374311
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598be5d0>
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ab6001-7e65-50e4-afb0-6e937d41facf/a3ab6001-7e65-50e4-afb0-6e937d41facf_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8816%252F20468816%252Fexterior_rear_driver-1774693967698.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8816/20468816/exterior_rear_driver-1774693967698.jpg saved to cache
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a3ab6001-7e65-50e4-afb0-6e937d41facf
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfc93d0>
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ab6001-7e65-50e4-afb0-6e937d41facf/a3ab6001-7e65-50e4-afb0-6e937d41facf_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8816%252F20468816%252Fexterior_front_passenger-1774694217051.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8816/20468816/exterior_front_passenger-1774694217051.jpg saved to cache
2026-03-29 20:15:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a3ab6001-7e65-50e4-afb0-6e937d41facf
2026-03-29 20:15:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 03671cb9-2521-560d-ad98-688930550de3 with identifier: 14461251
2026-03-29 20:15:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 03671cb9-2521-560d-ad98-688930550de3 with identifier: 14461251
2026-03-29 20:15:40 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 03671cb9-2521-560d-ad98-688930550de3 with identifier: 14461251 to the API
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1251/14461251/exterior_rear_driver-1774602277299.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '03671cb9-2521-560d-ad98-688930550de3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KS21 LVH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/14461251',
'listing': 'auction',
'location': 'Tyne and Wear Gateshead',
'make': 'Audi',
'model': 'A3',
'odometer': 29970,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03671cb9-2521-560d-ad98-688930550de3/03671cb9-2521-560d-ad98-688930550de3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1309750,
'Height': 2765,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1251/14461251/exterior_front_driver-1774602117508.jpg',
'Width': 3687},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03671cb9-2521-560d-ad98-688930550de3/03671cb9-2521-560d-ad98-688930550de3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1329237,
'Height': 2873,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1251/14461251/exterior_rear_driver-1774602277299.jpg',
'Width': 3831},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03671cb9-2521-560d-ad98-688930550de3/03671cb9-2521-560d-ad98-688930550de3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1290089,
'Height': 2748,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1251/14461251/exterior_front_passenger-1774602196970.jpg',
'Width': 3664},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03671cb9-2521-560d-ad98-688930550de3/03671cb9-2521-560d-ad98-688930550de3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1300515,
'Height': 2777,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1251/14461251/exterior_rear_passenger-1774602156058.jpg',
'Width': 3702},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03671cb9-2521-560d-ad98-688930550de3/03671cb9-2521-560d-ad98-688930550de3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2204969,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1251/14461251/interior_front_seats-1774603581184.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03671cb9-2521-560d-ad98-688930550de3/03671cb9-2521-560d-ad98-688930550de3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1381581,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1251/14461251/interior_rear_seats-1774603539530.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03671cb9-2521-560d-ad98-688930550de3/03671cb9-2521-560d-ad98-688930550de3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1607357,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1251/14461251/interior_dashboard-1774610952979.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03671cb9-2521-560d-ad98-688930550de3/03671cb9-2521-560d-ad98-688930550de3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1302849,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1251/14461251/interior_boot-1774692955699.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03671cb9-2521-560d-ad98-688930550de3/03671cb9-2521-560d-ad98-688930550de3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1938313,
'Height': 4000,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/1251/14461251/docs_service_history-1774692942791.jpg?ixlib=js-3.8.0&auto=format&s=6a249f19977a3bc1230ce0de855edde4',
'Width': 3000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03671cb9-2521-560d-ad98-688930550de3/03671cb9-2521-560d-ad98-688930550de3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416708,
'Height': 1602,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1251/14461251/wheels_front_driver-1774602421134.jpg',
'Width': 2136}],
'price': 16322,
'price_includes_vat': False,
'registration_date': '2021-06-30',
'seats_number': None,
'seller_name': None,
'title': 'Audi A3 S Line 40 TFSI E S-A',
'transmission': 'automatic',
'trim': 'S Line 40 TFSI E S-A',
'vin': 'WAUZZZGY7MA092699',
'year': 2021}
2026-03-29 20:15:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714461251%27 HTTP/1.1" 200 None
2026-03-29 20:15:41 [motorway.uk] INFO: Saving data for 14461251: {'created_time': 1774815341.005866, 'last_price_update_time': 1774815341.005879, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='14461251') HTTP/1.1" 204 0
2026-03-29 20:15:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9dd682f8-6a8c-5def-83d3-e7e073cae6be with identifier: 20479789
2026-03-29 20:15:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9dd682f8-6a8c-5def-83d3-e7e073cae6be with identifier: 20479789
2026-03-29 20:15:41 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9dd682f8-6a8c-5def-83d3-e7e073cae6be with identifier: 20479789 to the API
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/9789/20479789/interior_front_seats-1774688972322.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '9dd682f8-6a8c-5def-83d3-e7e073cae6be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'FN19 WPY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20479789',
'listing': 'auction',
'location': 'Herefordshire Hereford',
'make': 'Skoda',
'model': 'Superb',
'odometer': 43906,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd682f8-6a8c-5def-83d3-e7e073cae6be/9dd682f8-6a8c-5def-83d3-e7e073cae6be_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 920812,
'Height': 2256,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9789/20479789/exterior_front_driver-1774688229663.jpg',
'Width': 3008},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd682f8-6a8c-5def-83d3-e7e073cae6be/9dd682f8-6a8c-5def-83d3-e7e073cae6be_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1425814,
'Height': 2342,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9789/20479789/exterior_rear_driver-1774688237050.jpg',
'Width': 3123},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd682f8-6a8c-5def-83d3-e7e073cae6be/9dd682f8-6a8c-5def-83d3-e7e073cae6be_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1459365,
'Height': 2321,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9789/20479789/exterior_front_passenger-1774688242491.jpg',
'Width': 3094},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd682f8-6a8c-5def-83d3-e7e073cae6be/9dd682f8-6a8c-5def-83d3-e7e073cae6be_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1370331,
'Height': 2306,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9789/20479789/exterior_rear_passenger-1774688221384.jpg',
'Width': 3075},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd682f8-6a8c-5def-83d3-e7e073cae6be/9dd682f8-6a8c-5def-83d3-e7e073cae6be_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1711251,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9789/20479789/interior_front_seats-1774688972322.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd682f8-6a8c-5def-83d3-e7e073cae6be/9dd682f8-6a8c-5def-83d3-e7e073cae6be_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1476931,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9789/20479789/interior_rear_seats-1774688973916.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd682f8-6a8c-5def-83d3-e7e073cae6be/9dd682f8-6a8c-5def-83d3-e7e073cae6be_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2288272,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9789/20479789/interior_dashboard-1774688983065.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd682f8-6a8c-5def-83d3-e7e073cae6be/9dd682f8-6a8c-5def-83d3-e7e073cae6be_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 602398,
'Height': 1845,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9789/20479789/instrument_cluster-1774691006260.jpg',
'Width': 2460},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd682f8-6a8c-5def-83d3-e7e073cae6be/9dd682f8-6a8c-5def-83d3-e7e073cae6be_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 751757,
'Height': 1666,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9789/20479789/interior_boot-1774690472498.jpg',
'Width': 2222},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dd682f8-6a8c-5def-83d3-e7e073cae6be/9dd682f8-6a8c-5def-83d3-e7e073cae6be_image_9.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 1938206,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9789/20479789/docs_service_history-1774690073189.jpg?ixlib=js-3.8.0&auto=format&s=fca820aa30279d07be2d282852e8a3a9',
'Width': 2880}],
'price': 20543,
'price_includes_vat': False,
'registration_date': '2019-04-03',
'seats_number': None,
'seller_name': None,
'title': 'Skoda Superb Laurin &KLEM TSI 4',
'transmission': 'automatic',
'trim': 'Laurin &KLEM TSI 4',
'vin': 'TMBMP7NP6K7052044',
'year': 2019}
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720479789%27 HTTP/1.1" 200 None
2026-03-29 20:15:41 [motorway.uk] INFO: Saving data for 20479789: {'created_time': 1774815341.545072, 'last_price_update_time': 1774815341.545084, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20479789') HTTP/1.1" 204 0
2026-03-29 20:15:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 1111c056-716a-52c0-9a16-54165e019ccb with identifier: 20374311
2026-03-29 20:15:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 1111c056-716a-52c0-9a16-54165e019ccb with identifier: 20374311
2026-03-29 20:15:41 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 1111c056-716a-52c0-9a16-54165e019ccb with identifier: 20374311 to the API
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/4311/20374311/exterior_rear_driver-1774695930793.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '1111c056-716a-52c0-9a16-54165e019ccb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'DL65 AWX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20374311',
'listing': 'auction',
'location': 'Hampshire Farnborough',
'make': 'BMW',
'model': '4 Series',
'odometer': 81168,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1111c056-716a-52c0-9a16-54165e019ccb/1111c056-716a-52c0-9a16-54165e019ccb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1837408,
'Height': 2456,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4311/20374311/exterior_front_driver-1774695505963.jpg',
'Width': 3275},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1111c056-716a-52c0-9a16-54165e019ccb/1111c056-716a-52c0-9a16-54165e019ccb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1808946,
'Height': 2402,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4311/20374311/exterior_rear_driver-1774695930793.jpg',
'Width': 3203},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1111c056-716a-52c0-9a16-54165e019ccb/1111c056-716a-52c0-9a16-54165e019ccb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1806198,
'Height': 2346,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4311/20374311/exterior_front_passenger-1774695541026.jpg',
'Width': 3128},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1111c056-716a-52c0-9a16-54165e019ccb/1111c056-716a-52c0-9a16-54165e019ccb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1556771,
'Height': 2217,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4311/20374311/exterior_rear_passenger-1774695868664.jpg',
'Width': 2956},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1111c056-716a-52c0-9a16-54165e019ccb/1111c056-716a-52c0-9a16-54165e019ccb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3534813,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4311/20374311/interior_front_seats-1774694004253.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1111c056-716a-52c0-9a16-54165e019ccb/1111c056-716a-52c0-9a16-54165e019ccb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4420892,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4311/20374311/interior_rear_seats-1774693846989.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1111c056-716a-52c0-9a16-54165e019ccb/1111c056-716a-52c0-9a16-54165e019ccb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1823854,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4311/20374311/interior_dashboard-1774695562236.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1111c056-716a-52c0-9a16-54165e019ccb/1111c056-716a-52c0-9a16-54165e019ccb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2418739,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4311/20374311/instrument_cluster-1774693823026.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1111c056-716a-52c0-9a16-54165e019ccb/1111c056-716a-52c0-9a16-54165e019ccb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3126302,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4311/20374311/interior_boot-1774693954759.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1111c056-716a-52c0-9a16-54165e019ccb/1111c056-716a-52c0-9a16-54165e019ccb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 8950486,
'Height': 4284,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4311/20374311/docs_service_history-1774694098431.jpg?ixlib=js-3.8.0&auto=format&s=ec07355ba5f623e010a21a61d934ec9a',
'Width': 5712}],
'price': 7928,
'price_includes_vat': False,
'registration_date': '2015-11-30',
'seats_number': None,
'seller_name': None,
'title': 'BMW 420D M Sport',
'transmission': 'manual',
'trim': '420D M Sport',
'vin': 'WBA3U12020J965986',
'year': 2015}
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720374311%27 HTTP/1.1" 200 None
2026-03-29 20:15:41 [motorway.uk] INFO: Saving data for 20374311: {'created_time': 1774815341.964857, 'last_price_update_time': 1774815341.96487, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20374311') HTTP/1.1" 204 0
2026-03-29 20:15:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8816/20468816/exterior_front_driver-1774696513054.jpg> (referer: None)
2026-03-29 20:15:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1008&page=28&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9196/20289196/exterior_rear_driver-1774714787001.jpg> (referer: None)
2026-03-29 20:15:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9196/20289196/exterior_front_driver-1774714777125.jpg> (referer: None)
2026-03-29 20:15:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9196/20289196/exterior_front_passenger-1774714810016.jpg> (referer: None)
2026-03-29 20:15:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9196/20289196/exterior_rear_passenger-1774714793092.jpg> (referer: None)
2026-03-29 20:15:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9196/20289196/docs_service_history-1774718558882.jpg?ixlib=js-3.8.0&auto=format&s=9b07e8ce6c4dcce470973d33056f0c2d> (referer: None)
2026-03-29 20:15:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9196/20289196/interior_boot-1774715060907.jpg> (referer: None)
2026-03-29 20:15:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c30050>
2026-03-29 20:15:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3ab6001-7e65-50e4-afb0-6e937d41facf/a3ab6001-7e65-50e4-afb0-6e937d41facf_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8816%252F20468816%252Fexterior_front_driver-1774696513054.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8816/20468816/exterior_front_driver-1774696513054.jpg saved to cache
2026-03-29 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a3ab6001-7e65-50e4-afb0-6e937d41facf
2026-03-29 20:15:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3ab6001-7e65-50e4-afb0-6e937d41facf, skipping ID generation
2026-03-29 20:15:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3ab6001-7e65-50e4-afb0-6e937d41facf with scrape type 1
2026-03-29 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a3ab6001-7e65-50e4-afb0-6e937d41facf sending to next pipeline
2026-03-29 20:15:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a3ab6001-7e65-50e4-afb0-6e937d41facf, identifier: 20468816
2026-03-29 20:15:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a3ab6001-7e65-50e4-afb0-6e937d41facf with identifier: 20468816
2026-03-29 20:15:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a3ab6001-7e65-50e4-afb0-6e937d41facf with identifier: 20468816
2026-03-29 20:15:42 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a3ab6001-7e65-50e4-afb0-6e937d41facf with identifier: 20468816 to the API
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/8816/20468816/exterior_front_driver-1774696513054.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'a3ab6001-7e65-50e4-afb0-6e937d41facf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MV72 YXR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20468816',
'listing': 'auction',
'location': 'Derbyshire High Peak',
'make': 'Audi',
'model': 'S3',
'odometer': 19463,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ab6001-7e65-50e4-afb0-6e937d41facf/a3ab6001-7e65-50e4-afb0-6e937d41facf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2744541,
'Height': 2791,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8816/20468816/exterior_front_driver-1774696513054.jpg',
'Width': 3721},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ab6001-7e65-50e4-afb0-6e937d41facf/a3ab6001-7e65-50e4-afb0-6e937d41facf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2115893,
'Height': 3017,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8816/20468816/exterior_rear_driver-1774693967698.jpg',
'Width': 4022},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ab6001-7e65-50e4-afb0-6e937d41facf/a3ab6001-7e65-50e4-afb0-6e937d41facf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2426752,
'Height': 2788,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8816/20468816/exterior_front_passenger-1774694217051.jpg',
'Width': 3717},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ab6001-7e65-50e4-afb0-6e937d41facf/a3ab6001-7e65-50e4-afb0-6e937d41facf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2171130,
'Height': 3015,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8816/20468816/exterior_rear_passenger-1774693886152.jpg',
'Width': 4020},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ab6001-7e65-50e4-afb0-6e937d41facf/a3ab6001-7e65-50e4-afb0-6e937d41facf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3142530,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8816/20468816/interior_front_seats-1774694886907.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ab6001-7e65-50e4-afb0-6e937d41facf/a3ab6001-7e65-50e4-afb0-6e937d41facf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3434887,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8816/20468816/interior_rear_seats-1774694783671.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ab6001-7e65-50e4-afb0-6e937d41facf/a3ab6001-7e65-50e4-afb0-6e937d41facf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2532174,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8816/20468816/interior_dashboard-1774696597453.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ab6001-7e65-50e4-afb0-6e937d41facf/a3ab6001-7e65-50e4-afb0-6e937d41facf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3548106,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8816/20468816/interior_boot-1774694829859.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ab6001-7e65-50e4-afb0-6e937d41facf/a3ab6001-7e65-50e4-afb0-6e937d41facf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 521633,
'Height': 3067,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8816/20468816/docs_service_history-1774695448847.jpg?ixlib=js-3.8.0&auto=format&s=e614aa6f64c019c8ca1da79a3543f4ed',
'Width': 2175},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3ab6001-7e65-50e4-afb0-6e937d41facf/a3ab6001-7e65-50e4-afb0-6e937d41facf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 582070,
'Height': 3241,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8816/20468816/docs_service_history-1774695450575.jpg?ixlib=js-3.8.0&auto=format&s=a571d7e77d2af85e31c6e8bcc82dc3cc',
'Width': 2236}],
'price': 28494,
'price_includes_vat': False,
'registration_date': '2022-09-23',
'seats_number': None,
'seller_name': None,
'title': 'Audi S3 TFSI Quattro S-A',
'transmission': 'automatic',
'trim': 'TFSI Quattro S-A',
'vin': 'WAUZZZGY6PA012880',
'year': 2022}
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720468816%27 HTTP/1.1" 200 None
2026-03-29 20:15:42 [motorway.uk] INFO: Saving data for 20468816: {'created_time': 1774815342.678512, 'last_price_update_time': 1774815342.678522, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20468816') HTTP/1.1" 204 0
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 20304692
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 15783679
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 17667845
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 17291886
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 17331311
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 20377284
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 18264016
2026-03-29 20:15:42 [motorway.uk] INFO: Found listing with ID: 20486192
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486192%27 HTTP/1.1" 200 None
2026-03-29 20:15:42 [motorway.uk] INFO: Scrape type for 20486192: 1
2026-03-29 20:15:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658447d10>
2026-03-29 20:15:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fd63841-264c-56ac-8ef4-94dcf5ce832d/3fd63841-264c-56ac-8ef4-94dcf5ce832d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9196%252F20289196%252Fexterior_rear_driver-1774714787001.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9196/20289196/exterior_rear_driver-1774714787001.jpg saved to cache
2026-03-29 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3fd63841-264c-56ac-8ef4-94dcf5ce832d
2026-03-29 20:15:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a03310>
2026-03-29 20:15:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fd63841-264c-56ac-8ef4-94dcf5ce832d/3fd63841-264c-56ac-8ef4-94dcf5ce832d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9196%252F20289196%252Fexterior_front_driver-1774714777125.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9196/20289196/exterior_front_driver-1774714777125.jpg saved to cache
2026-03-29 20:15:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3fd63841-264c-56ac-8ef4-94dcf5ce832d
2026-03-29 20:15:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c9c250>
2026-03-29 20:15:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fd63841-264c-56ac-8ef4-94dcf5ce832d/3fd63841-264c-56ac-8ef4-94dcf5ce832d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9196%252F20289196%252Fexterior_front_passenger-1774714810016.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9196/20289196/exterior_front_passenger-1774714810016.jpg saved to cache
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3fd63841-264c-56ac-8ef4-94dcf5ce832d
2026-03-29 20:15:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658379c90>
2026-03-29 20:15:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fd63841-264c-56ac-8ef4-94dcf5ce832d/3fd63841-264c-56ac-8ef4-94dcf5ce832d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9196%252F20289196%252Fexterior_rear_passenger-1774714793092.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9196/20289196/exterior_rear_passenger-1774714793092.jpg saved to cache
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3fd63841-264c-56ac-8ef4-94dcf5ce832d
2026-03-29 20:15:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c9da50>
2026-03-29 20:15:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fd63841-264c-56ac-8ef4-94dcf5ce832d/3fd63841-264c-56ac-8ef4-94dcf5ce832d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9196%252F20289196%252Fdocs_service_history-1774718558882.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9b07e8ce6c4dcce470973d33056f0c2d') HTTP/1.1" 204 0
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9196/20289196/docs_service_history-1774718558882.jpg?ixlib=js-3.8.0&auto=format&s=9b07e8ce6c4dcce470973d33056f0c2d saved to cache
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3fd63841-264c-56ac-8ef4-94dcf5ce832d
2026-03-29 20:15:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf18b90>
2026-03-29 20:15:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fd63841-264c-56ac-8ef4-94dcf5ce832d/3fd63841-264c-56ac-8ef4-94dcf5ce832d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9196%252F20289196%252Finterior_boot-1774715060907.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9196/20289196/interior_boot-1774715060907.jpg saved to cache
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3fd63841-264c-56ac-8ef4-94dcf5ce832d
2026-03-29 20:15:43 [motorway.uk] INFO: Found listing with ID: 20489798
2026-03-29 20:15:43 [motorway.uk] INFO: Found listing with ID: 18016902
2026-03-29 20:15:43 [motorway.uk] INFO: Found listing with ID: 20194798
2026-03-29 20:15:43 [motorway.uk] INFO: Found listing with ID: 19772114
2026-03-29 20:15:43 [motorway.uk] INFO: Found listing with ID: 20365288
2026-03-29 20:15:43 [motorway.uk] INFO: Found listing with ID: 19121650
2026-03-29 20:15:43 [motorway.uk] INFO: Found listing with ID: 13570427
2026-03-29 20:15:43 [motorway.uk] INFO: Found listing with ID: 13327562
2026-03-29 20:15:43 [motorway.uk] INFO: Found listing with ID: 17966792
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717966792%27 HTTP/1.1" 200 None
2026-03-29 20:15:43 [motorway.uk] INFO: Scrape type for 17966792: 1
2026-03-29 20:15:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20149199.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:43 [motorway.uk] INFO: Found listing with ID: 20229861
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720229861%27 HTTP/1.1" 200 None
2026-03-29 20:15:43 [motorway.uk] INFO: Scrape type for 20229861: 1
2026-03-29 20:15:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:43 [motorway.uk] INFO: Found listing with ID: 20471278
2026-03-29 20:15:43 [motorway.uk] INFO: Found listing with ID: 20454392
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720454392%27 HTTP/1.1" 200 None
2026-03-29 20:15:43 [motorway.uk] INFO: Scrape type for 20454392: 1
2026-03-29 20:15:43 [motorway.uk] INFO: Found listing with ID: 20165611
2026-03-29 20:15:43 [motorway.uk] INFO: Found listing with ID: 19472539
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719472539%27 HTTP/1.1" 200 None
2026-03-29 20:15:43 [motorway.uk] INFO: Scrape type for 19472539: 1
2026-03-29 20:15:43 [motorway.uk] INFO: Found listing with ID: 20422592
2026-03-29 20:15:43 [motorway.uk] INFO: Found listing with ID: 20385998
2026-03-29 20:15:43 [motorway.uk] INFO: Found listing with ID: 16437364
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716437364%27 HTTP/1.1" 200 None
2026-03-29 20:15:43 [motorway.uk] INFO: Scrape type for 16437364: 1
2026-03-29 20:15:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9773/15549773/15549773-interior_front_seats-default-1774614835617.jpg> (referer: None)
2026-03-29 20:15:43 [motorway.uk] INFO: Found listing with ID: 20369773
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720369773%27 HTTP/1.1" 200 None
2026-03-29 20:15:43 [motorway.uk] INFO: Scrape type for 20369773: 1
2026-03-29 20:15:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:43 [motorway.uk] INFO: Found listing with ID: 18202599
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718202599%27 HTTP/1.1" 200 None
2026-03-29 20:15:43 [motorway.uk] INFO: Scrape type for 18202599: 1
2026-03-29 20:15:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81a3f3bd-a725-5a40-9544-46100ee95827 with identifier: 20149199
2026-03-29 20:15:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81a3f3bd-a725-5a40-9544-46100ee95827 with scrape type 1
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 81a3f3bd-a725-5a40-9544-46100ee95827
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9199%252F20149199%252Fexterior_front_driver-1773079113937.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9199/20149199/exterior_front_driver-1773079113937.jpg not downloaded yet
2026-03-29 20:15:43 [motorway.uk] INFO: Found listing with ID: 20493993
2026-03-29 20:15:43 [motorway.uk] INFO: Found listing with ID: 9310356
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279310356%27 HTTP/1.1" 200 None
2026-03-29 20:15:43 [motorway.uk] INFO: Scrape type for 9310356: 1
2026-03-29 20:15:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9196/20289196/interior_dashboard-1774715044687.jpg> (referer: None)
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9199%252F20149199%252Fexterior_rear_driver-1773079129645.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9199/20149199/exterior_rear_driver-1773079129645.jpg not downloaded yet
2026-03-29 20:15:43 [motorway.uk] INFO: Found listing with ID: 20226525
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720226525%27 HTTP/1.1" 200 None
2026-03-29 20:15:43 [motorway.uk] INFO: Scrape type for 20226525: 1
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9199%252F20149199%252Fexterior_front_passenger-1773079154185.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9199/20149199/exterior_front_passenger-1773079154185.jpg not downloaded yet
2026-03-29 20:15:43 [motorway.uk] INFO: Found listing with ID: 3894223
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273894223%27 HTTP/1.1" 200 None
2026-03-29 20:15:43 [motorway.uk] INFO: Scrape type for 3894223: 0
2026-03-29 20:15:43 [motorway.uk] INFO: Found listing with ID: 9990352
2026-03-29 20:15:43 [motorway.uk] INFO: Found listing with ID: 19838996
2026-03-29 20:15:43 [motorway.uk] INFO: Found listing with ID: 13722608
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713722608%27 HTTP/1.1" 200 None
2026-03-29 20:15:43 [motorway.uk] INFO: Scrape type for 13722608: 1
2026-03-29 20:15:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b481d0>
2026-03-29 20:15:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ec0514-12f4-5e33-9320-8c123503b733/e1ec0514-12f4-5e33-9320-8c123503b733_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9773%252F15549773%252F15549773-interior_front_seats-default-1774614835617.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9773/15549773/15549773-interior_front_seats-default-1774614835617.jpg saved to cache
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e1ec0514-12f4-5e33-9320-8c123503b733
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9199%252F20149199%252Fexterior_rear_passenger-1773079142020.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9199/20149199/exterior_rear_passenger-1773079142020.jpg not downloaded yet
2026-03-29 20:15:44 [motorway.uk] INFO: Found listing with ID: 20486496
2026-03-29 20:15:44 [motorway.uk] INFO: Found listing with ID: 20043212
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9199%252F20149199%252Finterior_front_seats-1774701538783.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9199/20149199/interior_front_seats-1774701538783.jpg not downloaded yet
2026-03-29 20:15:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9196/20289196/instrument_cluster-1774715076069.jpg> (referer: None)
2026-03-29 20:15:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8331/19288331/interior_boot-1774701032024.jpg> (referer: None)
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9199%252F20149199%252Finterior_rear_seats-1774701553900.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9199/20149199/interior_rear_seats-1774701553900.jpg not downloaded yet
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587c11d0>
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fd63841-264c-56ac-8ef4-94dcf5ce832d/3fd63841-264c-56ac-8ef4-94dcf5ce832d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9196%252F20289196%252Finterior_dashboard-1774715044687.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9196/20289196/interior_dashboard-1774715044687.jpg saved to cache
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3fd63841-264c-56ac-8ef4-94dcf5ce832d
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9199%252F20149199%252Finterior_dashboard-1774701588039.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9199/20149199/interior_dashboard-1774701588039.jpg not downloaded yet
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9199%252F20149199%252Finstrument_cluster-1774701657235.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9199/20149199/instrument_cluster-1774701657235.jpg not downloaded yet
2026-03-29 20:15:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f25f50>
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fd63841-264c-56ac-8ef4-94dcf5ce832d/3fd63841-264c-56ac-8ef4-94dcf5ce832d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9196%252F20289196%252Finstrument_cluster-1774715076069.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9196/20289196/instrument_cluster-1774715076069.jpg saved to cache
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3fd63841-264c-56ac-8ef4-94dcf5ce832d
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599d9d90>
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69703630-8ae1-5a70-b157-fbd013ce258a/69703630-8ae1-5a70-b157-fbd013ce258a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8331%252F19288331%252Finterior_boot-1774701032024.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8331/19288331/interior_boot-1774701032024.jpg saved to cache
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 69703630-8ae1-5a70-b157-fbd013ce258a
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9199%252F20149199%252Finterior_boot-1774701603714.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9199/20149199/interior_boot-1774701603714.jpg not downloaded yet
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9199%252F20149199%252Fdocs_service_history-1774701834639.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D82f61a4096bbdfe2e370d690f88dd290%27 HTTP/1.1" 200 None
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9199/20149199/docs_service_history-1774701834639.jpg?ixlib=js-3.8.0&auto=format&s=82f61a4096bbdfe2e370d690f88dd290 not downloaded yet
2026-03-29 20:15:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8488/16868488/exterior_rear_passenger-1774715004003.jpg> (referer: None)
2026-03-29 20:15:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3529/13753529/interior_rear_seats-1774630547944.jpg> (referer: None)
2026-03-29 20:15:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9196/20289196/interior_rear_seats-1774715003423.jpg> (referer: None)
2026-03-29 20:15:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8488/16868488/interior_front_seats-1774715469056.jpg> (referer: None)
2026-03-29 20:15:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3529/13753529/exterior_rear_passenger-1774631199694.jpg> (referer: None)
2026-03-29 20:15:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8331/19288331/interior_dashboard-1774701180053.jpg> (referer: None)
2026-03-29 20:15:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9199/20149199/exterior_front_driver-1773079113937.jpg> (referer: None)
2026-03-29 20:15:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9196/20289196/interior_front_seats-1774714978981.jpg> (referer: None)
2026-03-29 20:15:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3529/13753529/interior_front_seats-1774630532492.jpg> (referer: None)
2026-03-29 20:15:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8331/19288331/interior_rear_seats-1774700463299.jpg> (referer: None)
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599daf90>
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87090821-ad15-57c6-a877-d4bdb258a2f0/87090821-ad15-57c6-a877-d4bdb258a2f0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8488%252F16868488%252Fexterior_rear_passenger-1774715004003.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8488/16868488/exterior_rear_passenger-1774715004003.jpg saved to cache
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 87090821-ad15-57c6-a877-d4bdb258a2f0
2026-03-29 20:15:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfd4090>
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28040276-8ab4-51fc-b135-c3c9ad692553/28040276-8ab4-51fc-b135-c3c9ad692553_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3529%252F13753529%252Finterior_rear_seats-1774630547944.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3529/13753529/interior_rear_seats-1774630547944.jpg saved to cache
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 28040276-8ab4-51fc-b135-c3c9ad692553
2026-03-29 20:15:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599e1190>
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fd63841-264c-56ac-8ef4-94dcf5ce832d/3fd63841-264c-56ac-8ef4-94dcf5ce832d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9196%252F20289196%252Finterior_rear_seats-1774715003423.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9196/20289196/interior_rear_seats-1774715003423.jpg saved to cache
2026-03-29 20:15:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3fd63841-264c-56ac-8ef4-94dcf5ce832d
2026-03-29 20:15:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658475990>
2026-03-29 20:15:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87090821-ad15-57c6-a877-d4bdb258a2f0/87090821-ad15-57c6-a877-d4bdb258a2f0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8488%252F16868488%252Finterior_front_seats-1774715469056.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8488/16868488/interior_front_seats-1774715469056.jpg saved to cache
2026-03-29 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 87090821-ad15-57c6-a877-d4bdb258a2f0
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6588b1b50>
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28040276-8ab4-51fc-b135-c3c9ad692553/28040276-8ab4-51fc-b135-c3c9ad692553_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3529%252F13753529%252Fexterior_rear_passenger-1774631199694.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3529/13753529/exterior_rear_passenger-1774631199694.jpg saved to cache
2026-03-29 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 28040276-8ab4-51fc-b135-c3c9ad692553
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfd6410>
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69703630-8ae1-5a70-b157-fbd013ce258a/69703630-8ae1-5a70-b157-fbd013ce258a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8331%252F19288331%252Finterior_dashboard-1774701180053.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8331/19288331/interior_dashboard-1774701180053.jpg saved to cache
2026-03-29 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 69703630-8ae1-5a70-b157-fbd013ce258a
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6588b2790>
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a3f3bd-a725-5a40-9544-46100ee95827/81a3f3bd-a725-5a40-9544-46100ee95827_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9199%252F20149199%252Fexterior_front_driver-1773079113937.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9199/20149199/exterior_front_driver-1773079113937.jpg saved to cache
2026-03-29 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 81a3f3bd-a725-5a40-9544-46100ee95827
2026-03-29 20:15:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658474750>
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fd63841-264c-56ac-8ef4-94dcf5ce832d/3fd63841-264c-56ac-8ef4-94dcf5ce832d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9196%252F20289196%252Finterior_front_seats-1774714978981.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9196/20289196/interior_front_seats-1774714978981.jpg saved to cache
2026-03-29 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3fd63841-264c-56ac-8ef4-94dcf5ce832d
2026-03-29 20:15:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3fd63841-264c-56ac-8ef4-94dcf5ce832d, skipping ID generation
2026-03-29 20:15:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fd63841-264c-56ac-8ef4-94dcf5ce832d with scrape type 1
2026-03-29 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3fd63841-264c-56ac-8ef4-94dcf5ce832d sending to next pipeline
2026-03-29 20:15:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 3fd63841-264c-56ac-8ef4-94dcf5ce832d, identifier: 20289196
2026-03-29 20:15:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a849d0>
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28040276-8ab4-51fc-b135-c3c9ad692553/28040276-8ab4-51fc-b135-c3c9ad692553_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3529%252F13753529%252Finterior_front_seats-1774630532492.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3529/13753529/interior_front_seats-1774630532492.jpg saved to cache
2026-03-29 20:15:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 28040276-8ab4-51fc-b135-c3c9ad692553
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599d8f10>
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69703630-8ae1-5a70-b157-fbd013ce258a/69703630-8ae1-5a70-b157-fbd013ce258a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8331%252F19288331%252Finterior_rear_seats-1774700463299.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8331/19288331/interior_rear_seats-1774700463299.jpg saved to cache
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 69703630-8ae1-5a70-b157-fbd013ce258a
2026-03-29 20:15:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 3fd63841-264c-56ac-8ef4-94dcf5ce832d with identifier: 20289196
2026-03-29 20:15:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 3fd63841-264c-56ac-8ef4-94dcf5ce832d with identifier: 20289196
2026-03-29 20:15:46 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 3fd63841-264c-56ac-8ef4-94dcf5ce832d with identifier: 20289196 to the API
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/9196/20289196/interior_front_seats-1774714978981.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '3fd63841-264c-56ac-8ef4-94dcf5ce832d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WP70 MVA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20289196',
'listing': 'auction',
'location': 'Merseyside Liverpool',
'make': 'Mercedes',
'model': 'A Class',
'odometer': 52000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd63841-264c-56ac-8ef4-94dcf5ce832d/3fd63841-264c-56ac-8ef4-94dcf5ce832d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 825799,
'Height': 1848,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9196/20289196/exterior_front_driver-1774714777125.jpg',
'Width': 2464},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd63841-264c-56ac-8ef4-94dcf5ce832d/3fd63841-264c-56ac-8ef4-94dcf5ce832d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1061423,
'Height': 2007,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9196/20289196/exterior_rear_driver-1774714787001.jpg',
'Width': 2676},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd63841-264c-56ac-8ef4-94dcf5ce832d/3fd63841-264c-56ac-8ef4-94dcf5ce832d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1349219,
'Height': 1980,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9196/20289196/exterior_front_passenger-1774714810016.jpg',
'Width': 2640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd63841-264c-56ac-8ef4-94dcf5ce832d/3fd63841-264c-56ac-8ef4-94dcf5ce832d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 897853,
'Height': 1769,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9196/20289196/exterior_rear_passenger-1774714793092.jpg',
'Width': 2359},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd63841-264c-56ac-8ef4-94dcf5ce832d/3fd63841-264c-56ac-8ef4-94dcf5ce832d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4073583,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9196/20289196/interior_front_seats-1774714978981.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd63841-264c-56ac-8ef4-94dcf5ce832d/3fd63841-264c-56ac-8ef4-94dcf5ce832d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3642712,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9196/20289196/interior_rear_seats-1774715003423.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd63841-264c-56ac-8ef4-94dcf5ce832d/3fd63841-264c-56ac-8ef4-94dcf5ce832d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1315246,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9196/20289196/interior_dashboard-1774715044687.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd63841-264c-56ac-8ef4-94dcf5ce832d/3fd63841-264c-56ac-8ef4-94dcf5ce832d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1801624,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9196/20289196/instrument_cluster-1774715076069.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd63841-264c-56ac-8ef4-94dcf5ce832d/3fd63841-264c-56ac-8ef4-94dcf5ce832d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3307574,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9196/20289196/interior_boot-1774715060907.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fd63841-264c-56ac-8ef4-94dcf5ce832d/3fd63841-264c-56ac-8ef4-94dcf5ce832d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2702573,
'Height': 3132,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9196/20289196/docs_service_history-1774718558882.jpg?ixlib=js-3.8.0&auto=format&s=9b07e8ce6c4dcce470973d33056f0c2d',
'Width': 2145}],
'price': 14401,
'price_includes_vat': False,
'registration_date': '2020-11-30',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes A 250 AMG Line Premium E Auto',
'transmission': 'automatic',
'trim': 'A 250 AMG Line Premium E Auto',
'vin': 'W1K1771862J278570',
'year': 2020}
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720289196%27 HTTP/1.1" 200 None
2026-03-29 20:15:46 [motorway.uk] INFO: Saving data for 20289196: {'created_time': 1774815346.578235, 'last_price_update_time': 1774815346.578248, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20289196') HTTP/1.1" 204 0
2026-03-29 20:15:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9199/20149199/docs_service_history-1774701834639.jpg?ixlib=js-3.8.0&auto=format&s=82f61a4096bbdfe2e370d690f88dd290> (referer: None)
2026-03-29 20:15:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9199/20149199/interior_rear_seats-1774701553900.jpg> (referer: None)
2026-03-29 20:15:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9199/20149199/interior_boot-1774701603714.jpg> (referer: None)
2026-03-29 20:15:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9199/20149199/interior_front_seats-1774701538783.jpg> (referer: None)
2026-03-29 20:15:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c52890>
2026-03-29 20:15:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a3f3bd-a725-5a40-9544-46100ee95827/81a3f3bd-a725-5a40-9544-46100ee95827_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9199%252F20149199%252Fdocs_service_history-1774701834639.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D82f61a4096bbdfe2e370d690f88dd290') HTTP/1.1" 204 0
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9199/20149199/docs_service_history-1774701834639.jpg?ixlib=js-3.8.0&auto=format&s=82f61a4096bbdfe2e370d690f88dd290 saved to cache
2026-03-29 20:15:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 81a3f3bd-a725-5a40-9544-46100ee95827
2026-03-29 20:15:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cd4190>
2026-03-29 20:15:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a3f3bd-a725-5a40-9544-46100ee95827/81a3f3bd-a725-5a40-9544-46100ee95827_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9199%252F20149199%252Finterior_rear_seats-1774701553900.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9199/20149199/interior_rear_seats-1774701553900.jpg saved to cache
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 81a3f3bd-a725-5a40-9544-46100ee95827
2026-03-29 20:15:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20486192.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17966792.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/8144237.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598be110>
2026-03-29 20:15:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a3f3bd-a725-5a40-9544-46100ee95827/81a3f3bd-a725-5a40-9544-46100ee95827_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9199%252F20149199%252Finterior_boot-1774701603714.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9199/20149199/interior_boot-1774701603714.jpg saved to cache
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 81a3f3bd-a725-5a40-9544-46100ee95827
2026-03-29 20:15:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583816d0>
2026-03-29 20:15:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a3f3bd-a725-5a40-9544-46100ee95827/81a3f3bd-a725-5a40-9544-46100ee95827_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9199%252F20149199%252Finterior_front_seats-1774701538783.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9199/20149199/interior_front_seats-1774701538783.jpg saved to cache
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 81a3f3bd-a725-5a40-9544-46100ee95827
2026-03-29 20:15:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f7b3332-c9a8-5982-9632-785e0dcac931 with identifier: 20486192
2026-03-29 20:15:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f7b3332-c9a8-5982-9632-785e0dcac931 with scrape type 1
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9f7b3332-c9a8-5982-9632-785e0dcac931
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6192%252F20486192%252Fexterior_front_driver-1774697277492.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6192/20486192/exterior_front_driver-1774697277492.jpg not downloaded yet
2026-03-29 20:15:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4251d20-b9ec-570e-aeee-dadc7561c84a with identifier: 17966792
2026-03-29 20:15:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4251d20-b9ec-570e-aeee-dadc7561c84a with scrape type 1
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e4251d20-b9ec-570e-aeee-dadc7561c84a
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6792%252F17966792%252Fexterior_front_driver-1774690630688.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6792/17966792/exterior_front_driver-1774690630688.jpg not downloaded yet
2026-03-29 20:15:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ea0d116-d5cf-5a09-907b-719d4a484442 with identifier: 8144237
2026-03-29 20:15:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ea0d116-d5cf-5a09-907b-719d4a484442 with scrape type 2
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ea0d116-d5cf-5a09-907b-719d4a484442 with scrape type 2
2026-03-29 20:15:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8ea0d116-d5cf-5a09-907b-719d4a484442, identifier: 8144237
2026-03-29 20:15:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8ea0d116-d5cf-5a09-907b-719d4a484442 with identifier: 8144237
2026-03-29 20:15:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8ea0d116-d5cf-5a09-907b-719d4a484442 with identifier: 8144237
2026-03-29 20:15:47 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8ea0d116-d5cf-5a09-907b-719d4a484442 with identifier: 8144237 to the API
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/8144237.json>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '8ea0d116-d5cf-5a09-907b-719d4a484442',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FP71 TXV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/8144237',
'listing': 'auction',
'location': 'Merseyside Saint Helens',
'make': 'Toyota',
'model': 'Corolla',
'odometer': 35000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 16500,
'price_includes_vat': False,
'registration_date': '2022-01-07',
'seats_number': None,
'seller_name': None,
'title': 'Toyota Corolla GR Sport HEV CVT',
'transmission': 'automatic',
'trim': 'GR Sport HEV CVT',
'vin': 'SB1K53BE70E090808',
'year': 2022}
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278144237%27 HTTP/1.1" 200 None
2026-03-29 20:15:47 [motorway.uk] INFO: Saving data for 8144237: {'auction_closing_time': 1774884600.0, 'created_time': 1774643402.041508, 'last_price_update_time': 1774815347.899027}
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='8144237') HTTP/1.1" 204 0
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6192%252F20486192%252Fexterior_rear_driver-1774697279375.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6192/20486192/exterior_rear_driver-1774697279375.jpg not downloaded yet
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6792%252F17966792%252Fexterior_rear_driver-1774690643140.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6792/17966792/exterior_rear_driver-1774690643140.jpg not downloaded yet
2026-03-29 20:15:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16437364.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6192%252F20486192%252Fexterior_front_passenger-1774697279651.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6192/20486192/exterior_front_passenger-1774697279651.jpg not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6792%252F17966792%252Fexterior_front_passenger-1774690674336.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6792/17966792/exterior_front_passenger-1774690674336.jpg not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6192%252F20486192%252Fexterior_rear_passenger-1774697276104.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6192/20486192/exterior_rear_passenger-1774697276104.jpg not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6792%252F17966792%252Fexterior_rear_passenger-1774690660241.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6792/17966792/exterior_rear_passenger-1774690660241.jpg not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6192%252F20486192%252Finterior_front_seats-1774698448144.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6192/20486192/interior_front_seats-1774698448144.jpg not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6792%252F17966792%252Finterior_front_seats-1774701318659.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6792/17966792/interior_front_seats-1774701318659.jpg not downloaded yet
2026-03-29 20:15:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9773/15549773/15549773-exterior_front_passenger-default-1774614785309.jpg> (referer: None)
2026-03-29 20:15:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4928ea38-b3ec-5bec-8391-277fe036f4c0 with identifier: 16437364
2026-03-29 20:15:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4928ea38-b3ec-5bec-8391-277fe036f4c0 with scrape type 1
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4928ea38-b3ec-5bec-8391-277fe036f4c0
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7364%252F16437364%252Fexterior_front_driver-1773577376967.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7364/16437364/exterior_front_driver-1773577376967.jpg already downloaded
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7364%252F16437364%252Fexterior_rear_driver-1773577392093.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7364/16437364/exterior_rear_driver-1773577392093.jpg already downloaded
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7364%252F16437364%252Fexterior_front_passenger-1773577414316.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7364/16437364/exterior_front_passenger-1773577414316.jpg already downloaded
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7364%252F16437364%252Fexterior_rear_passenger-1773577390871.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7364/16437364/exterior_rear_passenger-1773577390871.jpg already downloaded
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7364%252F16437364%252Finterior_front_seats-1773577837674.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7364/16437364/interior_front_seats-1773577837674.jpg not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6192%252F20486192%252Finterior_rear_seats-1774698445486.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6192/20486192/interior_rear_seats-1774698445486.jpg not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6792%252F17966792%252Finterior_rear_seats-1774691979273.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6792/17966792/interior_rear_seats-1774691979273.jpg not downloaded yet
2026-03-29 20:15:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9199/20149199/exterior_rear_driver-1773079129645.jpg> (referer: None)
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7364%252F16437364%252Finterior_rear_seats-1773577851322.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7364/16437364/interior_rear_seats-1773577851322.jpg not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6192%252F20486192%252Finterior_dashboard-1774698453883.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6192/20486192/interior_dashboard-1774698453883.jpg not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6792%252F17966792%252Finterior_dashboard-1774701369308.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6792/17966792/interior_dashboard-1774701369308.jpg not downloaded yet
2026-03-29 20:15:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587a48d0>
2026-03-29 20:15:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ec0514-12f4-5e33-9320-8c123503b733/e1ec0514-12f4-5e33-9320-8c123503b733_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9773%252F15549773%252F15549773-exterior_front_passenger-default-1774614785309.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9773/15549773/15549773-exterior_front_passenger-default-1774614785309.jpg saved to cache
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e1ec0514-12f4-5e33-9320-8c123503b733
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7364%252F16437364%252Finterior_dashboard-1773577869768.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7364/16437364/interior_dashboard-1773577869768.jpg already downloaded
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7364%252F16437364%252Finstrument_cluster-1773577935164.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7364/16437364/instrument_cluster-1773577935164.jpg already downloaded
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7364%252F16437364%252Finterior_boot-1773577952094.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7364/16437364/interior_boot-1773577952094.jpg not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6192%252F20486192%252Finterior_boot-1774698446440.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6192/20486192/interior_boot-1774698446440.jpg not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6792%252F17966792%252Finstrument_cluster-1774692026764.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6792/17966792/instrument_cluster-1774692026764.jpg not downloaded yet
2026-03-29 20:15:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9199/20149199/exterior_front_passenger-1773079154185.jpg> (referer: None)
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7364%252F16437364%252Fdocs_service_history-1773578596857.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2d655c0e3f852fc9f1283abe84fda5b1%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7364/16437364/docs_service_history-1773578596857.jpg?ixlib=js-3.8.0&auto=format&s=2d655c0e3f852fc9f1283abe84fda5b1 not downloaded yet
2026-03-29 20:15:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658552a90>
2026-03-29 20:15:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a3f3bd-a725-5a40-9544-46100ee95827/81a3f3bd-a725-5a40-9544-46100ee95827_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9199%252F20149199%252Fexterior_rear_driver-1773079129645.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9199/20149199/exterior_rear_driver-1773079129645.jpg saved to cache
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 81a3f3bd-a725-5a40-9544-46100ee95827
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6192%252F20486192%252Fdocs_service_history-1774698687145.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D61b50f39cf8546c8e1a9f6dcc2fa5a0e%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6192/20486192/docs_service_history-1774698687145.jpg?ixlib=js-3.8.0&auto=format&s=61b50f39cf8546c8e1a9f6dcc2fa5a0e not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6792%252F17966792%252Finterior_boot-1774701369835.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6792/17966792/interior_boot-1774701369835.jpg not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6192%252F20486192%252Fdocs_service_history-1774703148462.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D434e6bf1618fce2444a6444ff6a6fb0e%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6192/20486192/docs_service_history-1774703148462.jpg?ixlib=js-3.8.0&auto=format&s=434e6bf1618fce2444a6444ff6a6fb0e not downloaded yet
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6792%252F17966792%252Fdocs_service_history-1774692686155.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D267f1768edf0b6f454418aa8d8572528%27 HTTP/1.1" 200 None
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6792/17966792/docs_service_history-1774692686155.jpg?ixlib=js-3.8.0&auto=format&s=267f1768edf0b6f454418aa8d8572528 not downloaded yet
2026-03-29 20:15:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e5c810>
2026-03-29 20:15:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a3f3bd-a725-5a40-9544-46100ee95827/81a3f3bd-a725-5a40-9544-46100ee95827_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9199%252F20149199%252Fexterior_front_passenger-1773079154185.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9199/20149199/exterior_front_passenger-1773079154185.jpg saved to cache
2026-03-29 20:15:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 81a3f3bd-a725-5a40-9544-46100ee95827
2026-03-29 20:15:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9199/20149199/exterior_rear_passenger-1773079142020.jpg> (referer: None)
2026-03-29 20:15:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9199/20149199/interior_dashboard-1774701588039.jpg> (referer: None)
2026-03-29 20:15:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6792/17966792/exterior_front_driver-1774690630688.jpg> (referer: None)
2026-03-29 20:15:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9199/20149199/instrument_cluster-1774701657235.jpg> (referer: None)
2026-03-29 20:15:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6792/17966792/exterior_rear_passenger-1774690660241.jpg> (referer: None)
2026-03-29 20:15:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658edd810>
2026-03-29 20:15:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a3f3bd-a725-5a40-9544-46100ee95827/81a3f3bd-a725-5a40-9544-46100ee95827_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9199%252F20149199%252Fexterior_rear_passenger-1773079142020.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9199/20149199/exterior_rear_passenger-1773079142020.jpg saved to cache
2026-03-29 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 81a3f3bd-a725-5a40-9544-46100ee95827
2026-03-29 20:15:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1044&page=29&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6792/17966792/interior_rear_seats-1774691979273.jpg> (referer: None)
2026-03-29 20:15:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589c7bd0>
2026-03-29 20:15:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a3f3bd-a725-5a40-9544-46100ee95827/81a3f3bd-a725-5a40-9544-46100ee95827_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9199%252F20149199%252Finterior_dashboard-1774701588039.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9199/20149199/interior_dashboard-1774701588039.jpg saved to cache
2026-03-29 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 81a3f3bd-a725-5a40-9544-46100ee95827
2026-03-29 20:15:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659afa750>
2026-03-29 20:15:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4251d20-b9ec-570e-aeee-dadc7561c84a/e4251d20-b9ec-570e-aeee-dadc7561c84a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6792%252F17966792%252Fexterior_front_driver-1774690630688.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6792/17966792/exterior_front_driver-1774690630688.jpg saved to cache
2026-03-29 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4251d20-b9ec-570e-aeee-dadc7561c84a
2026-03-29 20:15:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584913d0>
2026-03-29 20:15:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a3f3bd-a725-5a40-9544-46100ee95827/81a3f3bd-a725-5a40-9544-46100ee95827_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9199%252F20149199%252Finstrument_cluster-1774701657235.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9199/20149199/instrument_cluster-1774701657235.jpg saved to cache
2026-03-29 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 81a3f3bd-a725-5a40-9544-46100ee95827
2026-03-29 20:15:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 81a3f3bd-a725-5a40-9544-46100ee95827, skipping ID generation
2026-03-29 20:15:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81a3f3bd-a725-5a40-9544-46100ee95827 with scrape type 1
2026-03-29 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 81a3f3bd-a725-5a40-9544-46100ee95827 sending to next pipeline
2026-03-29 20:15:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 81a3f3bd-a725-5a40-9544-46100ee95827, identifier: 20149199
2026-03-29 20:15:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf30950>
2026-03-29 20:15:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4251d20-b9ec-570e-aeee-dadc7561c84a/e4251d20-b9ec-570e-aeee-dadc7561c84a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6792%252F17966792%252Fexterior_rear_passenger-1774690660241.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6792/17966792/exterior_rear_passenger-1774690660241.jpg saved to cache
2026-03-29 20:15:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e4251d20-b9ec-570e-aeee-dadc7561c84a
2026-03-29 20:15:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 81a3f3bd-a725-5a40-9544-46100ee95827 with identifier: 20149199
2026-03-29 20:15:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 81a3f3bd-a725-5a40-9544-46100ee95827 with identifier: 20149199
2026-03-29 20:15:49 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 81a3f3bd-a725-5a40-9544-46100ee95827 with identifier: 20149199 to the API
2026-03-29 20:15:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9199/20149199/instrument_cluster-1774701657235.jpg>
{'auction_title': '',
'category': None,
'color': 'Green',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '81a3f3bd-a725-5a40-9544-46100ee95827',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SO24 VKU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20149199',
'listing': 'auction',
'location': 'Greater Manchester Wigan',
'make': 'Dacia',
'model': 'Duster',
'odometer': 21778,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a3f3bd-a725-5a40-9544-46100ee95827/81a3f3bd-a725-5a40-9544-46100ee95827_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1928768,
'Height': 2916,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9199/20149199/exterior_front_driver-1773079113937.jpg',
'Width': 3888},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a3f3bd-a725-5a40-9544-46100ee95827/81a3f3bd-a725-5a40-9544-46100ee95827_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1189132,
'Height': 2576,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9199/20149199/exterior_rear_driver-1773079129645.jpg',
'Width': 3435},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a3f3bd-a725-5a40-9544-46100ee95827/81a3f3bd-a725-5a40-9544-46100ee95827_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1469494,
'Height': 2560,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9199/20149199/exterior_front_passenger-1773079154185.jpg',
'Width': 3413},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a3f3bd-a725-5a40-9544-46100ee95827/81a3f3bd-a725-5a40-9544-46100ee95827_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1379455,
'Height': 2511,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9199/20149199/exterior_rear_passenger-1773079142020.jpg',
'Width': 3348},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a3f3bd-a725-5a40-9544-46100ee95827/81a3f3bd-a725-5a40-9544-46100ee95827_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3577921,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9199/20149199/interior_front_seats-1774701538783.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a3f3bd-a725-5a40-9544-46100ee95827/81a3f3bd-a725-5a40-9544-46100ee95827_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3215597,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9199/20149199/interior_rear_seats-1774701553900.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a3f3bd-a725-5a40-9544-46100ee95827/81a3f3bd-a725-5a40-9544-46100ee95827_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1971609,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9199/20149199/interior_dashboard-1774701588039.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a3f3bd-a725-5a40-9544-46100ee95827/81a3f3bd-a725-5a40-9544-46100ee95827_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2628022,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9199/20149199/instrument_cluster-1774701657235.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a3f3bd-a725-5a40-9544-46100ee95827/81a3f3bd-a725-5a40-9544-46100ee95827_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3386315,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9199/20149199/interior_boot-1774701603714.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a3f3bd-a725-5a40-9544-46100ee95827/81a3f3bd-a725-5a40-9544-46100ee95827_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60935,
'Height': 842,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9199/20149199/docs_service_history-1774701834639.jpg?ixlib=js-3.8.0&auto=format&s=82f61a4096bbdfe2e370d690f88dd290',
'Width': 596}],
'price': 12123,
'price_includes_vat': False,
'registration_date': '2024-08-17',
'seats_number': None,
'seller_name': None,
'title': 'Dacia Duster Journey TCE 4X2',
'transmission': 'manual',
'trim': 'Journey TCE 4X2',
'vin': 'VF1HJD20073078922',
'year': 2024}
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720149199%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [motorway.uk] INFO: Saving data for 20149199: {'created_time': 1774815350.125916, 'last_price_update_time': 1774815350.125926, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20149199') HTTP/1.1" 204 0
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 20481167
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 11262426
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 19102337
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 20421191
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 20228423
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720228423%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [motorway.uk] INFO: Scrape type for 20228423: 1
2026-03-29 20:15:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ac0b90>
2026-03-29 20:15:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4251d20-b9ec-570e-aeee-dadc7561c84a/e4251d20-b9ec-570e-aeee-dadc7561c84a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6792%252F17966792%252Finterior_rear_seats-1774691979273.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6792/17966792/interior_rear_seats-1774691979273.jpg saved to cache
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e4251d20-b9ec-570e-aeee-dadc7561c84a
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 20365167
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 16886677
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 20489690
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720489690%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [motorway.uk] INFO: Scrape type for 20489690: 1
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 5776267
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%275776267%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [motorway.uk] INFO: Scrape type for 5776267: 1
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 20487109
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720487109%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [motorway.uk] INFO: Scrape type for 20487109: 1
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 20254081
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720254081%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [motorway.uk] INFO: Scrape type for 20254081: 0
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 18038036
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 20473354
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 20172363
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 20323228
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720323228%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [motorway.uk] INFO: Scrape type for 20323228: 1
2026-03-29 20:15:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6792/17966792/docs_service_history-1774692686155.jpg?ixlib=js-3.8.0&auto=format&s=267f1768edf0b6f454418aa8d8572528> (referer: None)
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 20486197
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 16378604
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 20456017
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 17631330
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 12503630
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712503630%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [motorway.uk] INFO: Scrape type for 12503630: 1
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 19805155
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 20484488
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720484488%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [motorway.uk] INFO: Scrape type for 20484488: 1
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 19543159
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 11178434
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 20434695
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 20490377
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 20488936
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 20484850
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 19905225
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719905225%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [motorway.uk] INFO: Scrape type for 19905225: 1
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 18671000
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718671000%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [motorway.uk] INFO: Scrape type for 18671000: 1
2026-03-29 20:15:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/9310356.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 15950437
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 12936291
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 19919784
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 20285746
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720285746%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [motorway.uk] INFO: Scrape type for 20285746: 2
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 20473072
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720473072%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [motorway.uk] INFO: Scrape type for 20473072: 1
2026-03-29 20:15:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658507610>
2026-03-29 20:15:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4251d20-b9ec-570e-aeee-dadc7561c84a/e4251d20-b9ec-570e-aeee-dadc7561c84a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6792%252F17966792%252Fdocs_service_history-1774692686155.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D267f1768edf0b6f454418aa8d8572528') HTTP/1.1" 204 0
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6792/17966792/docs_service_history-1774692686155.jpg?ixlib=js-3.8.0&auto=format&s=267f1768edf0b6f454418aa8d8572528 saved to cache
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e4251d20-b9ec-570e-aeee-dadc7561c84a
2026-03-29 20:15:50 [motorway.uk] INFO: Found listing with ID: 19988748
2026-03-29 20:15:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a379b3e-16e0-5e97-ab1a-a72efffafce7 with identifier: 9310356
2026-03-29 20:15:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a379b3e-16e0-5e97-ab1a-a72efffafce7 with scrape type 1
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3a379b3e-16e0-5e97-ab1a-a72efffafce7
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0356%252F9310356%252Fexterior_front_driver-1774700348985.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0356/9310356/exterior_front_driver-1774700348985.jpg not downloaded yet
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0356%252F9310356%252Fexterior_rear_driver-1774700388715.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0356/9310356/exterior_rear_driver-1774700388715.jpg not downloaded yet
2026-03-29 20:15:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/6192/20486192/docs_service_history-1774703148462.jpg?ixlib=js-3.8.0&auto=format&s=434e6bf1618fce2444a6444ff6a6fb0e> (referer: None)
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0356%252F9310356%252Fexterior_front_passenger-1774700354775.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0356/9310356/exterior_front_passenger-1774700354775.jpg not downloaded yet
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0356%252F9310356%252Fexterior_rear_passenger-1774700377014.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0356/9310356/exterior_rear_passenger-1774700377014.jpg not downloaded yet
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0356%252F9310356%252Finterior_front_seats-1774700421845.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0356/9310356/interior_front_seats-1774700421845.jpg not downloaded yet
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0356%252F9310356%252Finterior_rear_seats-1774700490975.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0356/9310356/interior_rear_seats-1774700490975.jpg not downloaded yet
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0356%252F9310356%252Finterior_dashboard-1774700697258.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0356/9310356/interior_dashboard-1774700697258.jpg not downloaded yet
2026-03-29 20:15:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7364/16437364/interior_boot-1773577952094.jpg> (referer: None)
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0356%252F9310356%252Finstrument_cluster-1774700766642.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0356/9310356/instrument_cluster-1774700766642.jpg not downloaded yet
2026-03-29 20:15:50 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x0f\x00\x00'
2026-03-29 20:15:50 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\xb8\x0b\x00\x00'
2026-03-29 20:15:50 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 46 - Data Location: 158 - value: b'samsung\x00'
2026-03-29 20:15:50 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 166 - value: b'Galaxy S25\x00'
2026-03-29 20:15:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:15:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 178 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:15:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 94 - Data Location: 186 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:15:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:15:50 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 194 - value: b'S931BXXS8BZB5\x00'
2026-03-29 20:15:50 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 130 - Data Location: 208 - value: b'2026:03:28 12:18:23\x00'
2026-03-29 20:15:50 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:15:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xe4\x00\x00\x00'
2026-03-29 20:15:50 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:15:50 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x02\x00\x00\x00'
2026-03-29 20:15:50 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x00\x03\x00\xedp:\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00!\xb7\x02\x00*d9\x00\x00\x00\x00\x00'
2026-03-29 20:15:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658704110>
2026-03-29 20:15:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f7b3332-c9a8-5982-9632-785e0dcac931/9f7b3332-c9a8-5982-9632-785e0dcac931_image_9.mpo HTTP/1.1" 201 0
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6192%252F20486192%252Fdocs_service_history-1774703148462.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D434e6bf1618fce2444a6444ff6a6fb0e') HTTP/1.1" 204 0
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6192/20486192/docs_service_history-1774703148462.jpg?ixlib=js-3.8.0&auto=format&s=434e6bf1618fce2444a6444ff6a6fb0e saved to cache
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9f7b3332-c9a8-5982-9632-785e0dcac931
2026-03-29 20:15:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6192/20486192/docs_service_history-1774698687145.jpg?ixlib=js-3.8.0&auto=format&s=61b50f39cf8546c8e1a9f6dcc2fa5a0e> (referer: None)
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0356%252F9310356%252Finterior_boot-1774700551480.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0356/9310356/interior_boot-1774700551480.jpg not downloaded yet
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0356%252F9310356%252Fdocs_service_history-1774700206387.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D07b07a05fd06ebb8c43f8d90616f749c%27 HTTP/1.1" 200 None
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0356/9310356/docs_service_history-1774700206387.jpg?ixlib=js-3.8.0&auto=format&s=07b07a05fd06ebb8c43f8d90616f749c not downloaded yet
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584def90>
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4928ea38-b3ec-5bec-8391-277fe036f4c0/4928ea38-b3ec-5bec-8391-277fe036f4c0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7364%252F16437364%252Finterior_boot-1773577952094.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7364/16437364/interior_boot-1773577952094.jpg saved to cache
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4928ea38-b3ec-5bec-8391-277fe036f4c0
2026-03-29 20:15:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19472539.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584dee10>
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f7b3332-c9a8-5982-9632-785e0dcac931/9f7b3332-c9a8-5982-9632-785e0dcac931_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6192%252F20486192%252Fdocs_service_history-1774698687145.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D61b50f39cf8546c8e1a9f6dcc2fa5a0e') HTTP/1.1" 204 0
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6192/20486192/docs_service_history-1774698687145.jpg?ixlib=js-3.8.0&auto=format&s=61b50f39cf8546c8e1a9f6dcc2fa5a0e saved to cache
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9f7b3332-c9a8-5982-9632-785e0dcac931
2026-03-29 20:15:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6192/20486192/interior_boot-1774698446440.jpg> (referer: None)
2026-03-29 20:15:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73389725-e44a-5f1e-bf7d-3c8bfbc49d1f with identifier: 19472539
2026-03-29 20:15:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73389725-e44a-5f1e-bf7d-3c8bfbc49d1f with scrape type 1
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 73389725-e44a-5f1e-bf7d-3c8bfbc49d1f
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2539%252F19472539%252Fexterior_front_driver-1774691468552.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2539/19472539/exterior_front_driver-1774691468552.jpg not downloaded yet
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2539%252F19472539%252Fexterior_rear_driver-1774692781667.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2539/19472539/exterior_rear_driver-1774692781667.jpg not downloaded yet
2026-03-29 20:15:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0356/9310356/exterior_rear_driver-1774700388715.jpg> (referer: None)
2026-03-29 20:15:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6792/17966792/instrument_cluster-1774692026764.jpg> (referer: None)
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2539%252F19472539%252Fexterior_front_passenger-1774691523929.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2539/19472539/exterior_front_passenger-1774691523929.jpg not downloaded yet
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2539%252F19472539%252Fexterior_rear_passenger-1774691511100.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2539/19472539/exterior_rear_passenger-1774691511100.jpg not downloaded yet
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2539%252F19472539%252Finterior_front_seats-1774691897485.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2539/19472539/interior_front_seats-1774691897485.jpg not downloaded yet
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2539%252F19472539%252Finterior_rear_seats-1774691947745.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2539/19472539/interior_rear_seats-1774691947745.jpg not downloaded yet
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65837bad0>
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f7b3332-c9a8-5982-9632-785e0dcac931/9f7b3332-c9a8-5982-9632-785e0dcac931_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6192%252F20486192%252Finterior_boot-1774698446440.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6192/20486192/interior_boot-1774698446440.jpg saved to cache
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f7b3332-c9a8-5982-9632-785e0dcac931
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2539%252F19472539%252Finterior_dashboard-1774692020774.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2539/19472539/interior_dashboard-1774692020774.jpg not downloaded yet
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2539%252F19472539%252Finstrument_cluster-1774691994469.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2539/19472539/instrument_cluster-1774691994469.jpg not downloaded yet
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598f16d0>
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a379b3e-16e0-5e97-ab1a-a72efffafce7/3a379b3e-16e0-5e97-ab1a-a72efffafce7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0356%252F9310356%252Fexterior_rear_driver-1774700388715.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0356/9310356/exterior_rear_driver-1774700388715.jpg saved to cache
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a379b3e-16e0-5e97-ab1a-a72efffafce7
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658404810>
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4251d20-b9ec-570e-aeee-dadc7561c84a/e4251d20-b9ec-570e-aeee-dadc7561c84a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6792%252F17966792%252Finstrument_cluster-1774692026764.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6792/17966792/instrument_cluster-1774692026764.jpg saved to cache
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e4251d20-b9ec-570e-aeee-dadc7561c84a
2026-03-29 20:15:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6792/17966792/interior_boot-1774701369835.jpg> (referer: None)
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2539%252F19472539%252Finterior_boot-1774692068995.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2539/19472539/interior_boot-1774692068995.jpg not downloaded yet
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2539%252F19472539%252Fdocs_service_history-1774692215999.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df2825e786fb46fea151e58ff9ef2811b%27 HTTP/1.1" 200 None
2026-03-29 20:15:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2539/19472539/docs_service_history-1774692215999.jpg?ixlib=js-3.8.0&auto=format&s=f2825e786fb46fea151e58ff9ef2811b not downloaded yet
2026-03-29 20:15:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0356/9310356/instrument_cluster-1774700766642.jpg> (referer: None)
2026-03-29 20:15:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7364/16437364/docs_service_history-1773578596857.jpg?ixlib=js-3.8.0&auto=format&s=2d655c0e3f852fc9f1283abe84fda5b1> (referer: None)
2026-03-29 20:15:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0356/9310356/interior_boot-1774700551480.jpg> (referer: None)
2026-03-29 20:15:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2539/19472539/exterior_front_driver-1774691468552.jpg> (referer: None)
2026-03-29 20:15:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0356/9310356/docs_service_history-1774700206387.jpg?ixlib=js-3.8.0&auto=format&s=07b07a05fd06ebb8c43f8d90616f749c> (referer: None)
2026-03-29 20:15:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0356/9310356/interior_dashboard-1774700697258.jpg> (referer: None)
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a844d0>
2026-03-29 20:15:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4251d20-b9ec-570e-aeee-dadc7561c84a/e4251d20-b9ec-570e-aeee-dadc7561c84a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6792%252F17966792%252Finterior_boot-1774701369835.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6792/17966792/interior_boot-1774701369835.jpg saved to cache
2026-03-29 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e4251d20-b9ec-570e-aeee-dadc7561c84a
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599a7e90>
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a379b3e-16e0-5e97-ab1a-a72efffafce7/3a379b3e-16e0-5e97-ab1a-a72efffafce7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0356%252F9310356%252Finstrument_cluster-1774700766642.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0356/9310356/instrument_cluster-1774700766642.jpg saved to cache
2026-03-29 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a379b3e-16e0-5e97-ab1a-a72efffafce7
2026-03-29 20:15:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:15:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:52 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582f3910>
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4928ea38-b3ec-5bec-8391-277fe036f4c0/4928ea38-b3ec-5bec-8391-277fe036f4c0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7364%252F16437364%252Fdocs_service_history-1773578596857.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2d655c0e3f852fc9f1283abe84fda5b1') HTTP/1.1" 204 0
2026-03-29 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7364/16437364/docs_service_history-1773578596857.jpg?ixlib=js-3.8.0&auto=format&s=2d655c0e3f852fc9f1283abe84fda5b1 saved to cache
2026-03-29 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4928ea38-b3ec-5bec-8391-277fe036f4c0
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d7b2d0>
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a379b3e-16e0-5e97-ab1a-a72efffafce7/3a379b3e-16e0-5e97-ab1a-a72efffafce7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0356%252F9310356%252Finterior_boot-1774700551480.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0356/9310356/interior_boot-1774700551480.jpg saved to cache
2026-03-29 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3a379b3e-16e0-5e97-ab1a-a72efffafce7
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d796d0>
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73389725-e44a-5f1e-bf7d-3c8bfbc49d1f/73389725-e44a-5f1e-bf7d-3c8bfbc49d1f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2539%252F19472539%252Fexterior_front_driver-1774691468552.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2539/19472539/exterior_front_driver-1774691468552.jpg saved to cache
2026-03-29 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 73389725-e44a-5f1e-bf7d-3c8bfbc49d1f
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659076390>
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a379b3e-16e0-5e97-ab1a-a72efffafce7/3a379b3e-16e0-5e97-ab1a-a72efffafce7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0356%252F9310356%252Fdocs_service_history-1774700206387.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D07b07a05fd06ebb8c43f8d90616f749c') HTTP/1.1" 204 0
2026-03-29 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0356/9310356/docs_service_history-1774700206387.jpg?ixlib=js-3.8.0&auto=format&s=07b07a05fd06ebb8c43f8d90616f749c saved to cache
2026-03-29 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3a379b3e-16e0-5e97-ab1a-a72efffafce7
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6590762d0>
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a379b3e-16e0-5e97-ab1a-a72efffafce7/3a379b3e-16e0-5e97-ab1a-a72efffafce7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0356%252F9310356%252Finterior_dashboard-1774700697258.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0356/9310356/interior_dashboard-1774700697258.jpg saved to cache
2026-03-29 20:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3a379b3e-16e0-5e97-ab1a-a72efffafce7
2026-03-29 20:15:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13722608.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2539/19472539/docs_service_history-1774692215999.jpg?ixlib=js-3.8.0&auto=format&s=f2825e786fb46fea151e58ff9ef2811b> (referer: None)
2026-03-29 20:15:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2539/19472539/interior_dashboard-1774692020774.jpg> (referer: None)
2026-03-29 20:15:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 251d721e-de81-59c2-87ff-c25a64b103e4 with identifier: 13722608
2026-03-29 20:15:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 251d721e-de81-59c2-87ff-c25a64b103e4 with scrape type 1
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 251d721e-de81-59c2-87ff-c25a64b103e4
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2608%252F13722608%252Fexterior_front_driver-1774622719386.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2608/13722608/exterior_front_driver-1774622719386.jpg not downloaded yet
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2608%252F13722608%252Fexterior_rear_driver-1774622927225.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2608/13722608/exterior_rear_driver-1774622927225.jpg not downloaded yet
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2608%252F13722608%252F13722608-exterior_front_passenger-modified-1774629430114.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2608/13722608/13722608-exterior_front_passenger-modified-1774629430114.jpeg not downloaded yet
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d79210>
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73389725-e44a-5f1e-bf7d-3c8bfbc49d1f/73389725-e44a-5f1e-bf7d-3c8bfbc49d1f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2539%252F19472539%252Fdocs_service_history-1774692215999.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df2825e786fb46fea151e58ff9ef2811b') HTTP/1.1" 204 0
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2539/19472539/docs_service_history-1774692215999.jpg?ixlib=js-3.8.0&auto=format&s=f2825e786fb46fea151e58ff9ef2811b saved to cache
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 73389725-e44a-5f1e-bf7d-3c8bfbc49d1f
2026-03-29 20:15:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a5dd90>
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73389725-e44a-5f1e-bf7d-3c8bfbc49d1f/73389725-e44a-5f1e-bf7d-3c8bfbc49d1f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2539%252F19472539%252Finterior_dashboard-1774692020774.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2539/19472539/interior_dashboard-1774692020774.jpg saved to cache
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 73389725-e44a-5f1e-bf7d-3c8bfbc49d1f
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2608%252F13722608%252Fexterior_rear_passenger-1774622919585.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2608/13722608/exterior_rear_passenger-1774622919585.jpg not downloaded yet
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2608%252F13722608%252Finterior_front_seats-1774623363313.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2608/13722608/interior_front_seats-1774623363313.jpg not downloaded yet
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2608%252F13722608%252Finterior_rear_seats-1774623514936.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2608/13722608/interior_rear_seats-1774623514936.jpg not downloaded yet
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2608%252F13722608%252Finterior_dashboard-1774623337291.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2608/13722608/interior_dashboard-1774623337291.jpg not downloaded yet
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2608%252F13722608%252F13722608-instrument_cluster-modified-1774628900480.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2608/13722608/13722608-instrument_cluster-modified-1774628900480.jpeg not downloaded yet
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2608%252F13722608%252Finterior_boot-1774623237279.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2608/13722608/interior_boot-1774623237279.jpg not downloaded yet
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2608%252F13722608%252F13722608-docs_service_history-modified-1763747842167.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db727b972651a22f042049b892ef04a9e%27 HTTP/1.1" 200 None
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2608/13722608/13722608-docs_service_history-modified-1763747842167.jpeg?ixlib=js-3.8.0&auto=format&s=b727b972651a22f042049b892ef04a9e not downloaded yet
2026-03-29 20:15:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2539/19472539/exterior_rear_driver-1774692781667.jpg> (referer: None)
2026-03-29 20:15:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0356/9310356/interior_rear_seats-1774700490975.jpg> (referer: None)
2026-03-29 20:15:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2539/19472539/exterior_rear_passenger-1774691511100.jpg> (referer: None)
2026-03-29 20:15:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0356/9310356/interior_front_seats-1774700421845.jpg> (referer: None)
2026-03-29 20:15:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2539/19472539/exterior_front_passenger-1774691523929.jpg> (referer: None)
2026-03-29 20:15:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2539/19472539/instrument_cluster-1774691994469.jpg> (referer: None)
2026-03-29 20:15:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2539/19472539/interior_rear_seats-1774691947745.jpg> (referer: None)
2026-03-29 20:15:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20454392.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2539/19472539/interior_boot-1774692068995.jpg> (referer: None)
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658787390>
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73389725-e44a-5f1e-bf7d-3c8bfbc49d1f/73389725-e44a-5f1e-bf7d-3c8bfbc49d1f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2539%252F19472539%252Fexterior_rear_driver-1774692781667.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2539/19472539/exterior_rear_driver-1774692781667.jpg saved to cache
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 73389725-e44a-5f1e-bf7d-3c8bfbc49d1f
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c17d50>
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a379b3e-16e0-5e97-ab1a-a72efffafce7/3a379b3e-16e0-5e97-ab1a-a72efffafce7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0356%252F9310356%252Finterior_rear_seats-1774700490975.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0356/9310356/interior_rear_seats-1774700490975.jpg saved to cache
2026-03-29 20:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3a379b3e-16e0-5e97-ab1a-a72efffafce7
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65998d6d0>
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73389725-e44a-5f1e-bf7d-3c8bfbc49d1f/73389725-e44a-5f1e-bf7d-3c8bfbc49d1f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2539%252F19472539%252Fexterior_rear_passenger-1774691511100.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2539/19472539/exterior_rear_passenger-1774691511100.jpg saved to cache
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 73389725-e44a-5f1e-bf7d-3c8bfbc49d1f
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599d7c10>
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a379b3e-16e0-5e97-ab1a-a72efffafce7/3a379b3e-16e0-5e97-ab1a-a72efffafce7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0356%252F9310356%252Finterior_front_seats-1774700421845.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0356/9310356/interior_front_seats-1774700421845.jpg saved to cache
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3a379b3e-16e0-5e97-ab1a-a72efffafce7
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64becb110>
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73389725-e44a-5f1e-bf7d-3c8bfbc49d1f/73389725-e44a-5f1e-bf7d-3c8bfbc49d1f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2539%252F19472539%252Fexterior_front_passenger-1774691523929.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2539/19472539/exterior_front_passenger-1774691523929.jpg saved to cache
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 73389725-e44a-5f1e-bf7d-3c8bfbc49d1f
2026-03-29 20:15:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658785a50>
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73389725-e44a-5f1e-bf7d-3c8bfbc49d1f/73389725-e44a-5f1e-bf7d-3c8bfbc49d1f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2539%252F19472539%252Finstrument_cluster-1774691994469.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2539/19472539/instrument_cluster-1774691994469.jpg saved to cache
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 73389725-e44a-5f1e-bf7d-3c8bfbc49d1f
2026-03-29 20:15:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587132d0>
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73389725-e44a-5f1e-bf7d-3c8bfbc49d1f/73389725-e44a-5f1e-bf7d-3c8bfbc49d1f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2539%252F19472539%252Finterior_rear_seats-1774691947745.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2539/19472539/interior_rear_seats-1774691947745.jpg saved to cache
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 73389725-e44a-5f1e-bf7d-3c8bfbc49d1f
2026-03-29 20:15:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36edccab-2417-5607-912e-5fde6a5f8fe8 with identifier: 20454392
2026-03-29 20:15:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36edccab-2417-5607-912e-5fde6a5f8fe8 with scrape type 1
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 36edccab-2417-5607-912e-5fde6a5f8fe8
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4392%252F20454392%252Fexterior_front_driver-1774687122155.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4392/20454392/exterior_front_driver-1774687122155.jpg not downloaded yet
2026-03-29 20:15:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf53e50>
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73389725-e44a-5f1e-bf7d-3c8bfbc49d1f/73389725-e44a-5f1e-bf7d-3c8bfbc49d1f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2539%252F19472539%252Finterior_boot-1774692068995.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2539/19472539/interior_boot-1774692068995.jpg saved to cache
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 73389725-e44a-5f1e-bf7d-3c8bfbc49d1f
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4392%252F20454392%252Fexterior_rear_driver-1774687155784.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4392/20454392/exterior_rear_driver-1774687155784.jpg not downloaded yet
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4392%252F20454392%252Fexterior_front_passenger-1774687100203.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4392/20454392/exterior_front_passenger-1774687100203.jpg not downloaded yet
2026-03-29 20:15:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2539/19472539/interior_front_seats-1774691897485.jpg> (referer: None)
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4392%252F20454392%252Fexterior_rear_passenger-1774687081718.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4392/20454392/exterior_rear_passenger-1774687081718.jpg not downloaded yet
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4392%252F20454392%252Finterior_front_seats-1774687867043.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4392/20454392/interior_front_seats-1774687867043.jpg not downloaded yet
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4392%252F20454392%252Finterior_rear_seats-1774687612309.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4392/20454392/interior_rear_seats-1774687612309.jpg not downloaded yet
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4392%252F20454392%252Finterior_dashboard-1774687896525.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4392/20454392/interior_dashboard-1774687896525.jpg not downloaded yet
2026-03-29 20:15:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2608/13722608/interior_boot-1774623237279.jpg> (referer: None)
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4392%252F20454392%252Finstrument_cluster-1774785716297.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4392/20454392/instrument_cluster-1774785716297.jpg not downloaded yet
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4392%252F20454392%252Finterior_boot-1774785704605.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4392/20454392/interior_boot-1774785704605.jpg not downloaded yet
2026-03-29 20:15:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ad2b50>
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_73389725-e44a-5f1e-bf7d-3c8bfbc49d1f/73389725-e44a-5f1e-bf7d-3c8bfbc49d1f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2539%252F19472539%252Finterior_front_seats-1774691897485.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2539/19472539/interior_front_seats-1774691897485.jpg saved to cache
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 73389725-e44a-5f1e-bf7d-3c8bfbc49d1f
2026-03-29 20:15:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 73389725-e44a-5f1e-bf7d-3c8bfbc49d1f, skipping ID generation
2026-03-29 20:15:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73389725-e44a-5f1e-bf7d-3c8bfbc49d1f with scrape type 1
2026-03-29 20:15:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 73389725-e44a-5f1e-bf7d-3c8bfbc49d1f sending to next pipeline
2026-03-29 20:15:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 73389725-e44a-5f1e-bf7d-3c8bfbc49d1f, identifier: 19472539
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4392%252F20454392%252Fdocs_service_history-1774687984784.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dde0b49546350c294a846d9508d4f5482%27 HTTP/1.1" 200 None
2026-03-29 20:15:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4392/20454392/docs_service_history-1774687984784.jpg?ixlib=js-3.8.0&auto=format&s=de0b49546350c294a846d9508d4f5482 not downloaded yet
2026-03-29 20:15:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20229861.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 73389725-e44a-5f1e-bf7d-3c8bfbc49d1f with identifier: 19472539
2026-03-29 20:15:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 73389725-e44a-5f1e-bf7d-3c8bfbc49d1f with identifier: 19472539
2026-03-29 20:15:55 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 73389725-e44a-5f1e-bf7d-3c8bfbc49d1f with identifier: 19472539 to the API
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/2539/19472539/interior_front_seats-1774691897485.jpg>
{'auction_title': '',
'category': None,
'color': 'Orange',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '73389725-e44a-5f1e-bf7d-3c8bfbc49d1f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'CX66 HWE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19472539',
'listing': 'auction',
'location': 'Caerffili Caerphilly',
'make': 'Peugeot',
'model': '208',
'odometer': 90600,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73389725-e44a-5f1e-bf7d-3c8bfbc49d1f/73389725-e44a-5f1e-bf7d-3c8bfbc49d1f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1695557,
'Height': 2571,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2539/19472539/exterior_front_driver-1774691468552.jpg',
'Width': 3428},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73389725-e44a-5f1e-bf7d-3c8bfbc49d1f/73389725-e44a-5f1e-bf7d-3c8bfbc49d1f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1960709,
'Height': 2362,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2539/19472539/exterior_rear_driver-1774692781667.jpg',
'Width': 3149},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73389725-e44a-5f1e-bf7d-3c8bfbc49d1f/73389725-e44a-5f1e-bf7d-3c8bfbc49d1f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2118147,
'Height': 2852,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2539/19472539/exterior_front_passenger-1774691523929.jpg',
'Width': 3803},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73389725-e44a-5f1e-bf7d-3c8bfbc49d1f/73389725-e44a-5f1e-bf7d-3c8bfbc49d1f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1437865,
'Height': 2526,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2539/19472539/exterior_rear_passenger-1774691511100.jpg',
'Width': 3368},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73389725-e44a-5f1e-bf7d-3c8bfbc49d1f/73389725-e44a-5f1e-bf7d-3c8bfbc49d1f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4083381,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2539/19472539/interior_front_seats-1774691897485.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73389725-e44a-5f1e-bf7d-3c8bfbc49d1f/73389725-e44a-5f1e-bf7d-3c8bfbc49d1f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3224291,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2539/19472539/interior_rear_seats-1774691947745.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73389725-e44a-5f1e-bf7d-3c8bfbc49d1f/73389725-e44a-5f1e-bf7d-3c8bfbc49d1f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3681059,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2539/19472539/interior_dashboard-1774692020774.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73389725-e44a-5f1e-bf7d-3c8bfbc49d1f/73389725-e44a-5f1e-bf7d-3c8bfbc49d1f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2607484,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2539/19472539/instrument_cluster-1774691994469.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73389725-e44a-5f1e-bf7d-3c8bfbc49d1f/73389725-e44a-5f1e-bf7d-3c8bfbc49d1f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4689423,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2539/19472539/interior_boot-1774692068995.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73389725-e44a-5f1e-bf7d-3c8bfbc49d1f/73389725-e44a-5f1e-bf7d-3c8bfbc49d1f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 790560,
'Height': 1884,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2539/19472539/docs_service_history-1774692215999.jpg?ixlib=js-3.8.0&auto=format&s=f2825e786fb46fea151e58ff9ef2811b',
'Width': 3032}],
'price': 1687,
'price_includes_vat': False,
'registration_date': '2016-10-08',
'seats_number': None,
'seller_name': None,
'title': 'Peugeot 208 Allure Blue HDi',
'transmission': 'manual',
'trim': 'Allure Blue HDi',
'vin': 'VF3CCBHY6GT190249',
'year': 2016}
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719472539%27 HTTP/1.1" 200 None
2026-03-29 20:15:55 [motorway.uk] INFO: Saving data for 19472539: {'created_time': 1774815355.813822, 'last_price_update_time': 1774815355.813835, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19472539') HTTP/1.1" 204 0
2026-03-29 20:15:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20323228.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20226525.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584230d0>
2026-03-29 20:15:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_251d721e-de81-59c2-87ff-c25a64b103e4/251d721e-de81-59c2-87ff-c25a64b103e4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2608%252F13722608%252Finterior_boot-1774623237279.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2608/13722608/interior_boot-1774623237279.jpg saved to cache
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 251d721e-de81-59c2-87ff-c25a64b103e4
2026-03-29 20:15:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed1f8495-fab0-55bd-9672-eb4dafd7c693 with identifier: 20229861
2026-03-29 20:15:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed1f8495-fab0-55bd-9672-eb4dafd7c693 with scrape type 1
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ed1f8495-fab0-55bd-9672-eb4dafd7c693
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9861%252F20229861%252Fexterior_front_driver-1774621663590.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9861/20229861/exterior_front_driver-1774621663590.jpg not downloaded yet
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9861%252F20229861%252Fexterior_rear_driver-1774621676281.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9861/20229861/exterior_rear_driver-1774621676281.jpg not downloaded yet
2026-03-29 20:15:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2608/13722608/13722608-instrument_cluster-modified-1774628900480.jpeg> (referer: None)
2026-03-29 20:15:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2608/13722608/interior_rear_seats-1774623514936.jpg> (referer: None)
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9861%252F20229861%252Fexterior_front_passenger-1774621702892.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9861/20229861/exterior_front_passenger-1774621702892.jpg not downloaded yet
2026-03-29 20:15:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02313ff0-ea42-5666-945a-d400fe158df8 with identifier: 20323228
2026-03-29 20:15:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02313ff0-ea42-5666-945a-d400fe158df8 with scrape type 1
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 02313ff0-ea42-5666-945a-d400fe158df8
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3228%252F20323228%252Fexterior_front_driver-1774620680004.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3228/20323228/exterior_front_driver-1774620680004.jpg not downloaded yet
2026-03-29 20:15:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcda4728-4826-539b-a155-03357507de2c with identifier: 20226525
2026-03-29 20:15:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcda4728-4826-539b-a155-03357507de2c with scrape type 1
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bcda4728-4826-539b-a155-03357507de2c
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6525%252F20226525%252Fexterior_front_driver-1774277158996.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6525/20226525/exterior_front_driver-1774277158996.jpg already downloaded
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6525%252F20226525%252Fexterior_rear_driver-1773508990748.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6525/20226525/exterior_rear_driver-1773508990748.jpg already downloaded
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6525%252F20226525%252Fexterior_front_passenger-1773509013145.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6525/20226525/exterior_front_passenger-1773509013145.jpg already downloaded
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6525%252F20226525%252Fexterior_rear_passenger-1773509001960.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6525/20226525/exterior_rear_passenger-1773509001960.jpg already downloaded
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6525%252F20226525%252Finterior_front_seats-1773510262635.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6525/20226525/interior_front_seats-1773510262635.jpg already downloaded
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6525%252F20226525%252Finterior_rear_seats-1773510284650.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6525/20226525/interior_rear_seats-1773510284650.jpg already downloaded
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6525%252F20226525%252Finterior_dashboard-1774704100480.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6525/20226525/interior_dashboard-1774704100480.jpg not downloaded yet
2026-03-29 20:15:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2608/13722608/interior_front_seats-1774623363313.jpg> (referer: None)
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9861%252F20229861%252Fexterior_rear_passenger-1774621693875.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9861/20229861/exterior_rear_passenger-1774621693875.jpg not downloaded yet
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3228%252F20323228%252Fexterior_rear_driver-1774620686558.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3228/20323228/exterior_rear_driver-1774620686558.jpg not downloaded yet
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6525%252F20226525%252Finstrument_cluster-1773510366114.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6525/20226525/instrument_cluster-1773510366114.jpg already downloaded
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6525%252F20226525%252Finterior_boot-1773510334305.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6525/20226525/interior_boot-1773510334305.jpg already downloaded
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6525%252F20226525%252Fdocs_service_history-1774536406916.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D146d672a2049fd488b11a0b7c9a35716%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6525/20226525/docs_service_history-1774536406916.jpg?ixlib=js-3.8.0&auto=format&s=146d672a2049fd488b11a0b7c9a35716 not downloaded yet
2026-03-29 20:15:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18202599.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bcfd10>
2026-03-29 20:15:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_251d721e-de81-59c2-87ff-c25a64b103e4/251d721e-de81-59c2-87ff-c25a64b103e4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2608%252F13722608%252F13722608-instrument_cluster-modified-1774628900480.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2608/13722608/13722608-instrument_cluster-modified-1774628900480.jpeg saved to cache
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 251d721e-de81-59c2-87ff-c25a64b103e4
2026-03-29 20:15:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a0f590>
2026-03-29 20:15:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_251d721e-de81-59c2-87ff-c25a64b103e4/251d721e-de81-59c2-87ff-c25a64b103e4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2608%252F13722608%252Finterior_rear_seats-1774623514936.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2608/13722608/interior_rear_seats-1774623514936.jpg saved to cache
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 251d721e-de81-59c2-87ff-c25a64b103e4
2026-03-29 20:15:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2608/13722608/exterior_rear_passenger-1774622919585.jpg> (referer: None)
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9861%252F20229861%252Finterior_front_seats-1774622206199.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9861/20229861/interior_front_seats-1774622206199.jpg not downloaded yet
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3228%252F20323228%252Fexterior_front_passenger-1774620681680.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3228/20323228/exterior_front_passenger-1774620681680.jpg not downloaded yet
2026-03-29 20:15:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ab1610>
2026-03-29 20:15:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_251d721e-de81-59c2-87ff-c25a64b103e4/251d721e-de81-59c2-87ff-c25a64b103e4_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2608%252F13722608%252Finterior_front_seats-1774623363313.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2608/13722608/interior_front_seats-1774623363313.jpg saved to cache
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 251d721e-de81-59c2-87ff-c25a64b103e4
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9861%252F20229861%252Finterior_rear_seats-1774622271791.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9861/20229861/interior_rear_seats-1774622271791.jpg not downloaded yet
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3228%252F20323228%252Fexterior_rear_passenger-1774620687288.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3228/20323228/exterior_rear_passenger-1774620687288.jpg not downloaded yet
2026-03-29 20:15:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2af35cd-c25c-50cd-a86a-c4befa1bd541 with identifier: 18202599
2026-03-29 20:15:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2af35cd-c25c-50cd-a86a-c4befa1bd541 with scrape type 1
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b2af35cd-c25c-50cd-a86a-c4befa1bd541
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2599%252F18202599%252Fexterior_front_driver-1774780687958.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2599/18202599/exterior_front_driver-1774780687958.jpeg not downloaded yet
2026-03-29 20:15:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4392/20454392/docs_service_history-1774687984784.jpg?ixlib=js-3.8.0&auto=format&s=de0b49546350c294a846d9508d4f5482> (referer: None)
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9861%252F20229861%252Finterior_dashboard-1774622283335.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9861/20229861/interior_dashboard-1774622283335.jpg not downloaded yet
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3228%252F20323228%252Finterior_front_seats-1774621030101.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3228/20323228/interior_front_seats-1774621030101.jpg not downloaded yet
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2599%252F18202599%252Fexterior_rear_driver-1774780785998.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2599/18202599/exterior_rear_driver-1774780785998.jpeg not downloaded yet
2026-03-29 20:15:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d17950>
2026-03-29 20:15:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_251d721e-de81-59c2-87ff-c25a64b103e4/251d721e-de81-59c2-87ff-c25a64b103e4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2608%252F13722608%252Fexterior_rear_passenger-1774622919585.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2608/13722608/exterior_rear_passenger-1774622919585.jpg saved to cache
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 251d721e-de81-59c2-87ff-c25a64b103e4
2026-03-29 20:15:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/2608/13722608/13722608-docs_service_history-modified-1763747842167.jpeg?ixlib=js-3.8.0&auto=format&s=b727b972651a22f042049b892ef04a9e> (referer: None)
2026-03-29 20:15:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4392/20454392/exterior_front_driver-1774687122155.jpg> (referer: None)
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9861%252F20229861%252Finstrument_cluster-1774622363890.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9861/20229861/instrument_cluster-1774622363890.jpg not downloaded yet
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3228%252F20323228%252Finterior_rear_seats-1774621024780.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3228/20323228/interior_rear_seats-1774621024780.jpg not downloaded yet
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2599%252F18202599%252Fexterior_front_passenger-1774780715810.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2599/18202599/exterior_front_passenger-1774780715810.jpeg not downloaded yet
2026-03-29 20:15:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4392/20454392/exterior_rear_driver-1774687155784.jpg> (referer: None)
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9861%252F20229861%252Finterior_boot-1774622220929.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9861/20229861/interior_boot-1774622220929.jpg not downloaded yet
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3228%252F20323228%252Finterior_dashboard-1774621042797.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3228/20323228/interior_dashboard-1774621042797.jpg not downloaded yet
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2599%252F18202599%252Fexterior_rear_passenger-1774780742080.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2599/18202599/exterior_rear_passenger-1774780742080.jpeg not downloaded yet
2026-03-29 20:15:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fe0b10>
2026-03-29 20:15:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36edccab-2417-5607-912e-5fde6a5f8fe8/36edccab-2417-5607-912e-5fde6a5f8fe8_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4392%252F20454392%252Fdocs_service_history-1774687984784.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dde0b49546350c294a846d9508d4f5482') HTTP/1.1" 204 0
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4392/20454392/docs_service_history-1774687984784.jpg?ixlib=js-3.8.0&auto=format&s=de0b49546350c294a846d9508d4f5482 saved to cache
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 36edccab-2417-5607-912e-5fde6a5f8fe8
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9861%252F20229861%252Fdocs_service_history-1774625941036.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D99b39864362e2f47cd90d6c304e0240a%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9861/20229861/docs_service_history-1774625941036.jpg?ixlib=js-3.8.0&auto=format&s=99b39864362e2f47cd90d6c304e0240a not downloaded yet
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3228%252F20323228%252Finstrument_cluster-1774621080448.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3228/20323228/instrument_cluster-1774621080448.jpg not downloaded yet
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2599%252F18202599%252Finterior_front_seats-1774780814613.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2599/18202599/interior_front_seats-1774780814613.jpeg not downloaded yet
2026-03-29 20:15:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2608/13722608/13722608-exterior_front_passenger-modified-1774629430114.jpeg> (referer: None)
2026-03-29 20:15:57 [PIL.TiffImagePlugin] DEBUG: tag: Compression (259) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:15:57 [PIL.TiffImagePlugin] DEBUG: tag: JPEGInterchangeFormat (513) - type: long (4) - value: b'\x00\x00\x03v'
2026-03-29 20:15:57 [PIL.TiffImagePlugin] DEBUG: tag: JPEGInterchangeFormatLength (514) - type: long (4) - value: b'\x00\x00U\xbd'
2026-03-29 20:15:57 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\x1dl'
2026-03-29 20:15:57 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 194 - value: b'samsung\x00'
2026-03-29 20:15:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:57 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 202 - value: b'2025:11:19 17:20:46\x00'
2026-03-29 20:15:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 106 - Data Location: 222 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 118 - Data Location: 230 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:57 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'?\xc0'
2026-03-29 20:15:57 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 142 - Data Location: 238 - value: b'Galaxy S25 Ultra\x00'
2026-03-29 20:15:57 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 154 - Data Location: 255 - value: b'S938BXXS6BYIF\x00'
2026-03-29 20:15:57 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x01\r'
2026-03-29 20:15:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:57 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:15:57 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x02\x00\x00\x00'
2026-03-29 20:15:57 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x00\x03\x002\xc2\x7f\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\xda\xce\x02\x00\xaa\xb7\x7f\x00\x00\x00\x00\x00'
2026-03-29 20:15:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ec6e90>
2026-03-29 20:15:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_251d721e-de81-59c2-87ff-c25a64b103e4/251d721e-de81-59c2-87ff-c25a64b103e4_image_9.mpo HTTP/1.1" 201 0
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2608%252F13722608%252F13722608-docs_service_history-modified-1763747842167.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db727b972651a22f042049b892ef04a9e') HTTP/1.1" 204 0
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2608/13722608/13722608-docs_service_history-modified-1763747842167.jpeg?ixlib=js-3.8.0&auto=format&s=b727b972651a22f042049b892ef04a9e saved to cache
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 251d721e-de81-59c2-87ff-c25a64b103e4
2026-03-29 20:15:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65853c110>
2026-03-29 20:15:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36edccab-2417-5607-912e-5fde6a5f8fe8/36edccab-2417-5607-912e-5fde6a5f8fe8_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4392%252F20454392%252Fexterior_front_driver-1774687122155.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4392/20454392/exterior_front_driver-1774687122155.jpg saved to cache
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36edccab-2417-5607-912e-5fde6a5f8fe8
2026-03-29 20:15:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2608/13722608/interior_dashboard-1774623337291.jpg> (referer: None)
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3228%252F20323228%252Finterior_boot-1774621026641.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3228/20323228/interior_boot-1774621026641.jpg not downloaded yet
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2599%252F18202599%252Finterior_rear_seats-1774781224831.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2599/18202599/interior_rear_seats-1774781224831.jpeg not downloaded yet
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3228%252F20323228%252Fdocs_service_history-1774622193393.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3787b738fe3e923b27eda39faebfd3ed%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3228/20323228/docs_service_history-1774622193393.jpg?ixlib=js-3.8.0&auto=format&s=3787b738fe3e923b27eda39faebfd3ed not downloaded yet
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2599%252F18202599%252F18202599-interior_dashboard-modified-1774782020211.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2599/18202599/18202599-interior_dashboard-modified-1774782020211.jpeg not downloaded yet
2026-03-29 20:15:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659cf6f90>
2026-03-29 20:15:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36edccab-2417-5607-912e-5fde6a5f8fe8/36edccab-2417-5607-912e-5fde6a5f8fe8_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4392%252F20454392%252Fexterior_rear_driver-1774687155784.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4392/20454392/exterior_rear_driver-1774687155784.jpg saved to cache
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36edccab-2417-5607-912e-5fde6a5f8fe8
2026-03-29 20:15:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be5cc90>
2026-03-29 20:15:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_251d721e-de81-59c2-87ff-c25a64b103e4/251d721e-de81-59c2-87ff-c25a64b103e4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2608%252F13722608%252F13722608-exterior_front_passenger-modified-1774629430114.jpeg') HTTP/1.1" 204 0
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2608/13722608/13722608-exterior_front_passenger-modified-1774629430114.jpeg saved to cache
2026-03-29 20:15:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 251d721e-de81-59c2-87ff-c25a64b103e4
2026-03-29 20:15:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/6525/20226525/docs_service_history-1774536406916.jpg?ixlib=js-3.8.0&auto=format&s=146d672a2049fd488b11a0b7c9a35716> (referer: None)
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2599%252F18202599%252Finterior_boot-1774781022103.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2599/18202599/interior_boot-1774781022103.jpeg not downloaded yet
2026-03-29 20:15:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9861/20229861/exterior_rear_driver-1774621676281.jpg> (referer: None)
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2599%252F18202599%252F18202599-docs_service_history-modified-1774782342092.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9c8a8edc6ba2b3b6308133f112272e88%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2599/18202599/18202599-docs_service_history-modified-1774782342092.jpeg?ixlib=js-3.8.0&auto=format&s=9c8a8edc6ba2b3b6308133f112272e88 not downloaded yet
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586bc950>
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_251d721e-de81-59c2-87ff-c25a64b103e4/251d721e-de81-59c2-87ff-c25a64b103e4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2608%252F13722608%252Finterior_dashboard-1774623337291.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2608/13722608/interior_dashboard-1774623337291.jpg saved to cache
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 251d721e-de81-59c2-87ff-c25a64b103e4
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2599%252F18202599%252Fdamage_scratches-1774781710925.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2599/18202599/damage_scratches-1774781710925.jpeg not downloaded yet
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582c7450>
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcda4728-4826-539b-a155-03357507de2c/bcda4728-4826-539b-a155-03357507de2c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6525%252F20226525%252Fdocs_service_history-1774536406916.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D146d672a2049fd488b11a0b7c9a35716') HTTP/1.1" 204 0
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6525/20226525/docs_service_history-1774536406916.jpg?ixlib=js-3.8.0&auto=format&s=146d672a2049fd488b11a0b7c9a35716 saved to cache
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bcda4728-4826-539b-a155-03357507de2c
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582c40d0>
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed1f8495-fab0-55bd-9672-eb4dafd7c693/ed1f8495-fab0-55bd-9672-eb4dafd7c693_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9861%252F20229861%252Fexterior_rear_driver-1774621676281.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9861/20229861/exterior_rear_driver-1774621676281.jpg saved to cache
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ed1f8495-fab0-55bd-9672-eb4dafd7c693
2026-03-29 20:15:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9861/20229861/exterior_front_driver-1774621663590.jpg> (referer: None)
2026-03-29 20:15:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3228/20323228/exterior_rear_driver-1774620686558.jpg> (referer: None)
2026-03-29 20:15:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4392/20454392/instrument_cluster-1774785716297.jpg> (referer: None)
2026-03-29 20:15:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3228/20323228/exterior_front_passenger-1774620681680.jpg> (referer: None)
2026-03-29 20:15:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4392/20454392/interior_boot-1774785704605.jpg> (referer: None)
2026-03-29 20:15:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4392/20454392/interior_dashboard-1774687896525.jpg> (referer: None)
2026-03-29 20:15:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6525/20226525/interior_dashboard-1774704100480.jpg> (referer: None)
2026-03-29 20:15:58 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (14211060) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/2599/18202599/interior_boot-1774781022103.jpeg>.
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658433610>
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed1f8495-fab0-55bd-9672-eb4dafd7c693/ed1f8495-fab0-55bd-9672-eb4dafd7c693_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9861%252F20229861%252Fexterior_front_driver-1774621663590.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9861/20229861/exterior_front_driver-1774621663590.jpg saved to cache
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ed1f8495-fab0-55bd-9672-eb4dafd7c693
2026-03-29 20:15:58 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (12671045) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/2599/18202599/interior_front_seats-1774780814613.jpeg>.
2026-03-29 20:15:58 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (16112836) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/2599/18202599/interior_rear_seats-1774781224831.jpeg>.
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f259d0>
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02313ff0-ea42-5666-945a-d400fe158df8/02313ff0-ea42-5666-945a-d400fe158df8_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3228%252F20323228%252Fexterior_rear_driver-1774620686558.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3228/20323228/exterior_rear_driver-1774620686558.jpg saved to cache
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 02313ff0-ea42-5666-945a-d400fe158df8
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659af22d0>
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36edccab-2417-5607-912e-5fde6a5f8fe8/36edccab-2417-5607-912e-5fde6a5f8fe8_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4392%252F20454392%252Finstrument_cluster-1774785716297.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4392/20454392/instrument_cluster-1774785716297.jpg saved to cache
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 36edccab-2417-5607-912e-5fde6a5f8fe8
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658356710>
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02313ff0-ea42-5666-945a-d400fe158df8/02313ff0-ea42-5666-945a-d400fe158df8_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3228%252F20323228%252Fexterior_front_passenger-1774620681680.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3228/20323228/exterior_front_passenger-1774620681680.jpg saved to cache
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 02313ff0-ea42-5666-945a-d400fe158df8
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a816d0>
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36edccab-2417-5607-912e-5fde6a5f8fe8/36edccab-2417-5607-912e-5fde6a5f8fe8_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4392%252F20454392%252Finterior_boot-1774785704605.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4392/20454392/interior_boot-1774785704605.jpg saved to cache
2026-03-29 20:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 36edccab-2417-5607-912e-5fde6a5f8fe8
2026-03-29 20:15:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:15:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:15:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:15:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d7a5d0>
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36edccab-2417-5607-912e-5fde6a5f8fe8/36edccab-2417-5607-912e-5fde6a5f8fe8_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4392%252F20454392%252Finterior_dashboard-1774687896525.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4392/20454392/interior_dashboard-1774687896525.jpg saved to cache
2026-03-29 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 36edccab-2417-5607-912e-5fde6a5f8fe8
2026-03-29 20:15:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:15:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a81b50>
2026-03-29 20:15:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:15:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcda4728-4826-539b-a155-03357507de2c/bcda4728-4826-539b-a155-03357507de2c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6525%252F20226525%252Finterior_dashboard-1774704100480.jpg') HTTP/1.1" 204 0
2026-03-29 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6525/20226525/interior_dashboard-1774704100480.jpg saved to cache
2026-03-29 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bcda4728-4826-539b-a155-03357507de2c
2026-03-29 20:15:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bcda4728-4826-539b-a155-03357507de2c, skipping ID generation
2026-03-29 20:15:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcda4728-4826-539b-a155-03357507de2c with scrape type 1
2026-03-29 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bcda4728-4826-539b-a155-03357507de2c sending to next pipeline
2026-03-29 20:15:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: bcda4728-4826-539b-a155-03357507de2c, identifier: 20226525
2026-03-29 20:15:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: bcda4728-4826-539b-a155-03357507de2c with identifier: 20226525
2026-03-29 20:15:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: bcda4728-4826-539b-a155-03357507de2c with identifier: 20226525
2026-03-29 20:15:59 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: bcda4728-4826-539b-a155-03357507de2c with identifier: 20226525 to the API
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:15:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/6525/20226525/interior_dashboard-1774704100480.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'bcda4728-4826-539b-a155-03357507de2c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KV19 TFD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20226525',
'listing': 'auction',
'location': 'None London',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 52500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 31,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcda4728-4826-539b-a155-03357507de2c/bcda4728-4826-539b-a155-03357507de2c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1986144,
'Height': 2803,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6525/20226525/exterior_front_driver-1774277158996.jpg',
'Width': 3737},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcda4728-4826-539b-a155-03357507de2c/bcda4728-4826-539b-a155-03357507de2c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1327455,
'Height': 2555,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6525/20226525/exterior_rear_driver-1773508990748.jpg',
'Width': 3406},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcda4728-4826-539b-a155-03357507de2c/bcda4728-4826-539b-a155-03357507de2c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1919353,
'Height': 2962,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6525/20226525/exterior_front_passenger-1773509013145.jpg',
'Width': 3949},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcda4728-4826-539b-a155-03357507de2c/bcda4728-4826-539b-a155-03357507de2c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1118732,
'Height': 2408,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6525/20226525/exterior_rear_passenger-1773509001960.jpg',
'Width': 3211},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcda4728-4826-539b-a155-03357507de2c/bcda4728-4826-539b-a155-03357507de2c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2987433,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6525/20226525/interior_front_seats-1773510262635.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcda4728-4826-539b-a155-03357507de2c/bcda4728-4826-539b-a155-03357507de2c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2465396,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6525/20226525/interior_rear_seats-1773510284650.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcda4728-4826-539b-a155-03357507de2c/bcda4728-4826-539b-a155-03357507de2c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2683930,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6525/20226525/interior_dashboard-1774704100480.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcda4728-4826-539b-a155-03357507de2c/bcda4728-4826-539b-a155-03357507de2c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 950389,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6525/20226525/instrument_cluster-1773510366114.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcda4728-4826-539b-a155-03357507de2c/bcda4728-4826-539b-a155-03357507de2c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3562112,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6525/20226525/interior_boot-1773510334305.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcda4728-4826-539b-a155-03357507de2c/bcda4728-4826-539b-a155-03357507de2c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 740107,
'Height': 2313,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/6525/20226525/docs_service_history-1774536406916.jpg?ixlib=js-3.8.0&auto=format&s=146d672a2049fd488b11a0b7c9a35716',
'Width': 3084}],
'price': 16010,
'price_includes_vat': False,
'registration_date': '2019-08-02',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Tiguan R-LINE Tech TDI S-A',
'transmission': 'automatic',
'trim': 'R-LINE Tech TDI S-A',
'vin': 'WVGZZZ5NZKW920643',
'year': 2019}
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720226525%27 HTTP/1.1" 200 None
2026-03-29 20:15:59 [motorway.uk] INFO: Saving data for 20226525: {'created_time': 1774815359.788178, 'last_price_update_time': 1774815359.788189, 'auction_closing_time': 1774884600.0}
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20226525') HTTP/1.1" 204 0
2026-03-29 20:15:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20369773.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:15:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/3228/20323228/docs_service_history-1774622193393.jpg?ixlib=js-3.8.0&auto=format&s=3787b738fe3e923b27eda39faebfd3ed> (referer: None)
2026-03-29 20:15:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/2599/18202599/18202599-docs_service_history-modified-1774782342092.jpeg?ixlib=js-3.8.0&auto=format&s=9c8a8edc6ba2b3b6308133f112272e88> (referer: None)
2026-03-29 20:15:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9861/20229861/docs_service_history-1774625941036.jpg?ixlib=js-3.8.0&auto=format&s=99b39864362e2f47cd90d6c304e0240a> (referer: None)
2026-03-29 20:15:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3228/20323228/interior_boot-1774621026641.jpg> (referer: None)
2026-03-29 20:15:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3228/20323228/instrument_cluster-1774621080448.jpg> (referer: None)
2026-03-29 20:15:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f82d223-b393-5957-92a3-09e5ad6f168c with identifier: 20369773
2026-03-29 20:15:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f82d223-b393-5957-92a3-09e5ad6f168c with scrape type 1
2026-03-29 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0f82d223-b393-5957-92a3-09e5ad6f168c
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9773%252F20369773%252Fexterior_front_driver-1774192810588.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9773/20369773/exterior_front_driver-1774192810588.jpg not downloaded yet
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:15:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9773%252F20369773%252Fexterior_rear_driver-1774192772625.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:15:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9773/20369773/exterior_rear_driver-1774192772625.jpg not downloaded yet
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9773%252F20369773%252Fexterior_front_passenger-1774192797133.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9773/20369773/exterior_front_passenger-1774192797133.jpg not downloaded yet
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a70790>
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02313ff0-ea42-5666-945a-d400fe158df8/02313ff0-ea42-5666-945a-d400fe158df8_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3228%252F20323228%252Fdocs_service_history-1774622193393.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3787b738fe3e923b27eda39faebfd3ed') HTTP/1.1" 204 0
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3228/20323228/docs_service_history-1774622193393.jpg?ixlib=js-3.8.0&auto=format&s=3787b738fe3e923b27eda39faebfd3ed saved to cache
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 02313ff0-ea42-5666-945a-d400fe158df8
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582f1b50>
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2af35cd-c25c-50cd-a86a-c4befa1bd541/b2af35cd-c25c-50cd-a86a-c4befa1bd541_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F2599%252F18202599%252F18202599-docs_service_history-modified-1774782342092.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9c8a8edc6ba2b3b6308133f112272e88') HTTP/1.1" 204 0
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/2599/18202599/18202599-docs_service_history-modified-1774782342092.jpeg?ixlib=js-3.8.0&auto=format&s=9c8a8edc6ba2b3b6308133f112272e88 saved to cache
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b2af35cd-c25c-50cd-a86a-c4befa1bd541
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9773%252F20369773%252Fexterior_rear_passenger-1774192811745.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9773/20369773/exterior_rear_passenger-1774192811745.jpg not downloaded yet
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659bc9f50>
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed1f8495-fab0-55bd-9672-eb4dafd7c693/ed1f8495-fab0-55bd-9672-eb4dafd7c693_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9861%252F20229861%252Fdocs_service_history-1774625941036.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D99b39864362e2f47cd90d6c304e0240a') HTTP/1.1" 204 0
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9861/20229861/docs_service_history-1774625941036.jpg?ixlib=js-3.8.0&auto=format&s=99b39864362e2f47cd90d6c304e0240a saved to cache
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ed1f8495-fab0-55bd-9672-eb4dafd7c693
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599ffd90>
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02313ff0-ea42-5666-945a-d400fe158df8/02313ff0-ea42-5666-945a-d400fe158df8_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3228%252F20323228%252Finterior_boot-1774621026641.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3228/20323228/interior_boot-1774621026641.jpg saved to cache
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 02313ff0-ea42-5666-945a-d400fe158df8
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e5c7d0>
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02313ff0-ea42-5666-945a-d400fe158df8/02313ff0-ea42-5666-945a-d400fe158df8_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3228%252F20323228%252Finstrument_cluster-1774621080448.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3228/20323228/instrument_cluster-1774621080448.jpg saved to cache
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 02313ff0-ea42-5666-945a-d400fe158df8
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9773%252F20369773%252Finterior_front_seats-1774193649876.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9773/20369773/interior_front_seats-1774193649876.jpg not downloaded yet
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9773%252F20369773%252Finterior_rear_seats-1774193670418.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9773/20369773/interior_rear_seats-1774193670418.jpg not downloaded yet
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9773%252F20369773%252Finterior_dashboard-1774702148826.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9773/20369773/interior_dashboard-1774702148826.jpg not downloaded yet
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9773%252F20369773%252Finstrument_cluster-1774193854946.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9773/20369773/instrument_cluster-1774193854946.jpg not downloaded yet
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9773%252F20369773%252Finterior_boot-1774193710634.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9773/20369773/interior_boot-1774193710634.jpg not downloaded yet
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9773%252F20369773%252Fdocs_service_history-1774193868302.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df7fccd8fe32c07c7138aa98c2c4e7678%27 HTTP/1.1" 200 None
2026-03-29 20:16:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9773/20369773/docs_service_history-1774193868302.jpg?ixlib=js-3.8.0&auto=format&s=f7fccd8fe32c07c7138aa98c2c4e7678 not downloaded yet
2026-03-29 20:16:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3228/20323228/interior_dashboard-1774621042797.jpg> (referer: None)
2026-03-29 20:16:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3228/20323228/interior_front_seats-1774621030101.jpg> (referer: None)
2026-03-29 20:16:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3228/20323228/interior_rear_seats-1774621024780.jpg> (referer: None)
2026-03-29 20:16:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9861/20229861/instrument_cluster-1774622363890.jpg> (referer: None)
2026-03-29 20:16:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9861/20229861/interior_boot-1774622220929.jpg> (referer: None)
2026-03-29 20:16:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19905225.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2599/18202599/18202599-interior_dashboard-modified-1774782020211.jpeg> (referer: None)
2026-03-29 20:16:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2599/18202599/damage_scratches-1774781710925.jpeg> (referer: None)
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fa9050>
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02313ff0-ea42-5666-945a-d400fe158df8/02313ff0-ea42-5666-945a-d400fe158df8_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3228%252F20323228%252Finterior_dashboard-1774621042797.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3228/20323228/interior_dashboard-1774621042797.jpg saved to cache
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 02313ff0-ea42-5666-945a-d400fe158df8
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658faa090>
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02313ff0-ea42-5666-945a-d400fe158df8/02313ff0-ea42-5666-945a-d400fe158df8_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3228%252F20323228%252Finterior_front_seats-1774621030101.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3228/20323228/interior_front_seats-1774621030101.jpg saved to cache
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 02313ff0-ea42-5666-945a-d400fe158df8
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658445d10>
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02313ff0-ea42-5666-945a-d400fe158df8/02313ff0-ea42-5666-945a-d400fe158df8_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3228%252F20323228%252Finterior_rear_seats-1774621024780.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3228/20323228/interior_rear_seats-1774621024780.jpg saved to cache
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 02313ff0-ea42-5666-945a-d400fe158df8
2026-03-29 20:16:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b21c90>
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed1f8495-fab0-55bd-9672-eb4dafd7c693/ed1f8495-fab0-55bd-9672-eb4dafd7c693_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9861%252F20229861%252Finstrument_cluster-1774622363890.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9861/20229861/instrument_cluster-1774622363890.jpg saved to cache
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ed1f8495-fab0-55bd-9672-eb4dafd7c693
2026-03-29 20:16:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf12110>
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed1f8495-fab0-55bd-9672-eb4dafd7c693/ed1f8495-fab0-55bd-9672-eb4dafd7c693_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9861%252F20229861%252Finterior_boot-1774622220929.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9861/20229861/interior_boot-1774622220929.jpg saved to cache
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ed1f8495-fab0-55bd-9672-eb4dafd7c693
2026-03-29 20:16:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ddc7e28-f2d4-53e9-a42b-17c2b30ca33d with identifier: 19905225
2026-03-29 20:16:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ddc7e28-f2d4-53e9-a42b-17c2b30ca33d with scrape type 1
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0ddc7e28-f2d4-53e9-a42b-17c2b30ca33d
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5225%252F19905225%252Fexterior_front_driver-1773315497087.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5225/19905225/exterior_front_driver-1773315497087.jpg already downloaded
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5225%252F19905225%252Fexterior_rear_driver-1771671623630.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5225/19905225/exterior_rear_driver-1771671623630.jpg already downloaded
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5225%252F19905225%252Fexterior_front_passenger-1773315523863.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5225/19905225/exterior_front_passenger-1773315523863.jpg already downloaded
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5225%252F19905225%252Fexterior_rear_passenger-1771671640896.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5225/19905225/exterior_rear_passenger-1771671640896.jpg already downloaded
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5225%252F19905225%252Finterior_front_seats-1771672231301.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5225/19905225/interior_front_seats-1771672231301.jpg already downloaded
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5225%252F19905225%252Finterior_rear_seats-1771672254282.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5225/19905225/interior_rear_seats-1771672254282.jpg already downloaded
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5225%252F19905225%252F19905225-interior_dashboard-modified-1771673175178.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5225/19905225/19905225-interior_dashboard-modified-1771673175178.jpeg already downloaded
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5225%252F19905225%252Finterior_boot-1771672302129.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5225/19905225/interior_boot-1771672302129.jpg already downloaded
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F5225%252F19905225%252F19905225-docs_service_history-modified-1773317605000.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1ac18bfdd546d47e86ab5bdcb27027c1%27 HTTP/1.1" 200 None
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/5225/19905225/19905225-docs_service_history-modified-1773317605000.jpeg?ixlib=js-3.8.0&auto=format&s=1ac18bfdd546d47e86ab5bdcb27027c1 already downloaded
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252F5225%252F19905225%252Fdocs_service_history-1771672693029.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da7a0ffd7d0f1e4d1c6cf3f166f36bd44%27 HTTP/1.1" 200 None
2026-03-29 20:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/5225/19905225/docs_service_history-1771672693029.jpg?ixlib=js-3.8.0&auto=format&s=a7a0ffd7d0f1e4d1c6cf3f166f36bd44 already downloaded
2026-03-29 20:16:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 0ddc7e28-f2d4-53e9-a42b-17c2b30ca33d, identifier: 19905225
2026-03-29 20:16:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658852e90>
2026-03-29 20:16:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2af35cd-c25c-50cd-a86a-c4befa1bd541/b2af35cd-c25c-50cd-a86a-c4befa1bd541_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2599%252F18202599%252F18202599-interior_dashboard-modified-1774782020211.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2599/18202599/18202599-interior_dashboard-modified-1774782020211.jpeg saved to cache
2026-03-29 20:16:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b2af35cd-c25c-50cd-a86a-c4befa1bd541
2026-03-29 20:16:02 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:16:02 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:16:02 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00t\xdb\xa5\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04\xe6\xe5\x00t\xd1\x01\x00\x00\x00\x00'
2026-03-29 20:16:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a72d90>
2026-03-29 20:16:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2af35cd-c25c-50cd-a86a-c4befa1bd541/b2af35cd-c25c-50cd-a86a-c4befa1bd541_image_9.mpo HTTP/1.1" 201 0
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2599%252F18202599%252Fdamage_scratches-1774781710925.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2599/18202599/damage_scratches-1774781710925.jpeg saved to cache
2026-03-29 20:16:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b2af35cd-c25c-50cd-a86a-c4befa1bd541
2026-03-29 20:16:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 0ddc7e28-f2d4-53e9-a42b-17c2b30ca33d with identifier: 19905225
2026-03-29 20:16:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 0ddc7e28-f2d4-53e9-a42b-17c2b30ca33d with identifier: 19905225
2026-03-29 20:16:02 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 0ddc7e28-f2d4-53e9-a42b-17c2b30ca33d with identifier: 19905225 to the API
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19905225.json>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '0ddc7e28-f2d4-53e9-a42b-17c2b30ca33d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'RV70 SKD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19905225',
'listing': 'auction',
'location': 'West Sussex Chichester',
'make': 'BMW',
'model': '5 Series',
'odometer': 72800,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/5225/19905225/exterior_front_driver-1773315497087.jpg',
'https://motorway-photos-redacted.imgix.net/5225/19905225/exterior_rear_driver-1771671623630.jpg',
'https://motorway-photos-redacted.imgix.net/5225/19905225/exterior_front_passenger-1773315523863.jpg',
'https://motorway-photos-redacted.imgix.net/5225/19905225/exterior_rear_passenger-1771671640896.jpg',
'https://motorway-photos.imgix.net/5225/19905225/interior_front_seats-1771672231301.jpg',
'https://motorway-photos.imgix.net/5225/19905225/interior_rear_seats-1771672254282.jpg',
'https://motorway-photos-modified.imgix.net/5225/19905225/19905225-interior_dashboard-modified-1771673175178.jpeg',
'https://motorway-photos.imgix.net/5225/19905225/interior_boot-1771672302129.jpg',
'https://motorway-service-history-photos.imgix.net/modified/5225/19905225/19905225-docs_service_history-modified-1773317605000.jpeg?ixlib=js-3.8.0&auto=format&s=1ac18bfdd546d47e86ab5bdcb27027c1',
'https://motorway-service-history-photos.imgix.net/5225/19905225/docs_service_history-1771672693029.jpg?ixlib=js-3.8.0&auto=format&s=a7a0ffd7d0f1e4d1c6cf3f166f36bd44'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6d8d11-3d49-5264-8f37-9d3ee382edc3/dd6d8d11-3d49-5264-8f37-9d3ee382edc3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1735054,
'Height': 2348,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5225/19905225/exterior_front_driver-1773315497087.jpg',
'Width': 3130},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6d8d11-3d49-5264-8f37-9d3ee382edc3/dd6d8d11-3d49-5264-8f37-9d3ee382edc3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2351853,
'Height': 2927,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5225/19905225/exterior_rear_driver-1771671623630.jpg',
'Width': 3902},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6d8d11-3d49-5264-8f37-9d3ee382edc3/dd6d8d11-3d49-5264-8f37-9d3ee382edc3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1898873,
'Height': 2425,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5225/19905225/exterior_front_passenger-1773315523863.jpg',
'Width': 3233},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6d8d11-3d49-5264-8f37-9d3ee382edc3/dd6d8d11-3d49-5264-8f37-9d3ee382edc3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2344552,
'Height': 2927,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5225/19905225/exterior_rear_passenger-1771671640896.jpg',
'Width': 3903},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6d8d11-3d49-5264-8f37-9d3ee382edc3/dd6d8d11-3d49-5264-8f37-9d3ee382edc3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4499056,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5225/19905225/interior_front_seats-1771672231301.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6d8d11-3d49-5264-8f37-9d3ee382edc3/dd6d8d11-3d49-5264-8f37-9d3ee382edc3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3635087,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5225/19905225/interior_rear_seats-1771672254282.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6d8d11-3d49-5264-8f37-9d3ee382edc3/dd6d8d11-3d49-5264-8f37-9d3ee382edc3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2156193,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5225/19905225/19905225-interior_dashboard-modified-1771673175178.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6d8d11-3d49-5264-8f37-9d3ee382edc3/dd6d8d11-3d49-5264-8f37-9d3ee382edc3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4750335,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5225/19905225/interior_boot-1771672302129.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6d8d11-3d49-5264-8f37-9d3ee382edc3/dd6d8d11-3d49-5264-8f37-9d3ee382edc3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 775321,
'Height': 3119,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/5225/19905225/19905225-docs_service_history-modified-1773317605000.jpeg?ixlib=js-3.8.0&auto=format&s=1ac18bfdd546d47e86ab5bdcb27027c1',
'Width': 2339},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd6d8d11-3d49-5264-8f37-9d3ee382edc3/dd6d8d11-3d49-5264-8f37-9d3ee382edc3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1812218,
'Height': 908,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/5225/19905225/docs_service_history-1771672693029.jpg?ixlib=js-3.8.0&auto=format&s=a7a0ffd7d0f1e4d1c6cf3f166f36bd44',
'Width': 2971}],
'price': 16601,
'price_includes_vat': False,
'registration_date': '2020-09-02',
'seats_number': None,
'seller_name': None,
'title': 'BMW 530D M Sport Auto',
'transmission': 'automatic',
'trim': '530D M Sport Auto',
'vin': 'WBAJC92010CE08826',
'year': 2020}
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719905225%27 HTTP/1.1" 200 None
2026-03-29 20:16:02 [motorway.uk] INFO: Saving data for 19905225: {'created_time': 1774815362.950429, 'last_price_update_time': 1774815362.95044, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19905225') HTTP/1.1" 204 0
2026-03-29 20:16:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9773/20369773/exterior_rear_passenger-1774192811745.jpg> (referer: None)
2026-03-29 20:16:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9773/20369773/docs_service_history-1774193868302.jpg?ixlib=js-3.8.0&auto=format&s=f7fccd8fe32c07c7138aa98c2c4e7678> (referer: None)
2026-03-29 20:16:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2599/18202599/exterior_rear_passenger-1774780742080.jpeg> (referer: None)
2026-03-29 20:16:03 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/2599/18202599/interior_boot-1774781022103.jpeg>.
2026-03-29 20:16:03 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/2599/18202599/interior_front_seats-1774780814613.jpeg>.
2026-03-29 20:16:03 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/2599/18202599/interior_rear_seats-1774781224831.jpeg>.
2026-03-29 20:16:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2599/18202599/exterior_front_passenger-1774780715810.jpeg> (referer: None)
2026-03-29 20:16:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9773/20369773/interior_boot-1774193710634.jpg> (referer: None)
2026-03-29 20:16:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2599/18202599/exterior_rear_driver-1774780785998.jpeg> (referer: None)
2026-03-29 20:16:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9773/20369773/interior_front_seats-1774193649876.jpg> (referer: None)
2026-03-29 20:16:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2599/18202599/interior_front_seats-1774780814613.jpeg> (referer: None)
2026-03-29 20:16:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2599/18202599/interior_boot-1774781022103.jpeg> (referer: None)
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584d59d0>
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f82d223-b393-5957-92a3-09e5ad6f168c/0f82d223-b393-5957-92a3-09e5ad6f168c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9773%252F20369773%252Fexterior_rear_passenger-1774192811745.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9773/20369773/exterior_rear_passenger-1774192811745.jpg saved to cache
2026-03-29 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f82d223-b393-5957-92a3-09e5ad6f168c
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659beb590>
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f82d223-b393-5957-92a3-09e5ad6f168c/0f82d223-b393-5957-92a3-09e5ad6f168c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9773%252F20369773%252Fdocs_service_history-1774193868302.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df7fccd8fe32c07c7138aa98c2c4e7678') HTTP/1.1" 204 0
2026-03-29 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9773/20369773/docs_service_history-1774193868302.jpg?ixlib=js-3.8.0&auto=format&s=f7fccd8fe32c07c7138aa98c2c4e7678 saved to cache
2026-03-29 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0f82d223-b393-5957-92a3-09e5ad6f168c
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c2a590>
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2af35cd-c25c-50cd-a86a-c4befa1bd541/b2af35cd-c25c-50cd-a86a-c4befa1bd541_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2599%252F18202599%252Fexterior_rear_passenger-1774780742080.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2599/18202599/exterior_rear_passenger-1774780742080.jpeg saved to cache
2026-03-29 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b2af35cd-c25c-50cd-a86a-c4befa1bd541
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f1e790>
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2af35cd-c25c-50cd-a86a-c4befa1bd541/b2af35cd-c25c-50cd-a86a-c4befa1bd541_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2599%252F18202599%252Fexterior_front_passenger-1774780715810.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2599/18202599/exterior_front_passenger-1774780715810.jpeg saved to cache
2026-03-29 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b2af35cd-c25c-50cd-a86a-c4befa1bd541
2026-03-29 20:16:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c63e10>
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f82d223-b393-5957-92a3-09e5ad6f168c/0f82d223-b393-5957-92a3-09e5ad6f168c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9773%252F20369773%252Finterior_boot-1774193710634.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9773/20369773/interior_boot-1774193710634.jpg saved to cache
2026-03-29 20:16:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0f82d223-b393-5957-92a3-09e5ad6f168c
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65830cc90>
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2af35cd-c25c-50cd-a86a-c4befa1bd541/b2af35cd-c25c-50cd-a86a-c4befa1bd541_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2599%252F18202599%252Fexterior_rear_driver-1774780785998.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2599/18202599/exterior_rear_driver-1774780785998.jpeg saved to cache
2026-03-29 20:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b2af35cd-c25c-50cd-a86a-c4befa1bd541
2026-03-29 20:16:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599c3d50>
2026-03-29 20:16:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f82d223-b393-5957-92a3-09e5ad6f168c/0f82d223-b393-5957-92a3-09e5ad6f168c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9773%252F20369773%252Finterior_front_seats-1774193649876.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9773/20369773/interior_front_seats-1774193649876.jpg saved to cache
2026-03-29 20:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f82d223-b393-5957-92a3-09e5ad6f168c
2026-03-29 20:16:04 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:16:04 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:16:04 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xbb=\xd6\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x06\x1ao\x00\xbb3>\x00\x00\x00\x00'
2026-03-29 20:16:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659981050>
2026-03-29 20:16:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2af35cd-c25c-50cd-a86a-c4befa1bd541/b2af35cd-c25c-50cd-a86a-c4befa1bd541_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2599%252F18202599%252Finterior_front_seats-1774780814613.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2599/18202599/interior_front_seats-1774780814613.jpeg saved to cache
2026-03-29 20:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b2af35cd-c25c-50cd-a86a-c4befa1bd541
2026-03-29 20:16:04 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:16:04 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:16:04 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xcf=\x07\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\t\x9a\xed\x00\xcf2o\x00\x00\x00\x00'
2026-03-29 20:16:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f1d4d0>
2026-03-29 20:16:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2af35cd-c25c-50cd-a86a-c4befa1bd541/b2af35cd-c25c-50cd-a86a-c4befa1bd541_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2599%252F18202599%252Finterior_boot-1774781022103.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2599/18202599/interior_boot-1774781022103.jpeg saved to cache
2026-03-29 20:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b2af35cd-c25c-50cd-a86a-c4befa1bd541
2026-03-29 20:16:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9773/20369773/exterior_front_driver-1774192810588.jpg> (referer: None)
2026-03-29 20:16:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9773/20369773/exterior_front_passenger-1774192797133.jpg> (referer: None)
2026-03-29 20:16:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9773/20369773/exterior_rear_driver-1774192772625.jpg> (referer: None)
2026-03-29 20:16:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2599/18202599/interior_rear_seats-1774781224831.jpeg> (referer: None)
2026-03-29 20:16:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9773/20369773/interior_dashboard-1774702148826.jpg> (referer: None)
2026-03-29 20:16:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9773/20369773/interior_rear_seats-1774193670418.jpg> (referer: None)
2026-03-29 20:16:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9773/20369773/instrument_cluster-1774193854946.jpg> (referer: None)
2026-03-29 20:16:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9861/20229861/interior_dashboard-1774622283335.jpg> (referer: None)
2026-03-29 20:16:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2599/18202599/exterior_front_driver-1774780687958.jpeg> (referer: None)
2026-03-29 20:16:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658579550>
2026-03-29 20:16:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f82d223-b393-5957-92a3-09e5ad6f168c/0f82d223-b393-5957-92a3-09e5ad6f168c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9773%252F20369773%252Fexterior_front_driver-1774192810588.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9773/20369773/exterior_front_driver-1774192810588.jpg saved to cache
2026-03-29 20:16:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f82d223-b393-5957-92a3-09e5ad6f168c
2026-03-29 20:16:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65850cc90>
2026-03-29 20:16:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f82d223-b393-5957-92a3-09e5ad6f168c/0f82d223-b393-5957-92a3-09e5ad6f168c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9773%252F20369773%252Fexterior_front_passenger-1774192797133.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9773/20369773/exterior_front_passenger-1774192797133.jpg saved to cache
2026-03-29 20:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f82d223-b393-5957-92a3-09e5ad6f168c
2026-03-29 20:16:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d00710>
2026-03-29 20:16:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f82d223-b393-5957-92a3-09e5ad6f168c/0f82d223-b393-5957-92a3-09e5ad6f168c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9773%252F20369773%252Fexterior_rear_driver-1774192772625.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9773/20369773/exterior_rear_driver-1774192772625.jpg saved to cache
2026-03-29 20:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f82d223-b393-5957-92a3-09e5ad6f168c
2026-03-29 20:16:05 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:16:05 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:16:05 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xeb\xe5O\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\t\xf7u\x00\xeb\xda\xb7\x00\x00\x00\x00'
2026-03-29 20:16:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589d8f10>
2026-03-29 20:16:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2af35cd-c25c-50cd-a86a-c4befa1bd541/b2af35cd-c25c-50cd-a86a-c4befa1bd541_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2599%252F18202599%252Finterior_rear_seats-1774781224831.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2599/18202599/interior_rear_seats-1774781224831.jpeg saved to cache
2026-03-29 20:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b2af35cd-c25c-50cd-a86a-c4befa1bd541
2026-03-29 20:16:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d00490>
2026-03-29 20:16:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f82d223-b393-5957-92a3-09e5ad6f168c/0f82d223-b393-5957-92a3-09e5ad6f168c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9773%252F20369773%252Finterior_dashboard-1774702148826.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9773/20369773/interior_dashboard-1774702148826.jpg saved to cache
2026-03-29 20:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0f82d223-b393-5957-92a3-09e5ad6f168c
2026-03-29 20:16:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599d98d0>
2026-03-29 20:16:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f82d223-b393-5957-92a3-09e5ad6f168c/0f82d223-b393-5957-92a3-09e5ad6f168c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9773%252F20369773%252Finterior_rear_seats-1774193670418.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9773/20369773/interior_rear_seats-1774193670418.jpg saved to cache
2026-03-29 20:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f82d223-b393-5957-92a3-09e5ad6f168c
2026-03-29 20:16:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c4e310>
2026-03-29 20:16:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f82d223-b393-5957-92a3-09e5ad6f168c/0f82d223-b393-5957-92a3-09e5ad6f168c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9773%252F20369773%252Finstrument_cluster-1774193854946.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9773/20369773/instrument_cluster-1774193854946.jpg saved to cache
2026-03-29 20:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0f82d223-b393-5957-92a3-09e5ad6f168c
2026-03-29 20:16:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f82d223-b393-5957-92a3-09e5ad6f168c, skipping ID generation
2026-03-29 20:16:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f82d223-b393-5957-92a3-09e5ad6f168c with scrape type 1
2026-03-29 20:16:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f82d223-b393-5957-92a3-09e5ad6f168c sending to next pipeline
2026-03-29 20:16:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 0f82d223-b393-5957-92a3-09e5ad6f168c, identifier: 20369773
2026-03-29 20:16:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65830d0d0>
2026-03-29 20:16:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed1f8495-fab0-55bd-9672-eb4dafd7c693/ed1f8495-fab0-55bd-9672-eb4dafd7c693_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9861%252F20229861%252Finterior_dashboard-1774622283335.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9861/20229861/interior_dashboard-1774622283335.jpg saved to cache
2026-03-29 20:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ed1f8495-fab0-55bd-9672-eb4dafd7c693
2026-03-29 20:16:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a1f410>
2026-03-29 20:16:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2af35cd-c25c-50cd-a86a-c4befa1bd541/b2af35cd-c25c-50cd-a86a-c4befa1bd541_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2599%252F18202599%252Fexterior_front_driver-1774780687958.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2599/18202599/exterior_front_driver-1774780687958.jpeg saved to cache
2026-03-29 20:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2af35cd-c25c-50cd-a86a-c4befa1bd541
2026-03-29 20:16:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2af35cd-c25c-50cd-a86a-c4befa1bd541, skipping ID generation
2026-03-29 20:16:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2af35cd-c25c-50cd-a86a-c4befa1bd541 with scrape type 1
2026-03-29 20:16:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2af35cd-c25c-50cd-a86a-c4befa1bd541 sending to next pipeline
2026-03-29 20:16:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b2af35cd-c25c-50cd-a86a-c4befa1bd541, identifier: 18202599
2026-03-29 20:16:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 0f82d223-b393-5957-92a3-09e5ad6f168c with identifier: 20369773
2026-03-29 20:16:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 0f82d223-b393-5957-92a3-09e5ad6f168c with identifier: 20369773
2026-03-29 20:16:06 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 0f82d223-b393-5957-92a3-09e5ad6f168c with identifier: 20369773 to the API
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9773/20369773/instrument_cluster-1774193854946.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '0f82d223-b393-5957-92a3-09e5ad6f168c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'AJ23 CJU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20369773',
'listing': 'auction',
'location': 'Falkirk Larbert',
'make': 'Hyundai',
'model': 'I20',
'odometer': 19632,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f82d223-b393-5957-92a3-09e5ad6f168c/0f82d223-b393-5957-92a3-09e5ad6f168c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1321348,
'Height': 2344,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9773/20369773/exterior_front_driver-1774192810588.jpg',
'Width': 3125},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f82d223-b393-5957-92a3-09e5ad6f168c/0f82d223-b393-5957-92a3-09e5ad6f168c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1465577,
'Height': 2483,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9773/20369773/exterior_rear_driver-1774192772625.jpg',
'Width': 3311},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f82d223-b393-5957-92a3-09e5ad6f168c/0f82d223-b393-5957-92a3-09e5ad6f168c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1217117,
'Height': 2116,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9773/20369773/exterior_front_passenger-1774192797133.jpg',
'Width': 2821},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f82d223-b393-5957-92a3-09e5ad6f168c/0f82d223-b393-5957-92a3-09e5ad6f168c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1460133,
'Height': 2912,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9773/20369773/exterior_rear_passenger-1774192811745.jpg',
'Width': 3882},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f82d223-b393-5957-92a3-09e5ad6f168c/0f82d223-b393-5957-92a3-09e5ad6f168c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3564491,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9773/20369773/interior_front_seats-1774193649876.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f82d223-b393-5957-92a3-09e5ad6f168c/0f82d223-b393-5957-92a3-09e5ad6f168c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2704635,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9773/20369773/interior_rear_seats-1774193670418.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f82d223-b393-5957-92a3-09e5ad6f168c/0f82d223-b393-5957-92a3-09e5ad6f168c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2453503,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9773/20369773/interior_dashboard-1774702148826.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f82d223-b393-5957-92a3-09e5ad6f168c/0f82d223-b393-5957-92a3-09e5ad6f168c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2762638,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9773/20369773/instrument_cluster-1774193854946.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f82d223-b393-5957-92a3-09e5ad6f168c/0f82d223-b393-5957-92a3-09e5ad6f168c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3039542,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9773/20369773/interior_boot-1774193710634.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f82d223-b393-5957-92a3-09e5ad6f168c/0f82d223-b393-5957-92a3-09e5ad6f168c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277126,
'Height': 1580,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9773/20369773/docs_service_history-1774193868302.jpg?ixlib=js-3.8.0&auto=format&s=f7fccd8fe32c07c7138aa98c2c4e7678',
'Width': 2255}],
'price': 12805,
'price_includes_vat': False,
'registration_date': '2023-07-15',
'seats_number': None,
'seller_name': None,
'title': 'Hyundai I20 N Line MHEV T-GDi',
'transmission': 'manual',
'trim': 'N Line MHEV T-GDi',
'vin': 'NLHBR51GLPZ333789',
'year': 2023}
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720369773%27 HTTP/1.1" 200 None
2026-03-29 20:16:06 [motorway.uk] INFO: Saving data for 20369773: {'created_time': 1774815366.694517, 'last_price_update_time': 1774815366.694527, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20369773') HTTP/1.1" 204 0
2026-03-29 20:16:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b2af35cd-c25c-50cd-a86a-c4befa1bd541 with identifier: 18202599
2026-03-29 20:16:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b2af35cd-c25c-50cd-a86a-c4befa1bd541 with identifier: 18202599
2026-03-29 20:16:06 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b2af35cd-c25c-50cd-a86a-c4befa1bd541 with identifier: 18202599 to the API
2026-03-29 20:16:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2599/18202599/exterior_front_driver-1774780687958.jpeg>
{'auction_title': '',
'category': None,
'color': 'Beige',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'b2af35cd-c25c-50cd-a86a-c4befa1bd541',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DR15 MYL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18202599',
'listing': 'auction',
'location': 'West Midlands Birmingham',
'make': 'Honda',
'model': 'HR-V',
'odometer': 28400,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2af35cd-c25c-50cd-a86a-c4befa1bd541/b2af35cd-c25c-50cd-a86a-c4befa1bd541_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4926765,
'Height': 4985,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2599/18202599/exterior_front_driver-1774780687958.jpeg',
'Width': 6646},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2af35cd-c25c-50cd-a86a-c4befa1bd541/b2af35cd-c25c-50cd-a86a-c4befa1bd541_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5853364,
'Height': 6037,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2599/18202599/exterior_rear_driver-1774780785998.jpeg',
'Width': 8049},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2af35cd-c25c-50cd-a86a-c4befa1bd541/b2af35cd-c25c-50cd-a86a-c4befa1bd541_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4981517,
'Height': 5683,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2599/18202599/exterior_front_passenger-1774780715810.jpeg',
'Width': 7577},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2af35cd-c25c-50cd-a86a-c4befa1bd541/b2af35cd-c25c-50cd-a86a-c4befa1bd541_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5428672,
'Height': 5877,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2599/18202599/exterior_rear_passenger-1774780742080.jpeg',
'Width': 7836},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2af35cd-c25c-50cd-a86a-c4befa1bd541/b2af35cd-c25c-50cd-a86a-c4befa1bd541_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 12671045,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/2599/18202599/interior_front_seats-1774780814613.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2af35cd-c25c-50cd-a86a-c4befa1bd541/b2af35cd-c25c-50cd-a86a-c4befa1bd541_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 16112836,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/2599/18202599/interior_rear_seats-1774781224831.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2af35cd-c25c-50cd-a86a-c4befa1bd541/b2af35cd-c25c-50cd-a86a-c4befa1bd541_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7870366,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2599/18202599/18202599-interior_dashboard-modified-1774782020211.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2af35cd-c25c-50cd-a86a-c4befa1bd541/b2af35cd-c25c-50cd-a86a-c4befa1bd541_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 14211060,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/2599/18202599/interior_boot-1774781022103.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2af35cd-c25c-50cd-a86a-c4befa1bd541/b2af35cd-c25c-50cd-a86a-c4befa1bd541_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 553868,
'Height': 2742,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/2599/18202599/18202599-docs_service_history-modified-1774782342092.jpeg?ixlib=js-3.8.0&auto=format&s=9c8a8edc6ba2b3b6308133f112272e88',
'Width': 2057},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2af35cd-c25c-50cd-a86a-c4befa1bd541/b2af35cd-c25c-50cd-a86a-c4befa1bd541_image_9.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 7979658,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/2599/18202599/damage_scratches-1774781710925.jpeg',
'Width': 8064}],
'price': 17385,
'price_includes_vat': False,
'registration_date': '2022-07-07',
'seats_number': None,
'seller_name': None,
'title': 'Honda HR-V Advance I-MMD CVT',
'transmission': 'automatic',
'trim': 'Advance I-MMD CVT',
'vin': 'JHMRV5830NS218859',
'year': 2022}
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718202599%27 HTTP/1.1" 200 None
2026-03-29 20:16:07 [motorway.uk] INFO: Saving data for 18202599: {'created_time': 1774815367.164714, 'last_price_update_time': 1774815367.164725, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18202599') HTTP/1.1" 204 0
2026-03-29 20:16:07 [scrapy.extensions.logstats] INFO: Crawled 248 pages (at 42 pages/min), scraped 121 items (at 19 items/min)
2026-03-29 20:16:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 304MiB
2026-03-29 20:16:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9861/20229861/exterior_rear_passenger-1774621693875.jpg> (referer: None)
2026-03-29 20:16:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3228/20323228/exterior_front_driver-1774620680004.jpg> (referer: None)
2026-03-29 20:16:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4392/20454392/exterior_front_passenger-1774687100203.jpg> (referer: None)
2026-03-29 20:16:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9861/20229861/exterior_front_passenger-1774621702892.jpg> (referer: None)
2026-03-29 20:16:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4392/20454392/exterior_rear_passenger-1774687081718.jpg> (referer: None)
2026-03-29 20:16:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3228/20323228/exterior_rear_passenger-1774620687288.jpg> (referer: None)
2026-03-29 20:16:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4392/20454392/interior_rear_seats-1774687612309.jpg> (referer: None)
2026-03-29 20:16:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9861/20229861/interior_rear_seats-1774622271791.jpg> (referer: None)
2026-03-29 20:16:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4392/20454392/interior_front_seats-1774687867043.jpg> (referer: None)
2026-03-29 20:16:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9861/20229861/interior_front_seats-1774622206199.jpg> (referer: None)
2026-03-29 20:16:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0356/9310356/exterior_front_driver-1774700348985.jpg> (referer: None)
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b165d0>
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed1f8495-fab0-55bd-9672-eb4dafd7c693/ed1f8495-fab0-55bd-9672-eb4dafd7c693_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9861%252F20229861%252Fexterior_rear_passenger-1774621693875.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9861/20229861/exterior_rear_passenger-1774621693875.jpg saved to cache
2026-03-29 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ed1f8495-fab0-55bd-9672-eb4dafd7c693
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b15250>
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02313ff0-ea42-5666-945a-d400fe158df8/02313ff0-ea42-5666-945a-d400fe158df8_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3228%252F20323228%252Fexterior_front_driver-1774620680004.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3228/20323228/exterior_front_driver-1774620680004.jpg saved to cache
2026-03-29 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 02313ff0-ea42-5666-945a-d400fe158df8
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ae5110>
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36edccab-2417-5607-912e-5fde6a5f8fe8/36edccab-2417-5607-912e-5fde6a5f8fe8_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4392%252F20454392%252Fexterior_front_passenger-1774687100203.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4392/20454392/exterior_front_passenger-1774687100203.jpg saved to cache
2026-03-29 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36edccab-2417-5607-912e-5fde6a5f8fe8
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599e0d50>
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed1f8495-fab0-55bd-9672-eb4dafd7c693/ed1f8495-fab0-55bd-9672-eb4dafd7c693_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9861%252F20229861%252Fexterior_front_passenger-1774621702892.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9861/20229861/exterior_front_passenger-1774621702892.jpg saved to cache
2026-03-29 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ed1f8495-fab0-55bd-9672-eb4dafd7c693
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65845ee90>
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36edccab-2417-5607-912e-5fde6a5f8fe8/36edccab-2417-5607-912e-5fde6a5f8fe8_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4392%252F20454392%252Fexterior_rear_passenger-1774687081718.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4392/20454392/exterior_rear_passenger-1774687081718.jpg saved to cache
2026-03-29 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36edccab-2417-5607-912e-5fde6a5f8fe8
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c396d0>
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02313ff0-ea42-5666-945a-d400fe158df8/02313ff0-ea42-5666-945a-d400fe158df8_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3228%252F20323228%252Fexterior_rear_passenger-1774620687288.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3228/20323228/exterior_rear_passenger-1774620687288.jpg saved to cache
2026-03-29 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 02313ff0-ea42-5666-945a-d400fe158df8
2026-03-29 20:16:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02313ff0-ea42-5666-945a-d400fe158df8, skipping ID generation
2026-03-29 20:16:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02313ff0-ea42-5666-945a-d400fe158df8 with scrape type 1
2026-03-29 20:16:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02313ff0-ea42-5666-945a-d400fe158df8 sending to next pipeline
2026-03-29 20:16:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 02313ff0-ea42-5666-945a-d400fe158df8, identifier: 20323228
2026-03-29 20:16:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64beef8d0>
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36edccab-2417-5607-912e-5fde6a5f8fe8/36edccab-2417-5607-912e-5fde6a5f8fe8_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4392%252F20454392%252Finterior_rear_seats-1774687612309.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4392/20454392/interior_rear_seats-1774687612309.jpg saved to cache
2026-03-29 20:16:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 36edccab-2417-5607-912e-5fde6a5f8fe8
2026-03-29 20:16:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599db650>
2026-03-29 20:16:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed1f8495-fab0-55bd-9672-eb4dafd7c693/ed1f8495-fab0-55bd-9672-eb4dafd7c693_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9861%252F20229861%252Finterior_rear_seats-1774622271791.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9861/20229861/interior_rear_seats-1774622271791.jpg saved to cache
2026-03-29 20:16:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ed1f8495-fab0-55bd-9672-eb4dafd7c693
2026-03-29 20:16:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65845ebd0>
2026-03-29 20:16:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36edccab-2417-5607-912e-5fde6a5f8fe8/36edccab-2417-5607-912e-5fde6a5f8fe8_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4392%252F20454392%252Finterior_front_seats-1774687867043.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4392/20454392/interior_front_seats-1774687867043.jpg saved to cache
2026-03-29 20:16:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36edccab-2417-5607-912e-5fde6a5f8fe8
2026-03-29 20:16:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36edccab-2417-5607-912e-5fde6a5f8fe8, skipping ID generation
2026-03-29 20:16:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36edccab-2417-5607-912e-5fde6a5f8fe8 with scrape type 1
2026-03-29 20:16:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36edccab-2417-5607-912e-5fde6a5f8fe8 sending to next pipeline
2026-03-29 20:16:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 36edccab-2417-5607-912e-5fde6a5f8fe8, identifier: 20454392
2026-03-29 20:16:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599e1c10>
2026-03-29 20:16:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed1f8495-fab0-55bd-9672-eb4dafd7c693/ed1f8495-fab0-55bd-9672-eb4dafd7c693_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9861%252F20229861%252Finterior_front_seats-1774622206199.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9861/20229861/interior_front_seats-1774622206199.jpg saved to cache
2026-03-29 20:16:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ed1f8495-fab0-55bd-9672-eb4dafd7c693
2026-03-29 20:16:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ed1f8495-fab0-55bd-9672-eb4dafd7c693, skipping ID generation
2026-03-29 20:16:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed1f8495-fab0-55bd-9672-eb4dafd7c693 with scrape type 1
2026-03-29 20:16:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ed1f8495-fab0-55bd-9672-eb4dafd7c693 sending to next pipeline
2026-03-29 20:16:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ed1f8495-fab0-55bd-9672-eb4dafd7c693, identifier: 20229861
2026-03-29 20:16:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599d24d0>
2026-03-29 20:16:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a379b3e-16e0-5e97-ab1a-a72efffafce7/3a379b3e-16e0-5e97-ab1a-a72efffafce7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0356%252F9310356%252Fexterior_front_driver-1774700348985.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0356/9310356/exterior_front_driver-1774700348985.jpg saved to cache
2026-03-29 20:16:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a379b3e-16e0-5e97-ab1a-a72efffafce7
2026-03-29 20:16:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 02313ff0-ea42-5666-945a-d400fe158df8 with identifier: 20323228
2026-03-29 20:16:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 02313ff0-ea42-5666-945a-d400fe158df8 with identifier: 20323228
2026-03-29 20:16:08 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 02313ff0-ea42-5666-945a-d400fe158df8 with identifier: 20323228 to the API
2026-03-29 20:16:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3228/20323228/exterior_rear_passenger-1774620687288.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '02313ff0-ea42-5666-945a-d400fe158df8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'Y700 ESH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20323228',
'listing': 'auction',
'location': 'Cambridgeshire Cambridge',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 88000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02313ff0-ea42-5666-945a-d400fe158df8/02313ff0-ea42-5666-945a-d400fe158df8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1327349,
'Height': 2276,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3228/20323228/exterior_front_driver-1774620680004.jpg',
'Width': 3035},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02313ff0-ea42-5666-945a-d400fe158df8/02313ff0-ea42-5666-945a-d400fe158df8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1173991,
'Height': 2180,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3228/20323228/exterior_rear_driver-1774620686558.jpg',
'Width': 2907},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02313ff0-ea42-5666-945a-d400fe158df8/02313ff0-ea42-5666-945a-d400fe158df8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1375827,
'Height': 2466,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3228/20323228/exterior_front_passenger-1774620681680.jpg',
'Width': 3288},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02313ff0-ea42-5666-945a-d400fe158df8/02313ff0-ea42-5666-945a-d400fe158df8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1489291,
'Height': 2760,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3228/20323228/exterior_rear_passenger-1774620687288.jpg',
'Width': 3680},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02313ff0-ea42-5666-945a-d400fe158df8/02313ff0-ea42-5666-945a-d400fe158df8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2264629,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/3228/20323228/interior_front_seats-1774621030101.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02313ff0-ea42-5666-945a-d400fe158df8/02313ff0-ea42-5666-945a-d400fe158df8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2354520,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/3228/20323228/interior_rear_seats-1774621024780.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02313ff0-ea42-5666-945a-d400fe158df8/02313ff0-ea42-5666-945a-d400fe158df8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2240164,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3228/20323228/interior_dashboard-1774621042797.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02313ff0-ea42-5666-945a-d400fe158df8/02313ff0-ea42-5666-945a-d400fe158df8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1897543,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3228/20323228/instrument_cluster-1774621080448.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02313ff0-ea42-5666-945a-d400fe158df8/02313ff0-ea42-5666-945a-d400fe158df8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2311244,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/3228/20323228/interior_boot-1774621026641.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02313ff0-ea42-5666-945a-d400fe158df8/02313ff0-ea42-5666-945a-d400fe158df8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 924528,
'Height': 1774,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/3228/20323228/docs_service_history-1774622193393.jpg?ixlib=js-3.8.0&auto=format&s=3787b738fe3e923b27eda39faebfd3ed',
'Width': 2365}],
'price': 9774,
'price_includes_vat': False,
'registration_date': '2018-10-04',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Passat GT TDI',
'transmission': 'manual',
'trim': 'GT TDI',
'vin': 'WVWZZZ3CZKE017385',
'year': 2018}
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720323228%27 HTTP/1.1" 200 None
2026-03-29 20:16:09 [motorway.uk] INFO: Saving data for 20323228: {'created_time': 1774815369.158697, 'last_price_update_time': 1774815369.158708, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20323228') HTTP/1.1" 204 0
2026-03-29 20:16:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 36edccab-2417-5607-912e-5fde6a5f8fe8 with identifier: 20454392
2026-03-29 20:16:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 36edccab-2417-5607-912e-5fde6a5f8fe8 with identifier: 20454392
2026-03-29 20:16:09 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 36edccab-2417-5607-912e-5fde6a5f8fe8 with identifier: 20454392 to the API
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/4392/20454392/interior_front_seats-1774687867043.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '36edccab-2417-5607-912e-5fde6a5f8fe8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HV74 XKD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20454392',
'listing': 'auction',
'location': 'None None',
'make': 'MINI',
'model': 'Cooper',
'odometer': 15243,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36edccab-2417-5607-912e-5fde6a5f8fe8/36edccab-2417-5607-912e-5fde6a5f8fe8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1129663,
'Height': 2214,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4392/20454392/exterior_front_driver-1774687122155.jpg',
'Width': 2952},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36edccab-2417-5607-912e-5fde6a5f8fe8/36edccab-2417-5607-912e-5fde6a5f8fe8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1307295,
'Height': 2196,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4392/20454392/exterior_rear_driver-1774687155784.jpg',
'Width': 2928},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36edccab-2417-5607-912e-5fde6a5f8fe8/36edccab-2417-5607-912e-5fde6a5f8fe8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 816843,
'Height': 2144,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4392/20454392/exterior_front_passenger-1774687100203.jpg',
'Width': 2859},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36edccab-2417-5607-912e-5fde6a5f8fe8/36edccab-2417-5607-912e-5fde6a5f8fe8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1172812,
'Height': 2297,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4392/20454392/exterior_rear_passenger-1774687081718.jpg',
'Width': 3063},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36edccab-2417-5607-912e-5fde6a5f8fe8/36edccab-2417-5607-912e-5fde6a5f8fe8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3056070,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4392/20454392/interior_front_seats-1774687867043.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36edccab-2417-5607-912e-5fde6a5f8fe8/36edccab-2417-5607-912e-5fde6a5f8fe8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2707514,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4392/20454392/interior_rear_seats-1774687612309.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36edccab-2417-5607-912e-5fde6a5f8fe8/36edccab-2417-5607-912e-5fde6a5f8fe8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2878199,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4392/20454392/interior_dashboard-1774687896525.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36edccab-2417-5607-912e-5fde6a5f8fe8/36edccab-2417-5607-912e-5fde6a5f8fe8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2047546,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4392/20454392/instrument_cluster-1774785716297.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36edccab-2417-5607-912e-5fde6a5f8fe8/36edccab-2417-5607-912e-5fde6a5f8fe8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2837772,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4392/20454392/interior_boot-1774785704605.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36edccab-2417-5607-912e-5fde6a5f8fe8/36edccab-2417-5607-912e-5fde6a5f8fe8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271188,
'Height': 2556,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4392/20454392/docs_service_history-1774687984784.jpg?ixlib=js-3.8.0&auto=format&s=de0b49546350c294a846d9508d4f5482',
'Width': 1179}],
'price': 18802,
'price_includes_vat': False,
'registration_date': '2024-09-12',
'seats_number': None,
'seller_name': None,
'title': 'MINI Cooper Classic C Auto',
'transmission': 'automatic',
'trim': 'Classic C Auto',
'vin': 'WMW12GD0702W44503',
'year': 2024}
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720454392%27 HTTP/1.1" 200 None
2026-03-29 20:16:09 [motorway.uk] INFO: Saving data for 20454392: {'created_time': 1774815369.573294, 'last_price_update_time': 1774815369.573306, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20454392') HTTP/1.1" 204 0
2026-03-29 20:16:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ed1f8495-fab0-55bd-9672-eb4dafd7c693 with identifier: 20229861
2026-03-29 20:16:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ed1f8495-fab0-55bd-9672-eb4dafd7c693 with identifier: 20229861
2026-03-29 20:16:09 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ed1f8495-fab0-55bd-9672-eb4dafd7c693 with identifier: 20229861 to the API
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/9861/20229861/interior_front_seats-1774622206199.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'ed1f8495-fab0-55bd-9672-eb4dafd7c693',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FL17 JZR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20229861',
'listing': 'auction',
'location': 'Leicestershire Leicester',
'make': 'Ford',
'model': 'Transit',
'odometer': 138787,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed1f8495-fab0-55bd-9672-eb4dafd7c693/ed1f8495-fab0-55bd-9672-eb4dafd7c693_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1562112,
'Height': 2366,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9861/20229861/exterior_front_driver-1774621663590.jpg',
'Width': 3154},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed1f8495-fab0-55bd-9672-eb4dafd7c693/ed1f8495-fab0-55bd-9672-eb4dafd7c693_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1137014,
'Height': 2194,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9861/20229861/exterior_rear_driver-1774621676281.jpg',
'Width': 2925},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed1f8495-fab0-55bd-9672-eb4dafd7c693/ed1f8495-fab0-55bd-9672-eb4dafd7c693_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1066440,
'Height': 2096,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9861/20229861/exterior_front_passenger-1774621702892.jpg',
'Width': 2795},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed1f8495-fab0-55bd-9672-eb4dafd7c693/ed1f8495-fab0-55bd-9672-eb4dafd7c693_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 828256,
'Height': 2047,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9861/20229861/exterior_rear_passenger-1774621693875.jpg',
'Width': 2729},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed1f8495-fab0-55bd-9672-eb4dafd7c693/ed1f8495-fab0-55bd-9672-eb4dafd7c693_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3634439,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9861/20229861/interior_front_seats-1774622206199.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed1f8495-fab0-55bd-9672-eb4dafd7c693/ed1f8495-fab0-55bd-9672-eb4dafd7c693_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2973624,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9861/20229861/interior_rear_seats-1774622271791.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed1f8495-fab0-55bd-9672-eb4dafd7c693/ed1f8495-fab0-55bd-9672-eb4dafd7c693_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3288360,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9861/20229861/interior_dashboard-1774622283335.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed1f8495-fab0-55bd-9672-eb4dafd7c693/ed1f8495-fab0-55bd-9672-eb4dafd7c693_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2739944,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9861/20229861/instrument_cluster-1774622363890.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed1f8495-fab0-55bd-9672-eb4dafd7c693/ed1f8495-fab0-55bd-9672-eb4dafd7c693_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2901044,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9861/20229861/interior_boot-1774622220929.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed1f8495-fab0-55bd-9672-eb4dafd7c693/ed1f8495-fab0-55bd-9672-eb4dafd7c693_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1061475,
'Height': 3215,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9861/20229861/docs_service_history-1774625941036.jpg?ixlib=js-3.8.0&auto=format&s=99b39864362e2f47cd90d6c304e0240a',
'Width': 2405}],
'price': 5829,
'price_includes_vat': False,
'registration_date': '2017-03-31',
'seats_number': None,
'seller_name': None,
'title': 'Ford Transit Custom 310 Limited',
'transmission': 'manual',
'trim': 'Custom 310 Limited',
'vin': 'WF0ZXXTTGZHJ63047',
'year': 2017}
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720229861%27 HTTP/1.1" 200 None
2026-03-29 20:16:10 [motorway.uk] INFO: Saving data for 20229861: {'created_time': 1774815370.020537, 'last_price_update_time': 1774815370.020551, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20229861') HTTP/1.1" 204 0
2026-03-29 20:16:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2608/13722608/exterior_rear_driver-1774622927225.jpg> (referer: None)
2026-03-29 20:16:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0356/9310356/exterior_front_passenger-1774700354775.jpg> (referer: None)
2026-03-29 20:16:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2608/13722608/exterior_front_driver-1774622719386.jpg> (referer: None)
2026-03-29 20:16:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0356/9310356/exterior_rear_passenger-1774700377014.jpg> (referer: None)
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659aaa290>
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_251d721e-de81-59c2-87ff-c25a64b103e4/251d721e-de81-59c2-87ff-c25a64b103e4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2608%252F13722608%252Fexterior_rear_driver-1774622927225.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2608/13722608/exterior_rear_driver-1774622927225.jpg saved to cache
2026-03-29 20:16:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 251d721e-de81-59c2-87ff-c25a64b103e4
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d7fad0>
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a379b3e-16e0-5e97-ab1a-a72efffafce7/3a379b3e-16e0-5e97-ab1a-a72efffafce7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0356%252F9310356%252Fexterior_front_passenger-1774700354775.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0356/9310356/exterior_front_passenger-1774700354775.jpg saved to cache
2026-03-29 20:16:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a379b3e-16e0-5e97-ab1a-a72efffafce7
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf4e690>
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_251d721e-de81-59c2-87ff-c25a64b103e4/251d721e-de81-59c2-87ff-c25a64b103e4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2608%252F13722608%252Fexterior_front_driver-1774622719386.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2608/13722608/exterior_front_driver-1774622719386.jpg saved to cache
2026-03-29 20:16:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 251d721e-de81-59c2-87ff-c25a64b103e4
2026-03-29 20:16:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 251d721e-de81-59c2-87ff-c25a64b103e4, skipping ID generation
2026-03-29 20:16:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 251d721e-de81-59c2-87ff-c25a64b103e4 with scrape type 1
2026-03-29 20:16:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 251d721e-de81-59c2-87ff-c25a64b103e4 sending to next pipeline
2026-03-29 20:16:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 251d721e-de81-59c2-87ff-c25a64b103e4, identifier: 13722608
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b84510>
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a379b3e-16e0-5e97-ab1a-a72efffafce7/3a379b3e-16e0-5e97-ab1a-a72efffafce7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0356%252F9310356%252Fexterior_rear_passenger-1774700377014.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0356/9310356/exterior_rear_passenger-1774700377014.jpg saved to cache
2026-03-29 20:16:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a379b3e-16e0-5e97-ab1a-a72efffafce7
2026-03-29 20:16:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a379b3e-16e0-5e97-ab1a-a72efffafce7, skipping ID generation
2026-03-29 20:16:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a379b3e-16e0-5e97-ab1a-a72efffafce7 with scrape type 1
2026-03-29 20:16:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a379b3e-16e0-5e97-ab1a-a72efffafce7 sending to next pipeline
2026-03-29 20:16:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 3a379b3e-16e0-5e97-ab1a-a72efffafce7, identifier: 9310356
2026-03-29 20:16:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 251d721e-de81-59c2-87ff-c25a64b103e4 with identifier: 13722608
2026-03-29 20:16:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 251d721e-de81-59c2-87ff-c25a64b103e4 with identifier: 13722608
2026-03-29 20:16:10 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 251d721e-de81-59c2-87ff-c25a64b103e4 with identifier: 13722608 to the API
2026-03-29 20:16:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2608/13722608/exterior_front_driver-1774622719386.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '251d721e-de81-59c2-87ff-c25a64b103e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HV61 UKL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/13722608',
'listing': 'auction',
'location': 'Slough Slough',
'make': 'Kia',
'model': 'Picanto',
'odometer': 84098,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_251d721e-de81-59c2-87ff-c25a64b103e4/251d721e-de81-59c2-87ff-c25a64b103e4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 988194,
'Height': 2220,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2608/13722608/exterior_front_driver-1774622719386.jpg',
'Width': 2960},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_251d721e-de81-59c2-87ff-c25a64b103e4/251d721e-de81-59c2-87ff-c25a64b103e4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 719802,
'Height': 1860,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2608/13722608/exterior_rear_driver-1774622927225.jpg',
'Width': 2480},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_251d721e-de81-59c2-87ff-c25a64b103e4/251d721e-de81-59c2-87ff-c25a64b103e4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1476609,
'Height': 2267,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2608/13722608/13722608-exterior_front_passenger-modified-1774629430114.jpeg',
'Width': 3023},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_251d721e-de81-59c2-87ff-c25a64b103e4/251d721e-de81-59c2-87ff-c25a64b103e4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 727310,
'Height': 1791,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2608/13722608/exterior_rear_passenger-1774622919585.jpg',
'Width': 2388},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_251d721e-de81-59c2-87ff-c25a64b103e4/251d721e-de81-59c2-87ff-c25a64b103e4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 921625,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/2608/13722608/interior_front_seats-1774623363313.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_251d721e-de81-59c2-87ff-c25a64b103e4/251d721e-de81-59c2-87ff-c25a64b103e4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 776746,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/2608/13722608/interior_rear_seats-1774623514936.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_251d721e-de81-59c2-87ff-c25a64b103e4/251d721e-de81-59c2-87ff-c25a64b103e4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1568160,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2608/13722608/interior_dashboard-1774623337291.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_251d721e-de81-59c2-87ff-c25a64b103e4/251d721e-de81-59c2-87ff-c25a64b103e4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400569,
'Height': 1570,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2608/13722608/13722608-instrument_cluster-modified-1774628900480.jpeg',
'Width': 2094},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_251d721e-de81-59c2-87ff-c25a64b103e4/251d721e-de81-59c2-87ff-c25a64b103e4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2129840,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/2608/13722608/interior_boot-1774623237279.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_251d721e-de81-59c2-87ff-c25a64b103e4/251d721e-de81-59c2-87ff-c25a64b103e4_image_9.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2700317,
'Height': 5017,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/2608/13722608/13722608-docs_service_history-modified-1763747842167.jpeg?ixlib=js-3.8.0&auto=format&s=b727b972651a22f042049b892ef04a9e',
'Width': 6689}],
'price': 1710,
'price_includes_vat': False,
'registration_date': '2011-09-30',
'seats_number': None,
'seller_name': None,
'title': 'Kia Picanto 3',
'transmission': 'manual',
'trim': '3',
'vin': 'KNABX512LCT074620',
'year': 2011}
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713722608%27 HTTP/1.1" 200 None
2026-03-29 20:16:11 [motorway.uk] INFO: Saving data for 13722608: {'created_time': 1774815371.14385, 'last_price_update_time': 1774815371.143863, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='13722608') HTTP/1.1" 204 0
2026-03-29 20:16:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 3a379b3e-16e0-5e97-ab1a-a72efffafce7 with identifier: 9310356
2026-03-29 20:16:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 3a379b3e-16e0-5e97-ab1a-a72efffafce7 with identifier: 9310356
2026-03-29 20:16:11 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 3a379b3e-16e0-5e97-ab1a-a72efffafce7 with identifier: 9310356 to the API
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0356/9310356/exterior_rear_passenger-1774700377014.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '3a379b3e-16e0-5e97-ab1a-a72efffafce7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'DS64 SYD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/9310356',
'listing': 'auction',
'location': 'Shropshire Shifnal',
'make': 'Ford',
'model': 'Edge',
'odometer': 62384,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a379b3e-16e0-5e97-ab1a-a72efffafce7/3a379b3e-16e0-5e97-ab1a-a72efffafce7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 719642,
'Height': 2138,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0356/9310356/exterior_front_driver-1774700348985.jpg',
'Width': 2851},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a379b3e-16e0-5e97-ab1a-a72efffafce7/3a379b3e-16e0-5e97-ab1a-a72efffafce7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 553916,
'Height': 1772,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0356/9310356/exterior_rear_driver-1774700388715.jpg',
'Width': 2362},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a379b3e-16e0-5e97-ab1a-a72efffafce7/3a379b3e-16e0-5e97-ab1a-a72efffafce7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 734234,
'Height': 1935,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0356/9310356/exterior_front_passenger-1774700354775.jpg',
'Width': 2580},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a379b3e-16e0-5e97-ab1a-a72efffafce7/3a379b3e-16e0-5e97-ab1a-a72efffafce7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 992950,
'Height': 2444,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0356/9310356/exterior_rear_passenger-1774700377014.jpg',
'Width': 3258},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a379b3e-16e0-5e97-ab1a-a72efffafce7/3a379b3e-16e0-5e97-ab1a-a72efffafce7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2412238,
'Height': 3000,
'OriginUrl': 'https://motorway-photos.imgix.net/0356/9310356/interior_front_seats-1774700421845.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a379b3e-16e0-5e97-ab1a-a72efffafce7/3a379b3e-16e0-5e97-ab1a-a72efffafce7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1938134,
'Height': 3000,
'OriginUrl': 'https://motorway-photos.imgix.net/0356/9310356/interior_rear_seats-1774700490975.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a379b3e-16e0-5e97-ab1a-a72efffafce7/3a379b3e-16e0-5e97-ab1a-a72efffafce7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1922689,
'Height': 3000,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0356/9310356/interior_dashboard-1774700697258.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a379b3e-16e0-5e97-ab1a-a72efffafce7/3a379b3e-16e0-5e97-ab1a-a72efffafce7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1075738,
'Height': 3000,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0356/9310356/instrument_cluster-1774700766642.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a379b3e-16e0-5e97-ab1a-a72efffafce7/3a379b3e-16e0-5e97-ab1a-a72efffafce7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1771067,
'Height': 3000,
'OriginUrl': 'https://motorway-photos.imgix.net/0356/9310356/interior_boot-1774700551480.jpg',
'Width': 4000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a379b3e-16e0-5e97-ab1a-a72efffafce7/3a379b3e-16e0-5e97-ab1a-a72efffafce7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1606057,
'Height': 4000,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0356/9310356/docs_service_history-1774700206387.jpg?ixlib=js-3.8.0&auto=format&s=07b07a05fd06ebb8c43f8d90616f749c',
'Width': 3000}],
'price': 9810,
'price_includes_vat': False,
'registration_date': '2017-09-21',
'seats_number': None,
'seller_name': None,
'title': 'Ford Edge Zetec TDCI',
'transmission': 'manual',
'trim': 'Zetec TDCI',
'vin': '2FMTK5JA7HBC00570',
'year': 2017}
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279310356%27 HTTP/1.1" 200 None
2026-03-29 20:16:11 [motorway.uk] INFO: Saving data for 9310356: {'created_time': 1774815371.575807, 'last_price_update_time': 1774815371.57582, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='9310356') HTTP/1.1" 204 0
2026-03-29 20:16:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6192/20486192/interior_rear_seats-1774698445486.jpg> (referer: None)
2026-03-29 20:16:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6192/20486192/interior_dashboard-1774698453883.jpg> (referer: None)
2026-03-29 20:16:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6792/17966792/interior_front_seats-1774701318659.jpg> (referer: None)
2026-03-29 20:16:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6792/17966792/interior_dashboard-1774701369308.jpg> (referer: None)
2026-03-29 20:16:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7364/16437364/interior_rear_seats-1773577851322.jpg> (referer: None)
2026-03-29 20:16:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7364/16437364/interior_front_seats-1773577837674.jpg> (referer: None)
2026-03-29 20:16:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e3cc90>
2026-03-29 20:16:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f7b3332-c9a8-5982-9632-785e0dcac931/9f7b3332-c9a8-5982-9632-785e0dcac931_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6192%252F20486192%252Finterior_rear_seats-1774698445486.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6192/20486192/interior_rear_seats-1774698445486.jpg saved to cache
2026-03-29 20:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f7b3332-c9a8-5982-9632-785e0dcac931
2026-03-29 20:16:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599df490>
2026-03-29 20:16:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f7b3332-c9a8-5982-9632-785e0dcac931/9f7b3332-c9a8-5982-9632-785e0dcac931_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6192%252F20486192%252Finterior_dashboard-1774698453883.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6192/20486192/interior_dashboard-1774698453883.jpg saved to cache
2026-03-29 20:16:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f7b3332-c9a8-5982-9632-785e0dcac931
2026-03-29 20:16:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c00510>
2026-03-29 20:16:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4251d20-b9ec-570e-aeee-dadc7561c84a/e4251d20-b9ec-570e-aeee-dadc7561c84a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6792%252F17966792%252Finterior_front_seats-1774701318659.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6792/17966792/interior_front_seats-1774701318659.jpg saved to cache
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e4251d20-b9ec-570e-aeee-dadc7561c84a
2026-03-29 20:16:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65851ab50>
2026-03-29 20:16:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4251d20-b9ec-570e-aeee-dadc7561c84a/e4251d20-b9ec-570e-aeee-dadc7561c84a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6792%252F17966792%252Finterior_dashboard-1774701369308.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6792/17966792/interior_dashboard-1774701369308.jpg saved to cache
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e4251d20-b9ec-570e-aeee-dadc7561c84a
2026-03-29 20:16:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a82f90>
2026-03-29 20:16:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4928ea38-b3ec-5bec-8391-277fe036f4c0/4928ea38-b3ec-5bec-8391-277fe036f4c0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7364%252F16437364%252Finterior_rear_seats-1773577851322.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7364/16437364/interior_rear_seats-1773577851322.jpg saved to cache
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4928ea38-b3ec-5bec-8391-277fe036f4c0
2026-03-29 20:16:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c03850>
2026-03-29 20:16:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4928ea38-b3ec-5bec-8391-277fe036f4c0/4928ea38-b3ec-5bec-8391-277fe036f4c0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7364%252F16437364%252Finterior_front_seats-1773577837674.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7364/16437364/interior_front_seats-1773577837674.jpg saved to cache
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4928ea38-b3ec-5bec-8391-277fe036f4c0
2026-03-29 20:16:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4928ea38-b3ec-5bec-8391-277fe036f4c0, skipping ID generation
2026-03-29 20:16:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4928ea38-b3ec-5bec-8391-277fe036f4c0 with scrape type 1
2026-03-29 20:16:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4928ea38-b3ec-5bec-8391-277fe036f4c0 sending to next pipeline
2026-03-29 20:16:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 4928ea38-b3ec-5bec-8391-277fe036f4c0, identifier: 16437364
2026-03-29 20:16:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 4928ea38-b3ec-5bec-8391-277fe036f4c0 with identifier: 16437364
2026-03-29 20:16:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 4928ea38-b3ec-5bec-8391-277fe036f4c0 with identifier: 16437364
2026-03-29 20:16:12 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 4928ea38-b3ec-5bec-8391-277fe036f4c0 with identifier: 16437364 to the API
2026-03-29 20:16:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/7364/16437364/interior_front_seats-1773577837674.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '4928ea38-b3ec-5bec-8391-277fe036f4c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ST18 YPN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/16437364',
'listing': 'auction',
'location': 'Kingston upon Hull Hull',
'make': 'Volkswagen',
'model': 'Golf',
'odometer': 78000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec960944-23f0-5b99-8be3-6a35d6242491/ec960944-23f0-5b99-8be3-6a35d6242491_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1236317,
'Height': 2400,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7364/16437364/exterior_front_driver-1773577376967.jpg',
'Width': 3200},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec960944-23f0-5b99-8be3-6a35d6242491/ec960944-23f0-5b99-8be3-6a35d6242491_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1073430,
'Height': 2347,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7364/16437364/exterior_rear_driver-1773577392093.jpg',
'Width': 3129},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec960944-23f0-5b99-8be3-6a35d6242491/ec960944-23f0-5b99-8be3-6a35d6242491_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1568875,
'Height': 2762,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7364/16437364/exterior_front_passenger-1773577414316.jpg',
'Width': 3682},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec960944-23f0-5b99-8be3-6a35d6242491/ec960944-23f0-5b99-8be3-6a35d6242491_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1275771,
'Height': 2501,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7364/16437364/exterior_rear_passenger-1773577390871.jpg',
'Width': 3334},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4928ea38-b3ec-5bec-8391-277fe036f4c0/4928ea38-b3ec-5bec-8391-277fe036f4c0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4581994,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7364/16437364/interior_front_seats-1773577837674.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4928ea38-b3ec-5bec-8391-277fe036f4c0/4928ea38-b3ec-5bec-8391-277fe036f4c0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4561816,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7364/16437364/interior_rear_seats-1773577851322.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec960944-23f0-5b99-8be3-6a35d6242491/ec960944-23f0-5b99-8be3-6a35d6242491_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1907768,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7364/16437364/interior_dashboard-1773577869768.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec960944-23f0-5b99-8be3-6a35d6242491/ec960944-23f0-5b99-8be3-6a35d6242491_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2912786,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7364/16437364/instrument_cluster-1773577935164.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4928ea38-b3ec-5bec-8391-277fe036f4c0/4928ea38-b3ec-5bec-8391-277fe036f4c0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3257236,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7364/16437364/interior_boot-1773577952094.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4928ea38-b3ec-5bec-8391-277fe036f4c0/4928ea38-b3ec-5bec-8391-277fe036f4c0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4713304,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7364/16437364/docs_service_history-1773578596857.jpg?ixlib=js-3.8.0&auto=format&s=2d655c0e3f852fc9f1283abe84fda5b1',
'Width': 4032}],
'price': 12586,
'price_includes_vat': False,
'registration_date': '2018-06-26',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Golf GTD TDI S-A',
'transmission': 'automatic',
'trim': 'GTD TDI S-A',
'vin': 'WVWZZZAUZJW266937',
'year': 2018}
2026-03-29 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716437364%27 HTTP/1.1" 200 None
2026-03-29 20:16:13 [motorway.uk] INFO: Saving data for 16437364: {'created_time': 1774815373.175552, 'last_price_update_time': 1774815373.175565, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='16437364') HTTP/1.1" 204 0
2026-03-29 20:16:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6192/20486192/exterior_rear_passenger-1774697276104.jpg> (referer: None)
2026-03-29 20:16:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6192/20486192/interior_front_seats-1774698448144.jpg> (referer: None)
2026-03-29 20:16:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659daf2d0>
2026-03-29 20:16:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f7b3332-c9a8-5982-9632-785e0dcac931/9f7b3332-c9a8-5982-9632-785e0dcac931_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6192%252F20486192%252Fexterior_rear_passenger-1774697276104.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6192/20486192/exterior_rear_passenger-1774697276104.jpg saved to cache
2026-03-29 20:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f7b3332-c9a8-5982-9632-785e0dcac931
2026-03-29 20:16:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20285746.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20473072.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599ede10>
2026-03-29 20:16:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f7b3332-c9a8-5982-9632-785e0dcac931/9f7b3332-c9a8-5982-9632-785e0dcac931_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6192%252F20486192%252Finterior_front_seats-1774698448144.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6192/20486192/interior_front_seats-1774698448144.jpg saved to cache
2026-03-29 20:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f7b3332-c9a8-5982-9632-785e0dcac931
2026-03-29 20:16:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20487109.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/12503630.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f6e4e7a-97e6-5209-950d-fa084c9a31c7 with identifier: 20285746
2026-03-29 20:16:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f6e4e7a-97e6-5209-950d-fa084c9a31c7 with scrape type 2
2026-03-29 20:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f6e4e7a-97e6-5209-950d-fa084c9a31c7 with scrape type 2
2026-03-29 20:16:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 2f6e4e7a-97e6-5209-950d-fa084c9a31c7, identifier: 20285746
2026-03-29 20:16:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46417c7f-ce94-57cf-b348-24cfdf7ed715 with identifier: 20473072
2026-03-29 20:16:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46417c7f-ce94-57cf-b348-24cfdf7ed715 with scrape type 1
2026-03-29 20:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 46417c7f-ce94-57cf-b348-24cfdf7ed715
2026-03-29 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3072%252F20473072%252Fexterior_front_driver-1774629818728.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3072/20473072/exterior_front_driver-1774629818728.jpg not downloaded yet
2026-03-29 20:16:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 2f6e4e7a-97e6-5209-950d-fa084c9a31c7 with identifier: 20285746
2026-03-29 20:16:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 2f6e4e7a-97e6-5209-950d-fa084c9a31c7 with identifier: 20285746
2026-03-29 20:16:14 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 2f6e4e7a-97e6-5209-950d-fa084c9a31c7 with identifier: 20285746 to the API
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20285746.json>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '2f6e4e7a-97e6-5209-950d-fa084c9a31c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YL67 OPK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20285746',
'listing': 'auction',
'location': 'Oxfordshire Carterton',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 68500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 11900,
'price_includes_vat': False,
'registration_date': '2018-01-20',
'seats_number': None,
'seller_name': None,
'title': 'Skoda Kodiaq SE L TSI 4X4 S-A',
'transmission': 'automatic',
'trim': 'SE L TSI 4X4 S-A',
'vin': 'TMBMC7NS9J8028894',
'year': 2018}
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720285746%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [motorway.uk] INFO: Saving data for 20285746: {'auction_closing_time': 1774884600.0, 'created_time': 1774383573.25279, 'last_price_update_time': 1774815374.30874}
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20285746') HTTP/1.1" 204 0
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3072%252F20473072%252Fexterior_rear_driver-1774629835618.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3072/20473072/exterior_rear_driver-1774629835618.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3072%252F20473072%252Fexterior_front_passenger-1774629861424.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3072/20473072/exterior_front_passenger-1774629861424.jpg not downloaded yet
2026-03-29 20:16:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18671000.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a804157-62b7-5d59-a75c-127c3cae69cf with identifier: 20487109
2026-03-29 20:16:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a804157-62b7-5d59-a75c-127c3cae69cf with scrape type 1
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8a804157-62b7-5d59-a75c-127c3cae69cf
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7109%252F20487109%252Fexterior_front_driver-1774773572824.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7109/20487109/exterior_front_driver-1774773572824.jpg not downloaded yet
2026-03-29 20:16:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09e64e29-2a45-5210-9fcc-44cd9ba3d185 with identifier: 12503630
2026-03-29 20:16:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09e64e29-2a45-5210-9fcc-44cd9ba3d185 with scrape type 1
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 09e64e29-2a45-5210-9fcc-44cd9ba3d185
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3630%252F12503630%252Fexterior_front_driver-1774699535240.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3630/12503630/exterior_front_driver-1774699535240.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3072%252F20473072%252Fexterior_rear_passenger-1774629846471.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3072/20473072/exterior_rear_passenger-1774629846471.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7109%252F20487109%252Fexterior_rear_driver-1774773584796.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7109/20487109/exterior_rear_driver-1774773584796.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3630%252F12503630%252Fexterior_rear_driver-1774699552712.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3630/12503630/exterior_rear_driver-1774699552712.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3072%252F20473072%252Finterior_front_seats-1774632962635.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3072/20473072/interior_front_seats-1774632962635.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7109%252F20487109%252Fexterior_front_passenger-1774719358261.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7109/20487109/exterior_front_passenger-1774719358261.jpeg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3630%252F12503630%252Fexterior_front_passenger-1774699593876.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3630/12503630/exterior_front_passenger-1774699593876.jpg not downloaded yet
2026-03-29 20:16:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/5776267.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3072%252F20473072%252Finterior_rear_seats-1774630676877.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3072/20473072/interior_rear_seats-1774630676877.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7109%252F20487109%252Fexterior_rear_passenger-1774719387897.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7109/20487109/exterior_rear_passenger-1774719387897.jpeg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3630%252F12503630%252Fexterior_rear_passenger-1774699631148.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3630/12503630/exterior_rear_passenger-1774699631148.jpg not downloaded yet
2026-03-29 20:16:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20484488.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37d0d8d3-fd5b-5a71-ae79-29eb2bdb86de with identifier: 18671000
2026-03-29 20:16:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37d0d8d3-fd5b-5a71-ae79-29eb2bdb86de with scrape type 1
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 37d0d8d3-fd5b-5a71-ae79-29eb2bdb86de
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1000%252F18671000%252Fexterior_front_driver-1774264031066.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1000/18671000/exterior_front_driver-1774264031066.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3072%252F20473072%252Finterior_dashboard-1774630717057.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3072/20473072/interior_dashboard-1774630717057.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7109%252F20487109%252Finterior_front_seats-1774719417686.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7109/20487109/interior_front_seats-1774719417686.jpeg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3630%252F12503630%252Finterior_front_seats-1774700169924.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3630/12503630/interior_front_seats-1774700169924.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1000%252F18671000%252Fexterior_rear_driver-1774264047059.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1000/18671000/exterior_rear_driver-1774264047059.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3072%252F20473072%252Finterior_boot-1774630793571.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3072/20473072/interior_boot-1774630793571.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7109%252F20487109%252Finterior_rear_seats-1774719468755.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7109/20487109/interior_rear_seats-1774719468755.jpeg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3630%252F12503630%252Finterior_rear_seats-1774700105773.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3630/12503630/interior_rear_seats-1774700105773.jpg not downloaded yet
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1000%252F18671000%252Fexterior_front_passenger-1774621716661.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1000/18671000/exterior_front_passenger-1774621716661.jpg not downloaded yet
2026-03-29 20:16:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25eed2fe-0799-58dd-b3e6-2beddeac33f3 with identifier: 5776267
2026-03-29 20:16:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25eed2fe-0799-58dd-b3e6-2beddeac33f3 with scrape type 1
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 25eed2fe-0799-58dd-b3e6-2beddeac33f3
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6267%252F5776267%252Fexterior_front_driver-1774702800357.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6267/5776267/exterior_front_driver-1774702800357.jpg not downloaded yet
2026-03-29 20:16:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c49ef8e8-29f4-5674-a3d6-23c87a0478c8 with identifier: 20484488
2026-03-29 20:16:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c49ef8e8-29f4-5674-a3d6-23c87a0478c8 with scrape type 1
2026-03-29 20:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c49ef8e8-29f4-5674-a3d6-23c87a0478c8
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4488%252F20484488%252Fexterior_front_driver-1774777606964.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4488/20484488/exterior_front_driver-1774777606964.jpeg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3072%252F20473072%252Fdocs_service_history-1774631328420.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D95b928be676d38e070bd3170ac6af732%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3072/20473072/docs_service_history-1774631328420.jpg?ixlib=js-3.8.0&auto=format&s=95b928be676d38e070bd3170ac6af732 not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7109%252F20487109%252Finterior_dashboard-1774773606511.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7109/20487109/interior_dashboard-1774773606511.jpg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3630%252F12503630%252Finterior_dashboard-1774701438817.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3630/12503630/interior_dashboard-1774701438817.jpg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1000%252F18671000%252Fexterior_rear_passenger-1774621702916.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1000/18671000/exterior_rear_passenger-1774621702916.jpg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6267%252F5776267%252Fexterior_rear_driver-1774702771912.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6267/5776267/exterior_rear_driver-1774702771912.jpg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4488%252F20484488%252Fexterior_rear_driver-1774777581391.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4488/20484488/exterior_rear_driver-1774777581391.jpeg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3072%252F20473072%252Fdamage_scratches-1774629921362.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3072/20473072/damage_scratches-1774629921362.jpg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7109%252F20487109%252Finterior_boot-1774719527200.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7109/20487109/interior_boot-1774719527200.jpeg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3630%252F12503630%252Finstrument_cluster-1774700181679.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3630/12503630/instrument_cluster-1774700181679.jpg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1000%252F18671000%252Finterior_front_seats-1774265097690.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1000/18671000/interior_front_seats-1774265097690.jpg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6267%252F5776267%252Fexterior_front_passenger-1774702801763.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6267/5776267/exterior_front_passenger-1774702801763.jpg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4488%252F20484488%252Fexterior_front_passenger-1774777421754.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4488/20484488/exterior_front_passenger-1774777421754.jpeg not downloaded yet
2026-03-29 20:16:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8488/16868488/exterior_front_passenger-1774715017017.jpg> (referer: None)
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7109%252F20487109%252Fdocs_service_history-1774720047423.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D2f335374a4b66733ace6c47dbe681982%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7109/20487109/docs_service_history-1774720047423.jpeg?ixlib=js-3.8.0&auto=format&s=2f335374a4b66733ace6c47dbe681982 not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3630%252F12503630%252Finterior_boot-1774700146780.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3630/12503630/interior_boot-1774700146780.jpg not downloaded yet
2026-03-29 20:16:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6192/20486192/exterior_front_driver-1774697277492.jpg> (referer: None)
2026-03-29 20:16:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6792/17966792/exterior_front_passenger-1774690674336.jpg> (referer: None)
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1000%252F18671000%252Finterior_rear_seats-1774265118977.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1000/18671000/interior_rear_seats-1774265118977.jpg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6267%252F5776267%252Fexterior_rear_passenger-1774702791588.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6267/5776267/exterior_rear_passenger-1774702791588.jpg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4488%252F20484488%252Fexterior_rear_passenger-1774777616181.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4488/20484488/exterior_rear_passenger-1774777616181.jpeg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7109%252F20487109%252Fdocs_service_history-1774720064262.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D41f195008e30ef91adca5a71aa56b033%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7109/20487109/docs_service_history-1774720064262.jpeg?ixlib=js-3.8.0&auto=format&s=41f195008e30ef91adca5a71aa56b033 not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3630%252F12503630%252Fdocs_service_history-1774701524155.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7bc550782d9345b7b9c74775cb302af4%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3630/12503630/docs_service_history-1774701524155.jpg?ixlib=js-3.8.0&auto=format&s=7bc550782d9345b7b9c74775cb302af4 not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1000%252F18671000%252Finterior_dashboard-1774621692824.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1000/18671000/interior_dashboard-1774621692824.jpg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6267%252F5776267%252Finterior_front_seats-1774703242358.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6267/5776267/interior_front_seats-1774703242358.jpg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4488%252F20484488%252Finterior_front_seats-1774777845910.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4488/20484488/interior_front_seats-1774777845910.jpeg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1000%252F18671000%252Finstrument_cluster-1774621737781.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1000/18671000/instrument_cluster-1774621737781.jpg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6267%252F5776267%252Finterior_rear_seats-1774703253457.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6267/5776267/interior_rear_seats-1774703253457.jpg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4488%252F20484488%252Finterior_rear_seats-1774777895857.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4488/20484488/interior_rear_seats-1774777895857.jpeg not downloaded yet
2026-03-29 20:16:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659017b90>
2026-03-29 20:16:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87090821-ad15-57c6-a877-d4bdb258a2f0/87090821-ad15-57c6-a877-d4bdb258a2f0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8488%252F16868488%252Fexterior_front_passenger-1774715017017.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8488/16868488/exterior_front_passenger-1774715017017.jpg saved to cache
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 87090821-ad15-57c6-a877-d4bdb258a2f0
2026-03-29 20:16:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6192/20486192/exterior_front_passenger-1774697279651.jpg> (referer: None)
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1000%252F18671000%252Finterior_boot-1774265227331.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1000/18671000/interior_boot-1774265227331.jpg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6267%252F5776267%252Finterior_dashboard-1774703278709.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6267/5776267/interior_dashboard-1774703278709.jpg not downloaded yet
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4488%252F20484488%252Finterior_dashboard-1774778118233.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4488/20484488/interior_dashboard-1774778118233.jpeg not downloaded yet
2026-03-29 20:16:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658716f90>
2026-03-29 20:16:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f7b3332-c9a8-5982-9632-785e0dcac931/9f7b3332-c9a8-5982-9632-785e0dcac931_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6192%252F20486192%252Fexterior_front_driver-1774697277492.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6192/20486192/exterior_front_driver-1774697277492.jpg saved to cache
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f7b3332-c9a8-5982-9632-785e0dcac931
2026-03-29 20:16:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658715e90>
2026-03-29 20:16:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4251d20-b9ec-570e-aeee-dadc7561c84a/e4251d20-b9ec-570e-aeee-dadc7561c84a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6792%252F17966792%252Fexterior_front_passenger-1774690674336.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6792/17966792/exterior_front_passenger-1774690674336.jpg saved to cache
2026-03-29 20:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e4251d20-b9ec-570e-aeee-dadc7561c84a
2026-03-29 20:16:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6192/20486192/exterior_rear_driver-1774697279375.jpg> (referer: None)
2026-03-29 20:16:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3529/13753529/exterior_front_passenger-1774631955701.jpg> (referer: None)
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1000%252F18671000%252Fdocs_service_history-1774265711969.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddd3fe46036731fe3b152d2322715299d%27 HTTP/1.1" 200 None
2026-03-29 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1000/18671000/docs_service_history-1774265711969.jpg?ixlib=js-3.8.0&auto=format&s=dd3fe46036731fe3b152d2322715299d not downloaded yet
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6267%252F5776267%252Finstrument_cluster-1774703353765.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6267/5776267/instrument_cluster-1774703353765.jpg not downloaded yet
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4488%252F20484488%252Finstrument_cluster-1774778015163.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4488/20484488/instrument_cluster-1774778015163.jpeg not downloaded yet
2026-03-29 20:16:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599cd810>
2026-03-29 20:16:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f7b3332-c9a8-5982-9632-785e0dcac931/9f7b3332-c9a8-5982-9632-785e0dcac931_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6192%252F20486192%252Fexterior_front_passenger-1774697279651.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6192/20486192/exterior_front_passenger-1774697279651.jpg saved to cache
2026-03-29 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f7b3332-c9a8-5982-9632-785e0dcac931
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6267%252F5776267%252Finterior_boot-1774703297908.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6267/5776267/interior_boot-1774703297908.jpg not downloaded yet
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4488%252F20484488%252Finterior_boot-1774778119305.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4488/20484488/interior_boot-1774778119305.jpeg not downloaded yet
2026-03-29 20:16:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8331/19288331/exterior_rear_passenger-1774699782106.jpg> (referer: None)
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6267%252F5776267%252Fdocs_service_history-1774703685009.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3b0b253d7b66f8b83d3ac148e64f522f%27 HTTP/1.1" 200 None
2026-03-29 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6267/5776267/docs_service_history-1774703685009.jpg?ixlib=js-3.8.0&auto=format&s=3b0b253d7b66f8b83d3ac148e64f522f not downloaded yet
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4488%252F20484488%252Fdocs_service_history-1774782302403.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3f8f19a0d43df8d68a4adee624c49265%27 HTTP/1.1" 200 None
2026-03-29 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4488/20484488/docs_service_history-1774782302403.jpeg?ixlib=js-3.8.0&auto=format&s=3f8f19a0d43df8d68a4adee624c49265 not downloaded yet
2026-03-29 20:16:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599cc310>
2026-03-29 20:16:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f7b3332-c9a8-5982-9632-785e0dcac931/9f7b3332-c9a8-5982-9632-785e0dcac931_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6192%252F20486192%252Fexterior_rear_driver-1774697279375.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6192/20486192/exterior_rear_driver-1774697279375.jpg saved to cache
2026-03-29 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f7b3332-c9a8-5982-9632-785e0dcac931
2026-03-29 20:16:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f7b3332-c9a8-5982-9632-785e0dcac931, skipping ID generation
2026-03-29 20:16:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f7b3332-c9a8-5982-9632-785e0dcac931 with scrape type 1
2026-03-29 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f7b3332-c9a8-5982-9632-785e0dcac931 sending to next pipeline
2026-03-29 20:16:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9f7b3332-c9a8-5982-9632-785e0dcac931, identifier: 20486192
2026-03-29 20:16:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ab16d0>
2026-03-29 20:16:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28040276-8ab4-51fc-b135-c3c9ad692553/28040276-8ab4-51fc-b135-c3c9ad692553_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3529%252F13753529%252Fexterior_front_passenger-1774631955701.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3529/13753529/exterior_front_passenger-1774631955701.jpg saved to cache
2026-03-29 20:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 28040276-8ab4-51fc-b135-c3c9ad692553
2026-03-29 20:16:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9f7b3332-c9a8-5982-9632-785e0dcac931 with identifier: 20486192
2026-03-29 20:16:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9f7b3332-c9a8-5982-9632-785e0dcac931 with identifier: 20486192
2026-03-29 20:16:16 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9f7b3332-c9a8-5982-9632-785e0dcac931 with identifier: 20486192 to the API
2026-03-29 20:16:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6192/20486192/exterior_rear_driver-1774697279375.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '9f7b3332-c9a8-5982-9632-785e0dcac931',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BG19 RVZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20486192',
'listing': 'auction',
'location': 'Worcestershire Redditch',
'make': 'Ford',
'model': 'Focus',
'odometer': 37545,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f7b3332-c9a8-5982-9632-785e0dcac931/9f7b3332-c9a8-5982-9632-785e0dcac931_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2153920,
'Height': 2839,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6192/20486192/exterior_front_driver-1774697277492.jpg',
'Width': 3785},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f7b3332-c9a8-5982-9632-785e0dcac931/9f7b3332-c9a8-5982-9632-785e0dcac931_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1985038,
'Height': 2855,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6192/20486192/exterior_rear_driver-1774697279375.jpg',
'Width': 3807},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f7b3332-c9a8-5982-9632-785e0dcac931/9f7b3332-c9a8-5982-9632-785e0dcac931_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1608411,
'Height': 2574,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6192/20486192/exterior_front_passenger-1774697279651.jpg',
'Width': 3432},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f7b3332-c9a8-5982-9632-785e0dcac931/9f7b3332-c9a8-5982-9632-785e0dcac931_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1586762,
'Height': 2621,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6192/20486192/exterior_rear_passenger-1774697276104.jpg',
'Width': 3494},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f7b3332-c9a8-5982-9632-785e0dcac931/9f7b3332-c9a8-5982-9632-785e0dcac931_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2049982,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6192/20486192/interior_front_seats-1774698448144.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f7b3332-c9a8-5982-9632-785e0dcac931/9f7b3332-c9a8-5982-9632-785e0dcac931_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1766695,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6192/20486192/interior_rear_seats-1774698445486.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f7b3332-c9a8-5982-9632-785e0dcac931/9f7b3332-c9a8-5982-9632-785e0dcac931_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1964889,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6192/20486192/interior_dashboard-1774698453883.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f7b3332-c9a8-5982-9632-785e0dcac931/9f7b3332-c9a8-5982-9632-785e0dcac931_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2044983,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6192/20486192/interior_boot-1774698446440.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f7b3332-c9a8-5982-9632-785e0dcac931/9f7b3332-c9a8-5982-9632-785e0dcac931_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1328869,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6192/20486192/docs_service_history-1774698687145.jpg?ixlib=js-3.8.0&auto=format&s=61b50f39cf8546c8e1a9f6dcc2fa5a0e',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f7b3332-c9a8-5982-9632-785e0dcac931/9f7b3332-c9a8-5982-9632-785e0dcac931_image_9.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2038188,
'Height': 3000,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/6192/20486192/docs_service_history-1774703148462.jpg?ixlib=js-3.8.0&auto=format&s=434e6bf1618fce2444a6444ff6a6fb0e',
'Width': 4000}],
'price': 11676,
'price_includes_vat': False,
'registration_date': '2019-03-29',
'seats_number': None,
'seller_name': None,
'title': 'Ford Focus ST-LINE X',
'transmission': 'manual',
'trim': 'ST-LINE X',
'vin': 'WF0NXXGCHNKC43331',
'year': 2019}
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486192%27 HTTP/1.1" 200 None
2026-03-29 20:16:17 [motorway.uk] INFO: Saving data for 20486192: {'created_time': 1774815377.123231, 'last_price_update_time': 1774815377.123242, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20486192') HTTP/1.1" 204 0
2026-03-29 20:16:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6588ace50>
2026-03-29 20:16:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69703630-8ae1-5a70-b157-fbd013ce258a/69703630-8ae1-5a70-b157-fbd013ce258a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8331%252F19288331%252Fexterior_rear_passenger-1774699782106.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8331/19288331/exterior_rear_passenger-1774699782106.jpg saved to cache
2026-03-29 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 69703630-8ae1-5a70-b157-fbd013ce258a
2026-03-29 20:16:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6792/17966792/exterior_rear_driver-1774690643140.jpg> (referer: None)
2026-03-29 20:16:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3529/13753529/exterior_rear_driver-1774630121293.jpg> (referer: None)
2026-03-29 20:16:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7109/20487109/exterior_front_passenger-1774719358261.jpeg> (referer: None)
2026-03-29 20:16:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8331/19288331/interior_front_seats-1774700467573.jpg> (referer: None)
2026-03-29 20:16:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3630/12503630/exterior_front_driver-1774699535240.jpg> (referer: None)
2026-03-29 20:16:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3630/12503630/exterior_front_passenger-1774699593876.jpg> (referer: None)
2026-03-29 20:16:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6588aca90>
2026-03-29 20:16:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4251d20-b9ec-570e-aeee-dadc7561c84a/e4251d20-b9ec-570e-aeee-dadc7561c84a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6792%252F17966792%252Fexterior_rear_driver-1774690643140.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6792/17966792/exterior_rear_driver-1774690643140.jpg saved to cache
2026-03-29 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e4251d20-b9ec-570e-aeee-dadc7561c84a
2026-03-29 20:16:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4251d20-b9ec-570e-aeee-dadc7561c84a, skipping ID generation
2026-03-29 20:16:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4251d20-b9ec-570e-aeee-dadc7561c84a with scrape type 1
2026-03-29 20:16:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4251d20-b9ec-570e-aeee-dadc7561c84a sending to next pipeline
2026-03-29 20:16:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e4251d20-b9ec-570e-aeee-dadc7561c84a, identifier: 17966792
2026-03-29 20:16:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e4251d20-b9ec-570e-aeee-dadc7561c84a with identifier: 17966792
2026-03-29 20:16:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e4251d20-b9ec-570e-aeee-dadc7561c84a with identifier: 17966792
2026-03-29 20:16:17 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e4251d20-b9ec-570e-aeee-dadc7561c84a with identifier: 17966792 to the API
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6792/17966792/exterior_rear_driver-1774690643140.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'e4251d20-b9ec-570e-aeee-dadc7561c84a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SY24 XXS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17966792',
'listing': 'auction',
'location': 'Moray Lossiemouth',
'make': 'Volvo',
'model': 'XC40',
'odometer': 19042,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4251d20-b9ec-570e-aeee-dadc7561c84a/e4251d20-b9ec-570e-aeee-dadc7561c84a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1586007,
'Height': 2571,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6792/17966792/exterior_front_driver-1774690630688.jpg',
'Width': 3428},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4251d20-b9ec-570e-aeee-dadc7561c84a/e4251d20-b9ec-570e-aeee-dadc7561c84a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2659232,
'Height': 2991,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6792/17966792/exterior_rear_driver-1774690643140.jpg',
'Width': 3988},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4251d20-b9ec-570e-aeee-dadc7561c84a/e4251d20-b9ec-570e-aeee-dadc7561c84a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1754986,
'Height': 2624,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6792/17966792/exterior_front_passenger-1774690674336.jpg',
'Width': 3499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4251d20-b9ec-570e-aeee-dadc7561c84a/e4251d20-b9ec-570e-aeee-dadc7561c84a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2265911,
'Height': 2852,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6792/17966792/exterior_rear_passenger-1774690660241.jpg',
'Width': 3803},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4251d20-b9ec-570e-aeee-dadc7561c84a/e4251d20-b9ec-570e-aeee-dadc7561c84a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3194460,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6792/17966792/interior_front_seats-1774701318659.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4251d20-b9ec-570e-aeee-dadc7561c84a/e4251d20-b9ec-570e-aeee-dadc7561c84a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3306013,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6792/17966792/interior_rear_seats-1774691979273.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4251d20-b9ec-570e-aeee-dadc7561c84a/e4251d20-b9ec-570e-aeee-dadc7561c84a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3286265,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6792/17966792/interior_dashboard-1774701369308.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4251d20-b9ec-570e-aeee-dadc7561c84a/e4251d20-b9ec-570e-aeee-dadc7561c84a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2168746,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6792/17966792/instrument_cluster-1774692026764.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4251d20-b9ec-570e-aeee-dadc7561c84a/e4251d20-b9ec-570e-aeee-dadc7561c84a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4665989,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6792/17966792/interior_boot-1774701369835.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4251d20-b9ec-570e-aeee-dadc7561c84a/e4251d20-b9ec-570e-aeee-dadc7561c84a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 883658,
'Height': 2800,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6792/17966792/docs_service_history-1774692686155.jpg?ixlib=js-3.8.0&auto=format&s=267f1768edf0b6f454418aa8d8572528',
'Width': 3654}],
'price': 24987,
'price_includes_vat': False,
'registration_date': '2024-05-15',
'seats_number': None,
'seller_name': None,
'title': 'Volvo XC40 + B3 MHEV Auto',
'transmission': 'automatic',
'trim': '+ B3 MHEV Auto',
'vin': 'YV1XZK7V8S2450627',
'year': 2024}
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717966792%27 HTTP/1.1" 200 None
2026-03-29 20:16:18 [motorway.uk] INFO: Saving data for 17966792: {'created_time': 1774815378.053008, 'last_price_update_time': 1774815378.05302, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17966792') HTTP/1.1" 204 0
2026-03-29 20:16:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20228423.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658edb510>
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28040276-8ab4-51fc-b135-c3c9ad692553/28040276-8ab4-51fc-b135-c3c9ad692553_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3529%252F13753529%252Fexterior_rear_driver-1774630121293.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3529/13753529/exterior_rear_driver-1774630121293.jpg saved to cache
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 28040276-8ab4-51fc-b135-c3c9ad692553
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658714c90>
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a804157-62b7-5d59-a75c-127c3cae69cf/8a804157-62b7-5d59-a75c-127c3cae69cf_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7109%252F20487109%252Fexterior_front_passenger-1774719358261.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7109/20487109/exterior_front_passenger-1774719358261.jpeg saved to cache
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8a804157-62b7-5d59-a75c-127c3cae69cf
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658597610>
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69703630-8ae1-5a70-b157-fbd013ce258a/69703630-8ae1-5a70-b157-fbd013ce258a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8331%252F19288331%252Finterior_front_seats-1774700467573.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8331/19288331/interior_front_seats-1774700467573.jpg saved to cache
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 69703630-8ae1-5a70-b157-fbd013ce258a
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a83690>
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09e64e29-2a45-5210-9fcc-44cd9ba3d185/09e64e29-2a45-5210-9fcc-44cd9ba3d185_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3630%252F12503630%252Fexterior_front_driver-1774699535240.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3630/12503630/exterior_front_driver-1774699535240.jpg saved to cache
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09e64e29-2a45-5210-9fcc-44cd9ba3d185
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658597d50>
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09e64e29-2a45-5210-9fcc-44cd9ba3d185/09e64e29-2a45-5210-9fcc-44cd9ba3d185_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3630%252F12503630%252Fexterior_front_passenger-1774699593876.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3630/12503630/exterior_front_passenger-1774699593876.jpg saved to cache
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 09e64e29-2a45-5210-9fcc-44cd9ba3d185
2026-03-29 20:16:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20489690.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ac59938-1388-58f4-8d1e-65fa98b37738 with identifier: 20228423
2026-03-29 20:16:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ac59938-1388-58f4-8d1e-65fa98b37738 with scrape type 1
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3ac59938-1388-58f4-8d1e-65fa98b37738
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8423%252F20228423%252Fexterior_front_driver-1773422906679.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8423/20228423/exterior_front_driver-1773422906679.jpg already downloaded
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8423%252F20228423%252Fexterior_rear_driver-1773422920942.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8423/20228423/exterior_rear_driver-1773422920942.jpg already downloaded
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8423%252F20228423%252Fexterior_front_passenger-1773422946466.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8423/20228423/exterior_front_passenger-1773422946466.jpg already downloaded
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8423%252F20228423%252Fexterior_rear_passenger-1773422935003.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8423/20228423/exterior_rear_passenger-1773422935003.jpg already downloaded
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8423%252F20228423%252Finterior_front_seats-1773423351137.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8423/20228423/interior_front_seats-1773423351137.jpg already downloaded
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8423%252F20228423%252Finterior_rear_seats-1773423368337.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8423/20228423/interior_rear_seats-1773423368337.jpg already downloaded
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8423%252F20228423%252Finterior_dashboard-1773423408247.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8423/20228423/interior_dashboard-1773423408247.jpg already downloaded
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8423%252F20228423%252Finstrument_cluster-1773423448992.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8423/20228423/instrument_cluster-1773423448992.jpg already downloaded
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8423%252F20228423%252Finterior_boot-1773423413430.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8423/20228423/interior_boot-1773423413430.jpg already downloaded
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8423%252F20228423%252Fdamage_scratches-1773423022891.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8423/20228423/damage_scratches-1773423022891.jpg already downloaded
2026-03-29 20:16:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 3ac59938-1388-58f4-8d1e-65fa98b37738, identifier: 20228423
2026-03-29 20:16:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 3ac59938-1388-58f4-8d1e-65fa98b37738 with identifier: 20228423
2026-03-29 20:16:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 3ac59938-1388-58f4-8d1e-65fa98b37738 with identifier: 20228423
2026-03-29 20:16:19 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 3ac59938-1388-58f4-8d1e-65fa98b37738 with identifier: 20228423 to the API
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20228423.json>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '3ac59938-1388-58f4-8d1e-65fa98b37738',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SF02 SHA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20228423',
'listing': 'auction',
'location': 'Neath Port Talbot Neath',
'make': 'Audi',
'model': 'TT',
'odometer': 89700,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/8423/20228423/exterior_front_driver-1773422906679.jpg',
'https://motorway-photos-redacted.imgix.net/8423/20228423/exterior_rear_driver-1773422920942.jpg',
'https://motorway-photos-redacted.imgix.net/8423/20228423/exterior_front_passenger-1773422946466.jpg',
'https://motorway-photos-redacted.imgix.net/8423/20228423/exterior_rear_passenger-1773422935003.jpg',
'https://motorway-photos.imgix.net/8423/20228423/interior_front_seats-1773423351137.jpg',
'https://motorway-photos.imgix.net/8423/20228423/interior_rear_seats-1773423368337.jpg',
'https://motorway-photos-redacted.imgix.net/8423/20228423/interior_dashboard-1773423408247.jpg',
'https://motorway-photos-redacted.imgix.net/8423/20228423/instrument_cluster-1773423448992.jpg',
'https://motorway-photos.imgix.net/8423/20228423/interior_boot-1773423413430.jpg',
'https://motorway-photos.imgix.net/8423/20228423/damage_scratches-1773423022891.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81b6cc6b-8c6a-5daf-b3ba-8db9009016ac/81b6cc6b-8c6a-5daf-b3ba-8db9009016ac_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1504903,
'Height': 2646,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8423/20228423/exterior_front_driver-1773422906679.jpg',
'Width': 3528},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81b6cc6b-8c6a-5daf-b3ba-8db9009016ac/81b6cc6b-8c6a-5daf-b3ba-8db9009016ac_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1488245,
'Height': 2612,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8423/20228423/exterior_rear_driver-1773422920942.jpg',
'Width': 3483},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81b6cc6b-8c6a-5daf-b3ba-8db9009016ac/81b6cc6b-8c6a-5daf-b3ba-8db9009016ac_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1173363,
'Height': 2540,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8423/20228423/exterior_front_passenger-1773422946466.jpg',
'Width': 3387},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81b6cc6b-8c6a-5daf-b3ba-8db9009016ac/81b6cc6b-8c6a-5daf-b3ba-8db9009016ac_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1655891,
'Height': 2763,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8423/20228423/exterior_rear_passenger-1773422935003.jpg',
'Width': 3684},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81b6cc6b-8c6a-5daf-b3ba-8db9009016ac/81b6cc6b-8c6a-5daf-b3ba-8db9009016ac_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2317519,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8423/20228423/interior_front_seats-1773423351137.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81b6cc6b-8c6a-5daf-b3ba-8db9009016ac/81b6cc6b-8c6a-5daf-b3ba-8db9009016ac_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2480169,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8423/20228423/interior_rear_seats-1773423368337.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81b6cc6b-8c6a-5daf-b3ba-8db9009016ac/81b6cc6b-8c6a-5daf-b3ba-8db9009016ac_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2972796,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8423/20228423/interior_dashboard-1773423408247.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81b6cc6b-8c6a-5daf-b3ba-8db9009016ac/81b6cc6b-8c6a-5daf-b3ba-8db9009016ac_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2338071,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8423/20228423/instrument_cluster-1773423448992.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81b6cc6b-8c6a-5daf-b3ba-8db9009016ac/81b6cc6b-8c6a-5daf-b3ba-8db9009016ac_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2879931,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8423/20228423/interior_boot-1773423413430.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81b6cc6b-8c6a-5daf-b3ba-8db9009016ac/81b6cc6b-8c6a-5daf-b3ba-8db9009016ac_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2628776,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8423/20228423/damage_scratches-1773423022891.jpg',
'Width': 4032}],
'price': 8050,
'price_includes_vat': False,
'registration_date': '2015-03-02',
'seats_number': None,
'seller_name': None,
'title': 'Audi TT Sport TFSI',
'transmission': 'manual',
'trim': 'Sport TFSI',
'vin': 'TRUZZZFV8F1009946',
'year': 2015}
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720228423%27 HTTP/1.1" 200 None
2026-03-29 20:16:19 [motorway.uk] INFO: Saving data for 20228423: {'created_time': 1774815379.511186, 'last_price_update_time': 1774815379.511199, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20228423') HTTP/1.1" 204 0
2026-03-29 20:16:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7 with identifier: 20489690
2026-03-29 20:16:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7 with scrape type 1
2026-03-29 20:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9690%252F20489690%252Fexterior_front_driver-1774708452430.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9690/20489690/exterior_front_driver-1774708452430.jpg not downloaded yet
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9690%252F20489690%252Fexterior_rear_driver-1774708475257.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9690/20489690/exterior_rear_driver-1774708475257.jpg not downloaded yet
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9690%252F20489690%252Fexterior_front_passenger-1774708497372.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9690/20489690/exterior_front_passenger-1774708497372.jpg not downloaded yet
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9690%252F20489690%252Fexterior_rear_passenger-1774708485040.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9690/20489690/exterior_rear_passenger-1774708485040.jpg not downloaded yet
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9690%252F20489690%252Finterior_front_seats-1774710939511.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9690/20489690/interior_front_seats-1774710939511.jpg not downloaded yet
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9690%252F20489690%252Finterior_rear_seats-1774708906602.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9690/20489690/interior_rear_seats-1774708906602.jpg not downloaded yet
2026-03-29 20:16:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6267/5776267/docs_service_history-1774703685009.jpg?ixlib=js-3.8.0&auto=format&s=3b0b253d7b66f8b83d3ac148e64f522f> (referer: None)
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9690%252F20489690%252Finterior_dashboard-1774708935872.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9690/20489690/interior_dashboard-1774708935872.jpg not downloaded yet
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9690%252F20489690%252Finterior_boot-1774708982049.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9690/20489690/interior_boot-1774708982049.jpg not downloaded yet
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9690%252F20489690%252Fdamage_scratches-1774708549066.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9690/20489690/damage_scratches-1774708549066.jpg not downloaded yet
2026-03-29 20:16:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4488/20484488/interior_dashboard-1774778118233.jpeg> (referer: None)
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9690%252F20489690%252Fdamage_scratches-1774708603622.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9690/20489690/damage_scratches-1774708603622.jpg not downloaded yet
2026-03-29 20:16:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1080&page=30&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a42dd0>
2026-03-29 20:16:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25eed2fe-0799-58dd-b3e6-2beddeac33f3/25eed2fe-0799-58dd-b3e6-2beddeac33f3_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6267%252F5776267%252Fdocs_service_history-1774703685009.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3b0b253d7b66f8b83d3ac148e64f522f') HTTP/1.1" 204 0
2026-03-29 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6267/5776267/docs_service_history-1774703685009.jpg?ixlib=js-3.8.0&auto=format&s=3b0b253d7b66f8b83d3ac148e64f522f saved to cache
2026-03-29 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 25eed2fe-0799-58dd-b3e6-2beddeac33f3
2026-03-29 20:16:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6267/5776267/instrument_cluster-1774703353765.jpg> (referer: None)
2026-03-29 20:16:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4488/20484488/instrument_cluster-1774778015163.jpeg> (referer: None)
2026-03-29 20:16:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658abb610>
2026-03-29 20:16:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c49ef8e8-29f4-5674-a3d6-23c87a0478c8/c49ef8e8-29f4-5674-a3d6-23c87a0478c8_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4488%252F20484488%252Finterior_dashboard-1774778118233.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4488/20484488/interior_dashboard-1774778118233.jpeg saved to cache
2026-03-29 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c49ef8e8-29f4-5674-a3d6-23c87a0478c8
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20500109
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720500109%27 HTTP/1.1" 200 None
2026-03-29 20:16:20 [motorway.uk] INFO: Scrape type for 20500109: 1
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20492540
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 4255654
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%274255654%27 HTTP/1.1" 200 None
2026-03-29 20:16:20 [motorway.uk] INFO: Scrape type for 4255654: 1
2026-03-29 20:16:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20381378
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720381378%27 HTTP/1.1" 200 None
2026-03-29 20:16:20 [motorway.uk] INFO: Scrape type for 20381378: 1
2026-03-29 20:16:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6588322d0>
2026-03-29 20:16:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25eed2fe-0799-58dd-b3e6-2beddeac33f3/25eed2fe-0799-58dd-b3e6-2beddeac33f3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6267%252F5776267%252Finstrument_cluster-1774703353765.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6267/5776267/instrument_cluster-1774703353765.jpg saved to cache
2026-03-29 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 25eed2fe-0799-58dd-b3e6-2beddeac33f3
2026-03-29 20:16:20 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:16:20 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:16:20 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00$\x1d\x19\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02&\xbd\x00$\x12o\x00\x00\x00\x00'
2026-03-29 20:16:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b47d50>
2026-03-29 20:16:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c49ef8e8-29f4-5674-a3d6-23c87a0478c8/c49ef8e8-29f4-5674-a3d6-23c87a0478c8_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4488%252F20484488%252Finstrument_cluster-1774778015163.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4488/20484488/instrument_cluster-1774778015163.jpeg saved to cache
2026-03-29 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c49ef8e8-29f4-5674-a3d6-23c87a0478c8
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 19391206
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 12889821
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712889821%27 HTTP/1.1" 200 None
2026-03-29 20:16:20 [motorway.uk] INFO: Scrape type for 12889821: 1
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 2216003
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%272216003%27 HTTP/1.1" 200 None
2026-03-29 20:16:20 [motorway.uk] INFO: Scrape type for 2216003: 1
2026-03-29 20:16:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4488/20484488/docs_service_history-1774782302403.jpeg?ixlib=js-3.8.0&auto=format&s=3f8f19a0d43df8d68a4adee624c49265> (referer: None)
2026-03-29 20:16:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4488/20484488/interior_boot-1774778119305.jpeg> (referer: None)
2026-03-29 20:16:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1000/18671000/instrument_cluster-1774621737781.jpg> (referer: None)
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20466618
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20454779
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20175346
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720175346%27 HTTP/1.1" 200 None
2026-03-29 20:16:20 [motorway.uk] INFO: Scrape type for 20175346: 1
2026-03-29 20:16:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6267/5776267/interior_dashboard-1774703278709.jpg> (referer: None)
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20488633
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20418638
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720418638%27 HTTP/1.1" 200 None
2026-03-29 20:16:20 [motorway.uk] INFO: Scrape type for 20418638: 1
2026-03-29 20:16:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1000/18671000/interior_boot-1774265227331.jpg> (referer: None)
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20394387
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20484190
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20488957
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20381560
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20490401
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 19925842
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20301602
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20482735
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20445456
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720445456%27 HTTP/1.1" 200 None
2026-03-29 20:16:20 [motorway.uk] INFO: Scrape type for 20445456: 1
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 17007661
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717007661%27 HTTP/1.1" 200 None
2026-03-29 20:16:20 [motorway.uk] INFO: Scrape type for 17007661: 1
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 16212102
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 3155170
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20438840
2026-03-29 20:16:20 [motorway.uk] INFO: Found listing with ID: 20141953
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720141953%27 HTTP/1.1" 200 None
2026-03-29 20:16:20 [motorway.uk] INFO: Scrape type for 20141953: 1
2026-03-29 20:16:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:16:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658420750>
2026-03-29 20:16:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c49ef8e8-29f4-5674-a3d6-23c87a0478c8/c49ef8e8-29f4-5674-a3d6-23c87a0478c8_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4488%252F20484488%252Fdocs_service_history-1774782302403.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3f8f19a0d43df8d68a4adee624c49265') HTTP/1.1" 204 0
2026-03-29 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4488/20484488/docs_service_history-1774782302403.jpeg?ixlib=js-3.8.0&auto=format&s=3f8f19a0d43df8d68a4adee624c49265 saved to cache
2026-03-29 20:16:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c49ef8e8-29f4-5674-a3d6-23c87a0478c8
2026-03-29 20:16:20 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:16:20 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:16:20 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00,0\x99\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xb1i\x00,%\xef\x00\x00\x00\x00'
2026-03-29 20:16:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582cc050>
2026-03-29 20:16:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c49ef8e8-29f4-5674-a3d6-23c87a0478c8/c49ef8e8-29f4-5674-a3d6-23c87a0478c8_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4488%252F20484488%252Finterior_boot-1774778119305.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4488/20484488/interior_boot-1774778119305.jpeg saved to cache
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c49ef8e8-29f4-5674-a3d6-23c87a0478c8
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bee9110>
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d0d8d3-fd5b-5a71-ae79-29eb2bdb86de/37d0d8d3-fd5b-5a71-ae79-29eb2bdb86de_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1000%252F18671000%252Finstrument_cluster-1774621737781.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1000/18671000/instrument_cluster-1774621737781.jpg saved to cache
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 37d0d8d3-fd5b-5a71-ae79-29eb2bdb86de
2026-03-29 20:16:21 [motorway.uk] INFO: Found listing with ID: 18015367
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718015367%27 HTTP/1.1" 200 None
2026-03-29 20:16:21 [motorway.uk] INFO: Scrape type for 18015367: 1
2026-03-29 20:16:21 [motorway.uk] INFO: Found listing with ID: 3408584
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273408584%27 HTTP/1.1" 200 None
2026-03-29 20:16:21 [motorway.uk] INFO: Scrape type for 3408584: 1
2026-03-29 20:16:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64beea2d0>
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25eed2fe-0799-58dd-b3e6-2beddeac33f3/25eed2fe-0799-58dd-b3e6-2beddeac33f3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6267%252F5776267%252Finterior_dashboard-1774703278709.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6267/5776267/interior_dashboard-1774703278709.jpg saved to cache
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 25eed2fe-0799-58dd-b3e6-2beddeac33f3
2026-03-29 20:16:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e71e10>
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d0d8d3-fd5b-5a71-ae79-29eb2bdb86de/37d0d8d3-fd5b-5a71-ae79-29eb2bdb86de_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1000%252F18671000%252Finterior_boot-1774265227331.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1000/18671000/interior_boot-1774265227331.jpg saved to cache
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 37d0d8d3-fd5b-5a71-ae79-29eb2bdb86de
2026-03-29 20:16:21 [motorway.uk] INFO: Found listing with ID: 20257689
2026-03-29 20:16:21 [motorway.uk] INFO: Found listing with ID: 20465447
2026-03-29 20:16:21 [motorway.uk] INFO: Found listing with ID: 20172367
2026-03-29 20:16:21 [motorway.uk] INFO: Found listing with ID: 19146005
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719146005%27 HTTP/1.1" 200 None
2026-03-29 20:16:21 [motorway.uk] INFO: Scrape type for 19146005: 1
2026-03-29 20:16:21 [motorway.uk] INFO: Found listing with ID: 10030504
2026-03-29 20:16:21 [motorway.uk] INFO: Found listing with ID: 20428748
2026-03-29 20:16:21 [motorway.uk] INFO: Found listing with ID: 20494737
2026-03-29 20:16:21 [motorway.uk] INFO: Found listing with ID: 20445682
2026-03-29 20:16:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4488/20484488/interior_front_seats-1774777845910.jpeg> (referer: None)
2026-03-29 20:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6267/5776267/interior_boot-1774703297908.jpg> (referer: None)
2026-03-29 20:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9690/20489690/interior_front_seats-1774710939511.jpg> (referer: None)
2026-03-29 20:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4488/20484488/interior_rear_seats-1774777895857.jpeg> (referer: None)
2026-03-29 20:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9690/20489690/damage_scratches-1774708603622.jpg> (referer: None)
2026-03-29 20:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6267/5776267/interior_rear_seats-1774703253457.jpg> (referer: None)
2026-03-29 20:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9690/20489690/interior_boot-1774708982049.jpg> (referer: None)
2026-03-29 20:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9690/20489690/damage_scratches-1774708549066.jpg> (referer: None)
2026-03-29 20:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1000/18671000/docs_service_history-1774265711969.jpg?ixlib=js-3.8.0&auto=format&s=dd3fe46036731fe3b152d2322715299d> (referer: None)
2026-03-29 20:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6267/5776267/interior_front_seats-1774703242358.jpg> (referer: None)
2026-03-29 20:16:21 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:16:21 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:16:21 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x006)\xdb\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xa74\x006\x1f1\x00\x00\x00\x00'
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65bfca790>
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c49ef8e8-29f4-5674-a3d6-23c87a0478c8/c49ef8e8-29f4-5674-a3d6-23c87a0478c8_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4488%252F20484488%252Finterior_front_seats-1774777845910.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4488/20484488/interior_front_seats-1774777845910.jpeg saved to cache
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c49ef8e8-29f4-5674-a3d6-23c87a0478c8
2026-03-29 20:16:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a0c810>
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25eed2fe-0799-58dd-b3e6-2beddeac33f3/25eed2fe-0799-58dd-b3e6-2beddeac33f3_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6267%252F5776267%252Finterior_boot-1774703297908.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6267/5776267/interior_boot-1774703297908.jpg saved to cache
2026-03-29 20:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 25eed2fe-0799-58dd-b3e6-2beddeac33f3
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658b44c90>
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7/f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9690%252F20489690%252Finterior_front_seats-1774710939511.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9690/20489690/interior_front_seats-1774710939511.jpg saved to cache
2026-03-29 20:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00?\x05\x98\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xe6M\x00>\xfa\xee\x00\x00\x00\x00'
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598dfe50>
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c49ef8e8-29f4-5674-a3d6-23c87a0478c8/c49ef8e8-29f4-5674-a3d6-23c87a0478c8_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4488%252F20484488%252Finterior_rear_seats-1774777895857.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4488/20484488/interior_rear_seats-1774777895857.jpeg saved to cache
2026-03-29 20:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c49ef8e8-29f4-5674-a3d6-23c87a0478c8
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65998cc90>
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7/f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9690%252F20489690%252Fdamage_scratches-1774708603622.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9690/20489690/damage_scratches-1774708603622.jpg saved to cache
2026-03-29 20:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cc2b50>
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25eed2fe-0799-58dd-b3e6-2beddeac33f3/25eed2fe-0799-58dd-b3e6-2beddeac33f3_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6267%252F5776267%252Finterior_rear_seats-1774703253457.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6267/5776267/interior_rear_seats-1774703253457.jpg saved to cache
2026-03-29 20:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 25eed2fe-0799-58dd-b3e6-2beddeac33f3
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583f6b90>
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7/f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9690%252F20489690%252Finterior_boot-1774708982049.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9690/20489690/interior_boot-1774708982049.jpg saved to cache
2026-03-29 20:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cc21d0>
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7/f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9690%252F20489690%252Fdamage_scratches-1774708549066.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9690/20489690/damage_scratches-1774708549066.jpg saved to cache
2026-03-29 20:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cc2d90>
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d0d8d3-fd5b-5a71-ae79-29eb2bdb86de/37d0d8d3-fd5b-5a71-ae79-29eb2bdb86de_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1000%252F18671000%252Fdocs_service_history-1774265711969.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddd3fe46036731fe3b152d2322715299d') HTTP/1.1" 204 0
2026-03-29 20:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1000/18671000/docs_service_history-1774265711969.jpg?ixlib=js-3.8.0&auto=format&s=dd3fe46036731fe3b152d2322715299d saved to cache
2026-03-29 20:16:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 37d0d8d3-fd5b-5a71-ae79-29eb2bdb86de
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf41b50>
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25eed2fe-0799-58dd-b3e6-2beddeac33f3/25eed2fe-0799-58dd-b3e6-2beddeac33f3_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6267%252F5776267%252Finterior_front_seats-1774703242358.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6267/5776267/interior_front_seats-1774703242358.jpg saved to cache
2026-03-29 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 25eed2fe-0799-58dd-b3e6-2beddeac33f3
2026-03-29 20:16:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9690/20489690/interior_rear_seats-1774708906602.jpg> (referer: None)
2026-03-29 20:16:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9690/20489690/interior_dashboard-1774708935872.jpg> (referer: None)
2026-03-29 20:16:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ccd990>
2026-03-29 20:16:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7/f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9690%252F20489690%252Finterior_rear_seats-1774708906602.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9690/20489690/interior_rear_seats-1774708906602.jpg saved to cache
2026-03-29 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7
2026-03-29 20:16:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fee850>
2026-03-29 20:16:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7/f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9690%252F20489690%252Finterior_dashboard-1774708935872.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9690/20489690/interior_dashboard-1774708935872.jpg saved to cache
2026-03-29 20:16:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7
2026-03-29 20:16:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9690/20489690/exterior_rear_passenger-1774708485040.jpg> (referer: None)
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cce790>
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7/f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9690%252F20489690%252Fexterior_rear_passenger-1774708485040.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9690/20489690/exterior_rear_passenger-1774708485040.jpg saved to cache
2026-03-29 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7
2026-03-29 20:16:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9690/20489690/exterior_front_passenger-1774708497372.jpg> (referer: None)
2026-03-29 20:16:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9690/20489690/exterior_rear_driver-1774708475257.jpg> (referer: None)
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fedb90>
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7/f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9690%252F20489690%252Fexterior_front_passenger-1774708497372.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9690/20489690/exterior_front_passenger-1774708497372.jpg saved to cache
2026-03-29 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d887d0>
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7/f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9690%252F20489690%252Fexterior_rear_driver-1774708475257.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9690/20489690/exterior_rear_driver-1774708475257.jpg saved to cache
2026-03-29 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7
2026-03-29 20:16:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9690/20489690/exterior_front_driver-1774708452430.jpg> (referer: None)
2026-03-29 20:16:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1000/18671000/interior_dashboard-1774621692824.jpg> (referer: None)
2026-03-29 20:16:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20500109.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ff9b50>
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7/f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9690%252F20489690%252Fexterior_front_driver-1774708452430.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9690/20489690/exterior_front_driver-1774708452430.jpg saved to cache
2026-03-29 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7
2026-03-29 20:16:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7, skipping ID generation
2026-03-29 20:16:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7 with scrape type 1
2026-03-29 20:16:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7 sending to next pipeline
2026-03-29 20:16:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7, identifier: 20489690
2026-03-29 20:16:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7 with identifier: 20489690
2026-03-29 20:16:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7 with identifier: 20489690
2026-03-29 20:16:25 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7 with identifier: 20489690 to the API
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9690/20489690/exterior_front_driver-1774708452430.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': 'f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HG61 ZKY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20489690',
'listing': 'auction',
'location': 'None Oxted',
'make': 'Honda',
'model': 'Insight',
'odometer': 77000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7/f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1548726,
'Height': 2425,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9690/20489690/exterior_front_driver-1774708452430.jpg',
'Width': 3233},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7/f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1662215,
'Height': 2709,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9690/20489690/exterior_rear_driver-1774708475257.jpg',
'Width': 3612},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7/f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1004208,
'Height': 2075,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9690/20489690/exterior_front_passenger-1774708497372.jpg',
'Width': 2766},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7/f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1649939,
'Height': 2316,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9690/20489690/exterior_rear_passenger-1774708485040.jpg',
'Width': 3088},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7/f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2170025,
'Height': 2307,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9690/20489690/interior_front_seats-1774710939511.jpg',
'Width': 3076},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7/f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3821471,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9690/20489690/interior_rear_seats-1774708906602.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7/f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3361222,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9690/20489690/interior_dashboard-1774708935872.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7/f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3321185,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9690/20489690/interior_boot-1774708982049.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7/f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2031616,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9690/20489690/damage_scratches-1774708549066.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7/f02e1ab2-3e6d-5b2a-8e53-918eaf39bcb7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1585357,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9690/20489690/damage_scratches-1774708603622.jpg',
'Width': 4032}],
'price': 3302,
'price_includes_vat': False,
'registration_date': '2011-12-17',
'seats_number': None,
'seller_name': None,
'title': 'Honda Insight EX IMA Hybrid CVT',
'transmission': 'automatic',
'trim': 'EX IMA Hybrid CVT',
'vin': 'JHMZE2870BS212078',
'year': 2011}
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720489690%27 HTTP/1.1" 200 None
2026-03-29 20:16:25 [motorway.uk] INFO: Saving data for 20489690: {'created_time': 1774815385.610714, 'last_price_update_time': 1774815385.610724, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20489690') HTTP/1.1" 204 0
2026-03-29 20:16:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/3630/12503630/docs_service_history-1774701524155.jpg?ixlib=js-3.8.0&auto=format&s=7bc550782d9345b7b9c74775cb302af4> (referer: None)
2026-03-29 20:16:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20141953.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1116&page=31&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c70f50>
2026-03-29 20:16:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d0d8d3-fd5b-5a71-ae79-29eb2bdb86de/37d0d8d3-fd5b-5a71-ae79-29eb2bdb86de_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1000%252F18671000%252Finterior_dashboard-1774621692824.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1000/18671000/interior_dashboard-1774621692824.jpg saved to cache
2026-03-29 20:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 37d0d8d3-fd5b-5a71-ae79-29eb2bdb86de
2026-03-29 20:16:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffc41ada-3469-5224-9894-ca7faf4481cf with identifier: 20500109
2026-03-29 20:16:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffc41ada-3469-5224-9894-ca7faf4481cf with scrape type 1
2026-03-29 20:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ffc41ada-3469-5224-9894-ca7faf4481cf
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0109%252F20500109%252F20500109-exterior_front_driver-modified-1774777940297.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0109/20500109/20500109-exterior_front_driver-modified-1774777940297.jpeg not downloaded yet
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0109%252F20500109%252Fexterior_rear_driver-1774776068216.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0109/20500109/exterior_rear_driver-1774776068216.jpg not downloaded yet
2026-03-29 20:16:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658108150>
2026-03-29 20:16:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09e64e29-2a45-5210-9fcc-44cd9ba3d185/09e64e29-2a45-5210-9fcc-44cd9ba3d185_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3630%252F12503630%252Fdocs_service_history-1774701524155.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7bc550782d9345b7b9c74775cb302af4') HTTP/1.1" 204 0
2026-03-29 20:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3630/12503630/docs_service_history-1774701524155.jpg?ixlib=js-3.8.0&auto=format&s=7bc550782d9345b7b9c74775cb302af4 saved to cache
2026-03-29 20:16:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 09e64e29-2a45-5210-9fcc-44cd9ba3d185
2026-03-29 20:16:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d683d739-09d3-5192-81c1-83ed9a59adf2 with identifier: 20141953
2026-03-29 20:16:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d683d739-09d3-5192-81c1-83ed9a59adf2 with scrape type 1
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d683d739-09d3-5192-81c1-83ed9a59adf2
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1953%252F20141953%252Fexterior_front_driver-1774690197350.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1953/20141953/exterior_front_driver-1774690197350.jpg not downloaded yet
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 20255071
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720255071%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [motorway.uk] INFO: Scrape type for 20255071: 1
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0109%252F20500109%252F20500109-exterior_front_passenger-modified-1774777948338.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0109/20500109/20500109-exterior_front_passenger-modified-1774777948338.jpeg not downloaded yet
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1953%252F20141953%252Fexterior_rear_driver-1774690202921.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1953/20141953/exterior_rear_driver-1774690202921.jpg not downloaded yet
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 20418634
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 20499940
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 20473047
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720473047%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [motorway.uk] INFO: Scrape type for 20473047: 1
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0109%252F20500109%252Fexterior_rear_passenger-1774776101187.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0109/20500109/exterior_rear_passenger-1774776101187.jpg not downloaded yet
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1953%252F20141953%252Fexterior_front_passenger-1774690207822.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1953/20141953/exterior_front_passenger-1774690207822.jpg not downloaded yet
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 20441126
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 20467526
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720467526%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [motorway.uk] INFO: Scrape type for 20467526: 1
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0109%252F20500109%252Finterior_front_seats-1774776734691.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0109/20500109/interior_front_seats-1774776734691.jpg not downloaded yet
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1953%252F20141953%252Fexterior_rear_passenger-1774690201751.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1953/20141953/exterior_rear_passenger-1774690201751.jpg not downloaded yet
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 20285675
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 20295392
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 10200221
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 13316160
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713316160%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [motorway.uk] INFO: Scrape type for 13316160: 1
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0109%252F20500109%252Finterior_rear_seats-1774776751788.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0109/20500109/interior_rear_seats-1774776751788.jpg not downloaded yet
2026-03-29 20:16:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20445456.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1953%252F20141953%252Finterior_front_seats-1774695634774.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1953/20141953/interior_front_seats-1774695634774.jpg not downloaded yet
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 20479742
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 20477549
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 16662751
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 12330372
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 19684886
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 17190543
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 14032750
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714032750%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [motorway.uk] INFO: Scrape type for 14032750: 1
2026-03-29 20:16:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0109%252F20500109%252F20500109-interior_dashboard-modified-1774777972953.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0109/20500109/20500109-interior_dashboard-modified-1774777972953.jpeg not downloaded yet
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1953%252F20141953%252Finterior_rear_seats-1774695628920.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1953/20141953/interior_rear_seats-1774695628920.jpg not downloaded yet
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 20240321
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720240321%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [motorway.uk] INFO: Scrape type for 20240321: 1
2026-03-29 20:16:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7109/20487109/docs_service_history-1774720064262.jpeg?ixlib=js-3.8.0&auto=format&s=41f195008e30ef91adca5a71aa56b033> (referer: None)
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0109%252F20500109%252Finterior_boot-1774776766195.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0109/20500109/interior_boot-1774776766195.jpg not downloaded yet
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1953%252F20141953%252Finterior_dashboard-1774695600652.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1953/20141953/interior_dashboard-1774695600652.jpg not downloaded yet
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 20020846
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720020846%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [motorway.uk] INFO: Scrape type for 20020846: 1
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0109%252F20500109%252Fdocs_service_history-1774776945378.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De581dfcd06ef754c2a32319dd9f50ca6%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0109/20500109/docs_service_history-1774776945378.jpg?ixlib=js-3.8.0&auto=format&s=e581dfcd06ef754c2a32319dd9f50ca6 not downloaded yet
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1953%252F20141953%252Finterior_boot-1774695617053.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1953/20141953/interior_boot-1774695617053.jpg not downloaded yet
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 14443515
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 20470846
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 17982437
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 20156998
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720156998%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [motorway.uk] INFO: Scrape type for 20156998: 1
2026-03-29 20:16:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 489c0a9f-68f9-508b-ab83-5d1e64be4252 with identifier: 20445456
2026-03-29 20:16:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 489c0a9f-68f9-508b-ab83-5d1e64be4252 with scrape type 1
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 489c0a9f-68f9-508b-ab83-5d1e64be4252
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5456%252F20445456%252Fexterior_front_driver-1774630455262.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5456/20445456/exterior_front_driver-1774630455262.jpg not downloaded yet
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0109%252F20500109%252Fdocs_service_history-1774776952239.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0c13fe2d5ad76292e04357a555b5853e%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0109/20500109/docs_service_history-1774776952239.jpg?ixlib=js-3.8.0&auto=format&s=0c13fe2d5ad76292e04357a555b5853e not downloaded yet
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1953%252F20141953%252Fdocs_service_history-1774695764667.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db60094095c26900ddb8c54345c4640ec%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1953/20141953/docs_service_history-1774695764667.jpg?ixlib=js-3.8.0&auto=format&s=b60094095c26900ddb8c54345c4640ec not downloaded yet
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 18987203
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 5963462
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%275963462%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [motorway.uk] INFO: Scrape type for 5963462: 1
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5456%252F20445456%252Fexterior_rear_driver-1774630315131.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5456/20445456/exterior_rear_driver-1774630315131.jpg not downloaded yet
2026-03-29 20:16:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4488/20484488/exterior_rear_passenger-1774777616181.jpeg> (referer: None)
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1953%252F20141953%252Fdocs_service_history-1774695779046.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df1ee303d278e5cc7de2d5f4028cf0ab6%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1953/20141953/docs_service_history-1774695779046.jpg?ixlib=js-3.8.0&auto=format&s=f1ee303d278e5cc7de2d5f4028cf0ab6 not downloaded yet
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 17363006
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 18720332
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 20374415
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 20438823
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720438823%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [motorway.uk] INFO: Scrape type for 20438823: 1
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5456%252F20445456%252Fexterior_front_passenger-1774630352608.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5456/20445456/exterior_front_passenger-1774630352608.jpg not downloaded yet
2026-03-29 20:16:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d0a790>
2026-03-29 20:16:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a804157-62b7-5d59-a75c-127c3cae69cf/8a804157-62b7-5d59-a75c-127c3cae69cf_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7109%252F20487109%252Fdocs_service_history-1774720064262.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D41f195008e30ef91adca5a71aa56b033') HTTP/1.1" 204 0
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7109/20487109/docs_service_history-1774720064262.jpeg?ixlib=js-3.8.0&auto=format&s=41f195008e30ef91adca5a71aa56b033 saved to cache
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8a804157-62b7-5d59-a75c-127c3cae69cf
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 20489356
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720489356%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [motorway.uk] INFO: Scrape type for 20489356: 1
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5456%252F20445456%252Fexterior_rear_passenger-1774630325007.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5456/20445456/exterior_rear_passenger-1774630325007.jpg not downloaded yet
2026-03-29 20:16:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be60550>
2026-03-29 20:16:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c49ef8e8-29f4-5674-a3d6-23c87a0478c8/c49ef8e8-29f4-5674-a3d6-23c87a0478c8_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4488%252F20484488%252Fexterior_rear_passenger-1774777616181.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4488/20484488/exterior_rear_passenger-1774777616181.jpeg saved to cache
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c49ef8e8-29f4-5674-a3d6-23c87a0478c8
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 17446143
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 18406701
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 20403434
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 19912396
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 5587668
2026-03-29 20:16:26 [motorway.uk] INFO: Found listing with ID: 20325290
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720325290%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [motorway.uk] INFO: Scrape type for 20325290: 1
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5456%252F20445456%252Finterior_front_seats-1774630890936.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5456/20445456/interior_front_seats-1774630890936.jpg not downloaded yet
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5456%252F20445456%252Finterior_rear_seats-1774630903542.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5456/20445456/interior_rear_seats-1774630903542.jpg not downloaded yet
2026-03-29 20:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5456%252F20445456%252Finterior_dashboard-1774630945698.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5456/20445456/interior_dashboard-1774630945698.jpg not downloaded yet
2026-03-29 20:16:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/3408584.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5456%252F20445456%252Finstrument_cluster-1774631008768.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5456/20445456/instrument_cluster-1774631008768.jpg not downloaded yet
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5456%252F20445456%252Finterior_boot-1774630954937.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5456/20445456/interior_boot-1774630954937.jpg not downloaded yet
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5456%252F20445456%252Fdocs_service_history-1774631081242.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D422533452a3709f1d2ac682dafde215b%27 HTTP/1.1" 200 None
2026-03-29 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5456/20445456/docs_service_history-1774631081242.jpg?ixlib=js-3.8.0&auto=format&s=422533452a3709f1d2ac682dafde215b not downloaded yet
2026-03-29 20:16:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6267/5776267/exterior_rear_passenger-1774702791588.jpg> (referer: None)
2026-03-29 20:16:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3630/12503630/interior_boot-1774700146780.jpg> (referer: None)
2026-03-29 20:16:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1000/18671000/interior_rear_seats-1774265118977.jpg> (referer: None)
2026-03-29 20:16:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0109/20500109/interior_rear_seats-1774776751788.jpg> (referer: None)
2026-03-29 20:16:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6a5659c-145e-52fc-ae7f-6e84f637968b with identifier: 3408584
2026-03-29 20:16:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6a5659c-145e-52fc-ae7f-6e84f637968b with scrape type 1
2026-03-29 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a6a5659c-145e-52fc-ae7f-6e84f637968b
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8584%252F3408584%252F3408584-exterior_front_driver-modified-1774710214850.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8584/3408584/3408584-exterior_front_driver-modified-1774710214850.jpeg not downloaded yet
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8584%252F3408584%252F3408584-exterior_rear_driver-modified-1774710600216.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8584/3408584/3408584-exterior_rear_driver-modified-1774710600216.jpeg not downloaded yet
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8584%252F3408584%252F3408584-exterior_front_passenger-modified-1774710609462.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8584/3408584/3408584-exterior_front_passenger-modified-1774710609462.jpeg not downloaded yet
2026-03-29 20:16:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65846d310>
2026-03-29 20:16:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25eed2fe-0799-58dd-b3e6-2beddeac33f3/25eed2fe-0799-58dd-b3e6-2beddeac33f3_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6267%252F5776267%252Fexterior_rear_passenger-1774702791588.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6267/5776267/exterior_rear_passenger-1774702791588.jpg saved to cache
2026-03-29 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 25eed2fe-0799-58dd-b3e6-2beddeac33f3
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8584%252F3408584%252F3408584-exterior_rear_passenger-modified-1774710625374.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8584/3408584/3408584-exterior_rear_passenger-modified-1774710625374.jpeg not downloaded yet
2026-03-29 20:16:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19146005.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18015367.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be62b50>
2026-03-29 20:16:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09e64e29-2a45-5210-9fcc-44cd9ba3d185/09e64e29-2a45-5210-9fcc-44cd9ba3d185_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3630%252F12503630%252Finterior_boot-1774700146780.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3630/12503630/interior_boot-1774700146780.jpg saved to cache
2026-03-29 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 09e64e29-2a45-5210-9fcc-44cd9ba3d185
2026-03-29 20:16:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599a4750>
2026-03-29 20:16:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d0d8d3-fd5b-5a71-ae79-29eb2bdb86de/37d0d8d3-fd5b-5a71-ae79-29eb2bdb86de_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1000%252F18671000%252Finterior_rear_seats-1774265118977.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1000/18671000/interior_rear_seats-1774265118977.jpg saved to cache
2026-03-29 20:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 37d0d8d3-fd5b-5a71-ae79-29eb2bdb86de
2026-03-29 20:16:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d46290>
2026-03-29 20:16:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc41ada-3469-5224-9894-ca7faf4481cf/ffc41ada-3469-5224-9894-ca7faf4481cf_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0109%252F20500109%252Finterior_rear_seats-1774776751788.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0109/20500109/interior_rear_seats-1774776751788.jpg saved to cache
2026-03-29 20:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ffc41ada-3469-5224-9894-ca7faf4481cf
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8584%252F3408584%252F3408584-interior_front_seats-modified-1774710646048.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8584/3408584/3408584-interior_front_seats-modified-1774710646048.jpeg not downloaded yet
2026-03-29 20:16:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5456/20445456/exterior_rear_driver-1774630315131.jpg> (referer: None)
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8584%252F3408584%252Finterior_rear_seats-1774632051933.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8584/3408584/interior_rear_seats-1774632051933.jpg not downloaded yet
2026-03-29 20:16:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fba2876-029d-56bd-924c-405078fd841a with identifier: 19146005
2026-03-29 20:16:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fba2876-029d-56bd-924c-405078fd841a with scrape type 1
2026-03-29 20:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7fba2876-029d-56bd-924c-405078fd841a
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6005%252F19146005%252Fexterior_front_driver-1772026058238.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6005/19146005/exterior_front_driver-1772026058238.jpg already downloaded
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6005%252F19146005%252Fexterior_rear_driver-1771581011026.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6005/19146005/exterior_rear_driver-1771581011026.jpg already downloaded
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6005%252F19146005%252Fexterior_front_passenger-1771581048619.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6005/19146005/exterior_front_passenger-1771581048619.jpg already downloaded
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6005%252F19146005%252Fexterior_rear_passenger-1771581030989.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6005/19146005/exterior_rear_passenger-1771581030989.jpg already downloaded
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6005%252F19146005%252Finterior_front_seats-1771581589319.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6005/19146005/interior_front_seats-1771581589319.jpg already downloaded
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6005%252F19146005%252Finterior_rear_seats-1771581665392.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6005/19146005/interior_rear_seats-1771581665392.jpg already downloaded
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6005%252F19146005%252Finterior_dashboard-1772026070076.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6005/19146005/interior_dashboard-1772026070076.jpg already downloaded
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6005%252F19146005%252Finterior_boot-1771590477155.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6005/19146005/interior_boot-1771590477155.jpg already downloaded
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6005%252F19146005%252Fdocs_service_history-1772025974653.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7de1fdec2662acb39dc3b007a1be7c9e%27 HTTP/1.1" 200 None
2026-03-29 20:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6005/19146005/docs_service_history-1772025974653.jpg?ixlib=js-3.8.0&auto=format&s=7de1fdec2662acb39dc3b007a1be7c9e already downloaded
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6005%252F19146005%252Fdocs_service_history-1772026022378.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df438b6da8e458a54c21c7434226a9e17%27 HTTP/1.1" 200 None
2026-03-29 20:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6005/19146005/docs_service_history-1772026022378.jpg?ixlib=js-3.8.0&auto=format&s=f438b6da8e458a54c21c7434226a9e17 already downloaded
2026-03-29 20:16:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 7fba2876-029d-56bd-924c-405078fd841a, identifier: 19146005
2026-03-29 20:16:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86552590-891f-5a98-81cd-496dbf676116 with identifier: 18015367
2026-03-29 20:16:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86552590-891f-5a98-81cd-496dbf676116 with scrape type 1
2026-03-29 20:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 86552590-891f-5a98-81cd-496dbf676116
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5367%252F18015367%252Fexterior_front_driver-1774699057959.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5367/18015367/exterior_front_driver-1774699057959.jpg not downloaded yet
2026-03-29 20:16:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7fba2876-029d-56bd-924c-405078fd841a with identifier: 19146005
2026-03-29 20:16:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7fba2876-029d-56bd-924c-405078fd841a with identifier: 19146005
2026-03-29 20:16:28 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7fba2876-029d-56bd-924c-405078fd841a with identifier: 19146005 to the API
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19146005.json>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '7fba2876-029d-56bd-924c-405078fd841a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'L3 SLX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19146005',
'listing': 'auction',
'location': 'West Lothian Broxburn',
'make': 'Ford',
'model': 'Ranger',
'odometer': 58000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photo_urls': ['https://motorway-photos-modified.imgix.net/6005/19146005/exterior_front_driver-1772026058238.jpg',
'https://motorway-photos-redacted.imgix.net/6005/19146005/exterior_rear_driver-1771581011026.jpg',
'https://motorway-photos-redacted.imgix.net/6005/19146005/exterior_front_passenger-1771581048619.jpg',
'https://motorway-photos-redacted.imgix.net/6005/19146005/exterior_rear_passenger-1771581030989.jpg',
'https://motorway-photos.imgix.net/6005/19146005/interior_front_seats-1771581589319.jpg',
'https://motorway-photos.imgix.net/6005/19146005/interior_rear_seats-1771581665392.jpg',
'https://motorway-photos-modified.imgix.net/6005/19146005/interior_dashboard-1772026070076.jpg',
'https://motorway-photos.imgix.net/6005/19146005/interior_boot-1771590477155.jpg',
'https://motorway-service-history-photos.imgix.net/modified/6005/19146005/docs_service_history-1772025974653.jpg?ixlib=js-3.8.0&auto=format&s=7de1fdec2662acb39dc3b007a1be7c9e',
'https://motorway-service-history-photos.imgix.net/modified/6005/19146005/docs_service_history-1772026022378.jpg?ixlib=js-3.8.0&auto=format&s=f438b6da8e458a54c21c7434226a9e17'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffe4c79a-0106-5086-bd36-ae25a7fb5ab0/ffe4c79a-0106-5086-bd36-ae25a7fb5ab0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3214812,
'Height': 2801,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6005/19146005/exterior_front_driver-1772026058238.jpg',
'Width': 3735},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffe4c79a-0106-5086-bd36-ae25a7fb5ab0/ffe4c79a-0106-5086-bd36-ae25a7fb5ab0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1831642,
'Height': 2423,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6005/19146005/exterior_rear_driver-1771581011026.jpg',
'Width': 3231},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffe4c79a-0106-5086-bd36-ae25a7fb5ab0/ffe4c79a-0106-5086-bd36-ae25a7fb5ab0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2012581,
'Height': 2596,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6005/19146005/exterior_front_passenger-1771581048619.jpg',
'Width': 3461},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffe4c79a-0106-5086-bd36-ae25a7fb5ab0/ffe4c79a-0106-5086-bd36-ae25a7fb5ab0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2353984,
'Height': 2980,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6005/19146005/exterior_rear_passenger-1771581030989.jpg',
'Width': 3973},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffe4c79a-0106-5086-bd36-ae25a7fb5ab0/ffe4c79a-0106-5086-bd36-ae25a7fb5ab0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3868346,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6005/19146005/interior_front_seats-1771581589319.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffe4c79a-0106-5086-bd36-ae25a7fb5ab0/ffe4c79a-0106-5086-bd36-ae25a7fb5ab0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4323354,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6005/19146005/interior_rear_seats-1771581665392.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffe4c79a-0106-5086-bd36-ae25a7fb5ab0/ffe4c79a-0106-5086-bd36-ae25a7fb5ab0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2295207,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6005/19146005/interior_dashboard-1772026070076.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffe4c79a-0106-5086-bd36-ae25a7fb5ab0/ffe4c79a-0106-5086-bd36-ae25a7fb5ab0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4071119,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6005/19146005/interior_boot-1771590477155.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffe4c79a-0106-5086-bd36-ae25a7fb5ab0/ffe4c79a-0106-5086-bd36-ae25a7fb5ab0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 763122,
'Height': 3271,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/6005/19146005/docs_service_history-1772025974653.jpg?ixlib=js-3.8.0&auto=format&s=7de1fdec2662acb39dc3b007a1be7c9e',
'Width': 2453},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffe4c79a-0106-5086-bd36-ae25a7fb5ab0/ffe4c79a-0106-5086-bd36-ae25a7fb5ab0_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2303955,
'Height': 3083,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/6005/19146005/docs_service_history-1772026022378.jpg?ixlib=js-3.8.0&auto=format&s=f438b6da8e458a54c21c7434226a9e17',
'Width': 4110}],
'price': 12940,
'price_includes_vat': False,
'registration_date': '2019-09-30',
'seats_number': None,
'seller_name': None,
'title': 'Ford Ranger Limited 4X4 DCB TDCI',
'transmission': 'manual',
'trim': 'Limited 4X4 DCB TDCI',
'vin': '6FPPXXMJ2PJP18618',
'year': 2019}
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719146005%27 HTTP/1.1" 200 None
2026-03-29 20:16:29 [motorway.uk] INFO: Saving data for 19146005: {'created_time': 1774815389.110832, 'last_price_update_time': 1774815389.110843, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19146005') HTTP/1.1" 204 0
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8584%252F3408584%252F3408584-interior_dashboard-modified-1774710230324.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8584/3408584/3408584-interior_dashboard-modified-1774710230324.jpeg not downloaded yet
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5367%252F18015367%252Fexterior_rear_driver-1774633401173.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5367/18015367/exterior_rear_driver-1774633401173.jpg not downloaded yet
2026-03-29 20:16:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20418638.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587a6c90>
2026-03-29 20:16:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_489c0a9f-68f9-508b-ab83-5d1e64be4252/489c0a9f-68f9-508b-ab83-5d1e64be4252_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5456%252F20445456%252Fexterior_rear_driver-1774630315131.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5456/20445456/exterior_rear_driver-1774630315131.jpg saved to cache
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 489c0a9f-68f9-508b-ab83-5d1e64be4252
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8584%252F3408584%252Finstrument_cluster-1774632142084.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8584/3408584/instrument_cluster-1774632142084.jpg not downloaded yet
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5367%252F18015367%252Fexterior_front_passenger-1774633403776.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5367/18015367/exterior_front_passenger-1774633403776.jpg not downloaded yet
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8584%252F3408584%252Finterior_boot-1774632100159.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8584/3408584/interior_boot-1774632100159.jpg not downloaded yet
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5367%252F18015367%252Fexterior_rear_passenger-1774633402933.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5367/18015367/exterior_rear_passenger-1774633402933.jpg not downloaded yet
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8584%252F3408584%252F3408584-docs_service_history-default-1774629529626.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6cc8300a51ecc4c475a6be6f52ebf1f8%27 HTTP/1.1" 200 None
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8584/3408584/3408584-docs_service_history-default-1774629529626.jpg?ixlib=js-3.8.0&auto=format&s=6cc8300a51ecc4c475a6be6f52ebf1f8 not downloaded yet
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5367%252F18015367%252Finterior_front_seats-1774696526105.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5367/18015367/interior_front_seats-1774696526105.jpg not downloaded yet
2026-03-29 20:16:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17007661.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81bd5520-fa3a-5ba3-90b6-a772cd67f702 with identifier: 20418638
2026-03-29 20:16:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81bd5520-fa3a-5ba3-90b6-a772cd67f702 with scrape type 1
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 81bd5520-fa3a-5ba3-90b6-a772cd67f702
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8638%252F20418638%252Fexterior_front_driver-1774772715845.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8638/20418638/exterior_front_driver-1774772715845.jpg not downloaded yet
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5367%252F18015367%252Finterior_rear_seats-1774696527424.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5367/18015367/interior_rear_seats-1774696527424.jpg not downloaded yet
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8638%252F20418638%252Fexterior_rear_driver-1774772965255.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8638/20418638/exterior_rear_driver-1774772965255.jpg not downloaded yet
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5367%252F18015367%252Finterior_dashboard-1774696541795.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5367/18015367/interior_dashboard-1774696541795.jpg not downloaded yet
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8638%252F20418638%252Fexterior_front_passenger-1774772743754.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8638/20418638/exterior_front_passenger-1774772743754.jpg not downloaded yet
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5367%252F18015367%252Finstrument_cluster-1774696540134.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5367/18015367/instrument_cluster-1774696540134.jpg not downloaded yet
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8638%252F20418638%252Fexterior_rear_passenger-1774773002827.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8638/20418638/exterior_rear_passenger-1774773002827.jpg not downloaded yet
2026-03-29 20:16:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8584/3408584/3408584-exterior_front_passenger-modified-1774710609462.jpeg> (referer: None)
2026-03-29 20:16:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39808af5-a3d6-5d73-919f-c2d87b622263 with identifier: 17007661
2026-03-29 20:16:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39808af5-a3d6-5d73-919f-c2d87b622263 with scrape type 1
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 39808af5-a3d6-5d73-919f-c2d87b622263
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7661%252F17007661%252Fexterior_front_driver-1774620553456.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7661/17007661/exterior_front_driver-1774620553456.jpg not downloaded yet
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5367%252F18015367%252Finterior_boot-1774696530051.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5367/18015367/interior_boot-1774696530051.jpg not downloaded yet
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8638%252F20418638%252Finterior_front_seats-1774623670137.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8638/20418638/interior_front_seats-1774623670137.jpg not downloaded yet
2026-03-29 20:16:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8584/3408584/3408584-exterior_front_driver-modified-1774710214850.jpeg> (referer: None)
2026-03-29 20:16:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8584/3408584/3408584-exterior_rear_driver-modified-1774710600216.jpeg> (referer: None)
2026-03-29 20:16:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8584/3408584/3408584-exterior_rear_passenger-modified-1774710625374.jpeg> (referer: None)
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7661%252F17007661%252Fexterior_rear_driver-1774620576832.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7661/17007661/exterior_rear_driver-1774620576832.jpg not downloaded yet
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5367%252F18015367%252Fdocs_service_history-1774696879196.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd0180698c7a6ce86dd94c61079ff2c03%27 HTTP/1.1" 200 None
2026-03-29 20:16:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5367/18015367/docs_service_history-1774696879196.jpg?ixlib=js-3.8.0&auto=format&s=d0180698c7a6ce86dd94c61079ff2c03 not downloaded yet
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8638%252F20418638%252Finterior_rear_seats-1774623532817.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8638/20418638/interior_rear_seats-1774623532817.jpg not downloaded yet
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7661%252F17007661%252Fexterior_front_passenger-1774620593997.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7661/17007661/exterior_front_passenger-1774620593997.jpg not downloaded yet
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8638%252F20418638%252Finterior_dashboard-1774772766734.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8638/20418638/interior_dashboard-1774772766734.jpg not downloaded yet
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7661%252F17007661%252Fexterior_rear_passenger-1774620584978.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7661/17007661/exterior_rear_passenger-1774620584978.jpg not downloaded yet
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c4a9d0>
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6a5659c-145e-52fc-ae7f-6e84f637968b/a6a5659c-145e-52fc-ae7f-6e84f637968b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8584%252F3408584%252F3408584-exterior_front_passenger-modified-1774710609462.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8584/3408584/3408584-exterior_front_passenger-modified-1774710609462.jpeg saved to cache
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a6a5659c-145e-52fc-ae7f-6e84f637968b
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8638%252F20418638%252Finstrument_cluster-1774623879207.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8638/20418638/instrument_cluster-1774623879207.jpg not downloaded yet
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7661%252F17007661%252Finterior_front_seats-1774620965767.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7661/17007661/interior_front_seats-1774620965767.jpg not downloaded yet
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ffa590>
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6a5659c-145e-52fc-ae7f-6e84f637968b/a6a5659c-145e-52fc-ae7f-6e84f637968b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8584%252F3408584%252F3408584-exterior_front_driver-modified-1774710214850.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8584/3408584/3408584-exterior_front_driver-modified-1774710214850.jpeg saved to cache
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a6a5659c-145e-52fc-ae7f-6e84f637968b
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658dac490>
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6a5659c-145e-52fc-ae7f-6e84f637968b/a6a5659c-145e-52fc-ae7f-6e84f637968b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8584%252F3408584%252F3408584-exterior_rear_driver-modified-1774710600216.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8584/3408584/3408584-exterior_rear_driver-modified-1774710600216.jpeg saved to cache
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a6a5659c-145e-52fc-ae7f-6e84f637968b
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658daf290>
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6a5659c-145e-52fc-ae7f-6e84f637968b/a6a5659c-145e-52fc-ae7f-6e84f637968b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8584%252F3408584%252F3408584-exterior_rear_passenger-modified-1774710625374.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8584/3408584/3408584-exterior_rear_passenger-modified-1774710625374.jpeg saved to cache
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a6a5659c-145e-52fc-ae7f-6e84f637968b
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8638%252F20418638%252Finterior_boot-1774623527735.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8638/20418638/interior_boot-1774623527735.jpg not downloaded yet
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7661%252F17007661%252Finterior_rear_seats-1774620947065.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7661/17007661/interior_rear_seats-1774620947065.jpg not downloaded yet
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8638%252F20418638%252Fdocs_service_history-1774691110546.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5e97f2ffe35f963e059aecedcd030dde%27 HTTP/1.1" 200 None
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8638/20418638/docs_service_history-1774691110546.jpg?ixlib=js-3.8.0&auto=format&s=5e97f2ffe35f963e059aecedcd030dde not downloaded yet
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7661%252F17007661%252Finterior_dashboard-1774621055868.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7661/17007661/interior_dashboard-1774621055868.jpg not downloaded yet
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7661%252F17007661%252Finstrument_cluster-1774620949667.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7661/17007661/instrument_cluster-1774620949667.jpg not downloaded yet
2026-03-29 20:16:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5456/20445456/interior_rear_seats-1774630903542.jpg> (referer: None)
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7661%252F17007661%252Finterior_boot-1774620894355.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7661/17007661/interior_boot-1774620894355.jpg not downloaded yet
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7661%252F17007661%252Fdocs_service_history-1774621410586.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3561c77214be742781f36f417d9c7065%27 HTTP/1.1" 200 None
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7661/17007661/docs_service_history-1774621410586.jpg?ixlib=js-3.8.0&auto=format&s=3561c77214be742781f36f417d9c7065 not downloaded yet
2026-03-29 20:16:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5456/20445456/docs_service_history-1774631081242.jpg?ixlib=js-3.8.0&auto=format&s=422533452a3709f1d2ac682dafde215b> (referer: None)
2026-03-29 20:16:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8584/3408584/3408584-interior_front_seats-modified-1774710646048.jpeg> (referer: None)
2026-03-29 20:16:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5367/18015367/exterior_rear_driver-1774633401173.jpg> (referer: None)
2026-03-29 20:16:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8638/20418638/exterior_front_passenger-1774772743754.jpg> (referer: None)
2026-03-29 20:16:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7661/17007661/exterior_front_driver-1774620553456.jpg> (referer: None)
2026-03-29 20:16:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5367/18015367/interior_boot-1774696530051.jpg> (referer: None)
2026-03-29 20:16:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8638/20418638/interior_front_seats-1774623670137.jpg> (referer: None)
2026-03-29 20:16:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5456/20445456/interior_boot-1774630954937.jpg> (referer: None)
2026-03-29 20:16:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b0e650>
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_489c0a9f-68f9-508b-ab83-5d1e64be4252/489c0a9f-68f9-508b-ab83-5d1e64be4252_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5456%252F20445456%252Finterior_rear_seats-1774630903542.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5456/20445456/interior_rear_seats-1774630903542.jpg saved to cache
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 489c0a9f-68f9-508b-ab83-5d1e64be4252
2026-03-29 20:16:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f6acd0>
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_489c0a9f-68f9-508b-ab83-5d1e64be4252/489c0a9f-68f9-508b-ab83-5d1e64be4252_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5456%252F20445456%252Fdocs_service_history-1774631081242.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D422533452a3709f1d2ac682dafde215b') HTTP/1.1" 204 0
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5456/20445456/docs_service_history-1774631081242.jpg?ixlib=js-3.8.0&auto=format&s=422533452a3709f1d2ac682dafde215b saved to cache
2026-03-29 20:16:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 489c0a9f-68f9-508b-ab83-5d1e64be4252
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a38a90>
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6a5659c-145e-52fc-ae7f-6e84f637968b/a6a5659c-145e-52fc-ae7f-6e84f637968b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8584%252F3408584%252F3408584-interior_front_seats-modified-1774710646048.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8584/3408584/3408584-interior_front_seats-modified-1774710646048.jpeg saved to cache
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a6a5659c-145e-52fc-ae7f-6e84f637968b
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658753d10>
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86552590-891f-5a98-81cd-496dbf676116/86552590-891f-5a98-81cd-496dbf676116_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5367%252F18015367%252Fexterior_rear_driver-1774633401173.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5367/18015367/exterior_rear_driver-1774633401173.jpg saved to cache
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 86552590-891f-5a98-81cd-496dbf676116
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658465050>
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81bd5520-fa3a-5ba3-90b6-a772cd67f702/81bd5520-fa3a-5ba3-90b6-a772cd67f702_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8638%252F20418638%252Fexterior_front_passenger-1774772743754.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8638/20418638/exterior_front_passenger-1774772743754.jpg saved to cache
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 81bd5520-fa3a-5ba3-90b6-a772cd67f702
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658753690>
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39808af5-a3d6-5d73-919f-c2d87b622263/39808af5-a3d6-5d73-919f-c2d87b622263_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7661%252F17007661%252Fexterior_front_driver-1774620553456.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7661/17007661/exterior_front_driver-1774620553456.jpg saved to cache
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 39808af5-a3d6-5d73-919f-c2d87b622263
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582bc510>
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86552590-891f-5a98-81cd-496dbf676116/86552590-891f-5a98-81cd-496dbf676116_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5367%252F18015367%252Finterior_boot-1774696530051.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5367/18015367/interior_boot-1774696530051.jpg saved to cache
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 86552590-891f-5a98-81cd-496dbf676116
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658752110>
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81bd5520-fa3a-5ba3-90b6-a772cd67f702/81bd5520-fa3a-5ba3-90b6-a772cd67f702_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8638%252F20418638%252Finterior_front_seats-1774623670137.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8638/20418638/interior_front_seats-1774623670137.jpg saved to cache
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 81bd5520-fa3a-5ba3-90b6-a772cd67f702
2026-03-29 20:16:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b656d0>
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_489c0a9f-68f9-508b-ab83-5d1e64be4252/489c0a9f-68f9-508b-ab83-5d1e64be4252_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5456%252F20445456%252Finterior_boot-1774630954937.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5456/20445456/interior_boot-1774630954937.jpg saved to cache
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 489c0a9f-68f9-508b-ab83-5d1e64be4252
2026-03-29 20:16:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7661/17007661/docs_service_history-1774621410586.jpg?ixlib=js-3.8.0&auto=format&s=3561c77214be742781f36f417d9c7065> (referer: None)
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 81bd5520-fa3a-5ba3-90b6-a772cd67f702 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-29 20:16:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7661/17007661/instrument_cluster-1774620949667.jpg> (referer: None)
2026-03-29 20:16:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a3ab50>
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39808af5-a3d6-5d73-919f-c2d87b622263/39808af5-a3d6-5d73-919f-c2d87b622263_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7661%252F17007661%252Fdocs_service_history-1774621410586.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3561c77214be742781f36f417d9c7065') HTTP/1.1" 204 0
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7661/17007661/docs_service_history-1774621410586.jpg?ixlib=js-3.8.0&auto=format&s=3561c77214be742781f36f417d9c7065 saved to cache
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 39808af5-a3d6-5d73-919f-c2d87b622263
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e11410>
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39808af5-a3d6-5d73-919f-c2d87b622263/39808af5-a3d6-5d73-919f-c2d87b622263_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7661%252F17007661%252Finstrument_cluster-1774620949667.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7661/17007661/instrument_cluster-1774620949667.jpg saved to cache
2026-03-29 20:16:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 39808af5-a3d6-5d73-919f-c2d87b622263
2026-03-29 20:16:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8638/20418638/docs_service_history-1774691110546.jpg?ixlib=js-3.8.0&auto=format&s=5e97f2ffe35f963e059aecedcd030dde> (referer: None)
2026-03-29 20:16:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/12889821.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8638/20418638/interior_boot-1774623527735.jpg> (referer: None)
2026-03-29 20:16:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7661/17007661/interior_dashboard-1774621055868.jpg> (referer: None)
2026-03-29 20:16:32 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 22 - Data Location: 98 - value: b'Screenshot\x00'
2026-03-29 20:16:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 110 - value: b'\x00\x00\x00\x90\x00\x00\x00\x01'
2026-03-29 20:16:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 118 - value: b'\x00\x00\x00\x90\x00\x00\x00\x01'
2026-03-29 20:16:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:32 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 82 - Data Location: 126 - value: b'2026:03:28 09:04:04\x00'
2026-03-29 20:16:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x92'
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f857d0>
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81bd5520-fa3a-5ba3-90b6-a772cd67f702/81bd5520-fa3a-5ba3-90b6-a772cd67f702_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8638%252F20418638%252Fdocs_service_history-1774691110546.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5e97f2ffe35f963e059aecedcd030dde') HTTP/1.1" 204 0
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8638/20418638/docs_service_history-1774691110546.jpg?ixlib=js-3.8.0&auto=format&s=5e97f2ffe35f963e059aecedcd030dde saved to cache
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 81bd5520-fa3a-5ba3-90b6-a772cd67f702
2026-03-29 20:16:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54f21971-08d0-5b0f-b4c4-5565f68c325b with identifier: 12889821
2026-03-29 20:16:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54f21971-08d0-5b0f-b4c4-5565f68c325b with scrape type 1
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 54f21971-08d0-5b0f-b4c4-5565f68c325b
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9821%252F12889821%252Fexterior_front_driver-1774706432624.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9821/12889821/exterior_front_driver-1774706432624.jpg not downloaded yet
2026-03-29 20:16:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7661/17007661/exterior_front_passenger-1774620593997.jpg> (referer: None)
2026-03-29 20:16:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8638/20418638/instrument_cluster-1774623879207.jpg> (referer: None)
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9821%252F12889821%252Fexterior_rear_driver-1774706439400.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9821/12889821/exterior_rear_driver-1774706439400.jpg not downloaded yet
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b200d0>
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81bd5520-fa3a-5ba3-90b6-a772cd67f702/81bd5520-fa3a-5ba3-90b6-a772cd67f702_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8638%252F20418638%252Finterior_boot-1774623527735.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8638/20418638/interior_boot-1774623527735.jpg saved to cache
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 81bd5520-fa3a-5ba3-90b6-a772cd67f702
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9821%252F12889821%252Fexterior_front_passenger-1774706455489.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9821/12889821/exterior_front_passenger-1774706455489.jpg not downloaded yet
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658461590>
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39808af5-a3d6-5d73-919f-c2d87b622263/39808af5-a3d6-5d73-919f-c2d87b622263_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7661%252F17007661%252Finterior_dashboard-1774621055868.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7661/17007661/interior_dashboard-1774621055868.jpg saved to cache
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 39808af5-a3d6-5d73-919f-c2d87b622263
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9821%252F12889821%252Fexterior_rear_passenger-1774706447295.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9821/12889821/exterior_rear_passenger-1774706447295.jpg not downloaded yet
2026-03-29 20:16:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8638/20418638/interior_dashboard-1774772766734.jpg> (referer: None)
2026-03-29 20:16:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20240321.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9821%252F12889821%252Finterior_front_seats-1774707073866.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9821/12889821/interior_front_seats-1774707073866.jpg not downloaded yet
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599c08d0>
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39808af5-a3d6-5d73-919f-c2d87b622263/39808af5-a3d6-5d73-919f-c2d87b622263_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7661%252F17007661%252Fexterior_front_passenger-1774620593997.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7661/17007661/exterior_front_passenger-1774620593997.jpg saved to cache
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 39808af5-a3d6-5d73-919f-c2d87b622263
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a6d750>
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81bd5520-fa3a-5ba3-90b6-a772cd67f702/81bd5520-fa3a-5ba3-90b6-a772cd67f702_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8638%252F20418638%252Finstrument_cluster-1774623879207.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8638/20418638/instrument_cluster-1774623879207.jpg saved to cache
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 81bd5520-fa3a-5ba3-90b6-a772cd67f702
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9821%252F12889821%252Finterior_rear_seats-1774707073876.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9821/12889821/interior_rear_seats-1774707073876.jpg not downloaded yet
2026-03-29 20:16:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7661/17007661/exterior_rear_passenger-1774620584978.jpg> (referer: None)
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9821%252F12889821%252Finterior_dashboard-1774707042900.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9821/12889821/interior_dashboard-1774707042900.jpg not downloaded yet
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f7cf90>
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81bd5520-fa3a-5ba3-90b6-a772cd67f702/81bd5520-fa3a-5ba3-90b6-a772cd67f702_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8638%252F20418638%252Finterior_dashboard-1774772766734.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8638/20418638/interior_dashboard-1774772766734.jpg saved to cache
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 81bd5520-fa3a-5ba3-90b6-a772cd67f702
2026-03-29 20:16:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c47963b-c2f5-53d3-93eb-3c8bfc302774 with identifier: 20240321
2026-03-29 20:16:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c47963b-c2f5-53d3-93eb-3c8bfc302774 with scrape type 1
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9c47963b-c2f5-53d3-93eb-3c8bfc302774
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0321%252F20240321%252Fexterior_front_driver-1774700682413.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0321/20240321/exterior_front_driver-1774700682413.jpg not downloaded yet
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9821%252F12889821%252Finstrument_cluster-1774707185108.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9821/12889821/instrument_cluster-1774707185108.jpg not downloaded yet
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0321%252F20240321%252Fexterior_rear_driver-1774695300108.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0321/20240321/exterior_rear_driver-1774695300108.jpg not downloaded yet
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9821%252F12889821%252Finterior_boot-1774762909056.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9821/12889821/interior_boot-1774762909056.jpg not downloaded yet
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0321%252F20240321%252Fexterior_front_passenger-1774695311376.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0321/20240321/exterior_front_passenger-1774695311376.jpg not downloaded yet
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65befecd0>
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39808af5-a3d6-5d73-919f-c2d87b622263/39808af5-a3d6-5d73-919f-c2d87b622263_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7661%252F17007661%252Fexterior_rear_passenger-1774620584978.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7661/17007661/exterior_rear_passenger-1774620584978.jpg saved to cache
2026-03-29 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 39808af5-a3d6-5d73-919f-c2d87b622263
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9821%252F12889821%252Fwheels_front_driver-1774706547590.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9821/12889821/wheels_front_driver-1774706547590.jpg not downloaded yet
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0321%252F20240321%252Fexterior_rear_passenger-1774700694272.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0321/20240321/exterior_rear_passenger-1774700694272.jpg not downloaded yet
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0321%252F20240321%252Finterior_front_seats-1774696507920.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0321/20240321/interior_front_seats-1774696507920.jpg not downloaded yet
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0321%252F20240321%252Finterior_rear_seats-1774696559890.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0321/20240321/interior_rear_seats-1774696559890.jpg not downloaded yet
2026-03-29 20:16:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7661/17007661/interior_rear_seats-1774620947065.jpg> (referer: None)
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0321%252F20240321%252Finterior_dashboard-1774696442497.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0321/20240321/interior_dashboard-1774696442497.jpg not downloaded yet
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0321%252F20240321%252Finstrument_cluster-1774696395172.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0321/20240321/instrument_cluster-1774696395172.jpg not downloaded yet
2026-03-29 20:16:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8638/20418638/interior_rear_seats-1774623532817.jpg> (referer: None)
2026-03-29 20:16:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7661/17007661/interior_front_seats-1774620965767.jpg> (referer: None)
2026-03-29 20:16:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7661/17007661/exterior_rear_driver-1774620576832.jpg> (referer: None)
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0321%252F20240321%252Finterior_boot-1774700709797.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0321/20240321/interior_boot-1774700709797.jpg not downloaded yet
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F0321%252F20240321%252Fdocs_service_history-1774700667209.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8a0bf660c5865f68cfe7c21e8250c029%27 HTTP/1.1" 200 None
2026-03-29 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/0321/20240321/docs_service_history-1774700667209.jpg?ixlib=js-3.8.0&auto=format&s=8a0bf660c5865f68cfe7c21e8250c029 not downloaded yet
2026-03-29 20:16:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8638/20418638/exterior_rear_passenger-1774773002827.jpg> (referer: None)
2026-03-29 20:16:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b1bf90>
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39808af5-a3d6-5d73-919f-c2d87b622263/39808af5-a3d6-5d73-919f-c2d87b622263_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7661%252F17007661%252Finterior_rear_seats-1774620947065.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7661/17007661/interior_rear_seats-1774620947065.jpg saved to cache
2026-03-29 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 39808af5-a3d6-5d73-919f-c2d87b622263
2026-03-29 20:16:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5367/18015367/docs_service_history-1774696879196.jpg?ixlib=js-3.8.0&auto=format&s=d0180698c7a6ce86dd94c61079ff2c03> (referer: None)
2026-03-29 20:16:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9821/12889821/exterior_front_passenger-1774706455489.jpg> (referer: None)
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c616d0>
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81bd5520-fa3a-5ba3-90b6-a772cd67f702/81bd5520-fa3a-5ba3-90b6-a772cd67f702_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8638%252F20418638%252Finterior_rear_seats-1774623532817.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8638/20418638/interior_rear_seats-1774623532817.jpg saved to cache
2026-03-29 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 81bd5520-fa3a-5ba3-90b6-a772cd67f702
2026-03-29 20:16:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587c8bd0>
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39808af5-a3d6-5d73-919f-c2d87b622263/39808af5-a3d6-5d73-919f-c2d87b622263_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7661%252F17007661%252Finterior_front_seats-1774620965767.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7661/17007661/interior_front_seats-1774620965767.jpg saved to cache
2026-03-29 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 39808af5-a3d6-5d73-919f-c2d87b622263
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658871b50>
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39808af5-a3d6-5d73-919f-c2d87b622263/39808af5-a3d6-5d73-919f-c2d87b622263_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7661%252F17007661%252Fexterior_rear_driver-1774620576832.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7661/17007661/exterior_rear_driver-1774620576832.jpg saved to cache
2026-03-29 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 39808af5-a3d6-5d73-919f-c2d87b622263
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65882ea90>
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81bd5520-fa3a-5ba3-90b6-a772cd67f702/81bd5520-fa3a-5ba3-90b6-a772cd67f702_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8638%252F20418638%252Fexterior_rear_passenger-1774773002827.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8638/20418638/exterior_rear_passenger-1774773002827.jpg saved to cache
2026-03-29 20:16:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 81bd5520-fa3a-5ba3-90b6-a772cd67f702
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65882e090>
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86552590-891f-5a98-81cd-496dbf676116/86552590-891f-5a98-81cd-496dbf676116_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5367%252F18015367%252Fdocs_service_history-1774696879196.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd0180698c7a6ce86dd94c61079ff2c03') HTTP/1.1" 204 0
2026-03-29 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5367/18015367/docs_service_history-1774696879196.jpg?ixlib=js-3.8.0&auto=format&s=d0180698c7a6ce86dd94c61079ff2c03 saved to cache
2026-03-29 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 86552590-891f-5a98-81cd-496dbf676116
2026-03-29 20:16:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d4d310>
2026-03-29 20:16:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54f21971-08d0-5b0f-b4c4-5565f68c325b/54f21971-08d0-5b0f-b4c4-5565f68c325b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9821%252F12889821%252Fexterior_front_passenger-1774706455489.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9821/12889821/exterior_front_passenger-1774706455489.jpg saved to cache
2026-03-29 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 54f21971-08d0-5b0f-b4c4-5565f68c325b
2026-03-29 20:16:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9821/12889821/exterior_front_driver-1774706432624.jpg> (referer: None)
2026-03-29 20:16:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9821/12889821/exterior_rear_passenger-1774706447295.jpg> (referer: None)
2026-03-29 20:16:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7661/17007661/interior_boot-1774620894355.jpg> (referer: None)
2026-03-29 20:16:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9821/12889821/exterior_rear_driver-1774706439400.jpg> (referer: None)
2026-03-29 20:16:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9821/12889821/interior_front_seats-1774707073866.jpg> (referer: None)
2026-03-29 20:16:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0321/20240321/interior_rear_seats-1774696559890.jpg> (referer: None)
2026-03-29 20:16:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ab9e10>
2026-03-29 20:16:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54f21971-08d0-5b0f-b4c4-5565f68c325b/54f21971-08d0-5b0f-b4c4-5565f68c325b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9821%252F12889821%252Fexterior_front_driver-1774706432624.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9821/12889821/exterior_front_driver-1774706432624.jpg saved to cache
2026-03-29 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54f21971-08d0-5b0f-b4c4-5565f68c325b
2026-03-29 20:16:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65853c0d0>
2026-03-29 20:16:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54f21971-08d0-5b0f-b4c4-5565f68c325b/54f21971-08d0-5b0f-b4c4-5565f68c325b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9821%252F12889821%252Fexterior_rear_passenger-1774706447295.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9821/12889821/exterior_rear_passenger-1774706447295.jpg saved to cache
2026-03-29 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 54f21971-08d0-5b0f-b4c4-5565f68c325b
2026-03-29 20:16:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ffb710>
2026-03-29 20:16:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39808af5-a3d6-5d73-919f-c2d87b622263/39808af5-a3d6-5d73-919f-c2d87b622263_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7661%252F17007661%252Finterior_boot-1774620894355.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7661/17007661/interior_boot-1774620894355.jpg saved to cache
2026-03-29 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 39808af5-a3d6-5d73-919f-c2d87b622263
2026-03-29 20:16:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 39808af5-a3d6-5d73-919f-c2d87b622263, skipping ID generation
2026-03-29 20:16:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39808af5-a3d6-5d73-919f-c2d87b622263 with scrape type 1
2026-03-29 20:16:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 39808af5-a3d6-5d73-919f-c2d87b622263 sending to next pipeline
2026-03-29 20:16:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 39808af5-a3d6-5d73-919f-c2d87b622263, identifier: 17007661
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e47a90>
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54f21971-08d0-5b0f-b4c4-5565f68c325b/54f21971-08d0-5b0f-b4c4-5565f68c325b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9821%252F12889821%252Fexterior_rear_driver-1774706439400.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9821/12889821/exterior_rear_driver-1774706439400.jpg saved to cache
2026-03-29 20:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 54f21971-08d0-5b0f-b4c4-5565f68c325b
2026-03-29 20:16:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf9e990>
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54f21971-08d0-5b0f-b4c4-5565f68c325b/54f21971-08d0-5b0f-b4c4-5565f68c325b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9821%252F12889821%252Finterior_front_seats-1774707073866.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9821/12889821/interior_front_seats-1774707073866.jpg saved to cache
2026-03-29 20:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 54f21971-08d0-5b0f-b4c4-5565f68c325b
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658872b50>
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c47963b-c2f5-53d3-93eb-3c8bfc302774/9c47963b-c2f5-53d3-93eb-3c8bfc302774_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0321%252F20240321%252Finterior_rear_seats-1774696559890.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0321/20240321/interior_rear_seats-1774696559890.jpg saved to cache
2026-03-29 20:16:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9c47963b-c2f5-53d3-93eb-3c8bfc302774
2026-03-29 20:16:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 39808af5-a3d6-5d73-919f-c2d87b622263 with identifier: 17007661
2026-03-29 20:16:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 39808af5-a3d6-5d73-919f-c2d87b622263 with identifier: 17007661
2026-03-29 20:16:35 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 39808af5-a3d6-5d73-919f-c2d87b622263 with identifier: 17007661 to the API
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/7661/17007661/interior_boot-1774620894355.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '39808af5-a3d6-5d73-919f-c2d87b622263',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DG69 XYZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17007661',
'listing': 'auction',
'location': 'West Yorkshire Leeds',
'make': 'Mercedes',
'model': 'A Class',
'odometer': 61000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39808af5-a3d6-5d73-919f-c2d87b622263/39808af5-a3d6-5d73-919f-c2d87b622263_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1791054,
'Height': 2729,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7661/17007661/exterior_front_driver-1774620553456.jpg',
'Width': 3638},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39808af5-a3d6-5d73-919f-c2d87b622263/39808af5-a3d6-5d73-919f-c2d87b622263_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1530588,
'Height': 2771,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7661/17007661/exterior_rear_driver-1774620576832.jpg',
'Width': 3694},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39808af5-a3d6-5d73-919f-c2d87b622263/39808af5-a3d6-5d73-919f-c2d87b622263_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1467776,
'Height': 2493,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7661/17007661/exterior_front_passenger-1774620593997.jpg',
'Width': 3324},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39808af5-a3d6-5d73-919f-c2d87b622263/39808af5-a3d6-5d73-919f-c2d87b622263_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1745086,
'Height': 2681,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7661/17007661/exterior_rear_passenger-1774620584978.jpg',
'Width': 3574},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39808af5-a3d6-5d73-919f-c2d87b622263/39808af5-a3d6-5d73-919f-c2d87b622263_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3068373,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7661/17007661/interior_front_seats-1774620965767.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39808af5-a3d6-5d73-919f-c2d87b622263/39808af5-a3d6-5d73-919f-c2d87b622263_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3422188,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7661/17007661/interior_rear_seats-1774620947065.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39808af5-a3d6-5d73-919f-c2d87b622263/39808af5-a3d6-5d73-919f-c2d87b622263_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1124780,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7661/17007661/interior_dashboard-1774621055868.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39808af5-a3d6-5d73-919f-c2d87b622263/39808af5-a3d6-5d73-919f-c2d87b622263_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 958935,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7661/17007661/instrument_cluster-1774620949667.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39808af5-a3d6-5d73-919f-c2d87b622263/39808af5-a3d6-5d73-919f-c2d87b622263_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3926454,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7661/17007661/interior_boot-1774620894355.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39808af5-a3d6-5d73-919f-c2d87b622263/39808af5-a3d6-5d73-919f-c2d87b622263_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94232,
'Height': 433,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7661/17007661/docs_service_history-1774621410586.jpg?ixlib=js-3.8.0&auto=format&s=3561c77214be742781f36f417d9c7065',
'Width': 1179}],
'price': 12880,
'price_includes_vat': False,
'registration_date': '2019-09-28',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes A 200 AMG Line Premium +',
'transmission': 'manual',
'trim': 'A 200 AMG Line Premium +',
'vin': 'WDD1770872V043664',
'year': 2019}
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717007661%27 HTTP/1.1" 200 None
2026-03-29 20:16:35 [motorway.uk] INFO: Saving data for 17007661: {'created_time': 1774815395.871409, 'last_price_update_time': 1774815395.871419, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17007661') HTTP/1.1" 204 0
2026-03-29 20:16:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0321/20240321/exterior_front_passenger-1774695311376.jpg> (referer: None)
2026-03-29 20:16:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/0321/20240321/docs_service_history-1774700667209.jpg?ixlib=js-3.8.0&auto=format&s=8a0bf660c5865f68cfe7c21e8250c029> (referer: None)
2026-03-29 20:16:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9821/12889821/wheels_front_driver-1774706547590.jpg> (referer: None)
2026-03-29 20:16:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0321/20240321/instrument_cluster-1774696395172.jpg> (referer: None)
2026-03-29 20:16:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0321/20240321/exterior_rear_passenger-1774700694272.jpg> (referer: None)
2026-03-29 20:16:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0321/20240321/interior_front_seats-1774696507920.jpg> (referer: None)
2026-03-29 20:16:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0321/20240321/interior_boot-1774700709797.jpg> (referer: None)
2026-03-29 20:16:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0321/20240321/interior_dashboard-1774696442497.jpg> (referer: None)
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658830210>
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c47963b-c2f5-53d3-93eb-3c8bfc302774/9c47963b-c2f5-53d3-93eb-3c8bfc302774_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0321%252F20240321%252Fexterior_front_passenger-1774695311376.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0321/20240321/exterior_front_passenger-1774695311376.jpg saved to cache
2026-03-29 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c47963b-c2f5-53d3-93eb-3c8bfc302774
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64b93a110>
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c47963b-c2f5-53d3-93eb-3c8bfc302774/9c47963b-c2f5-53d3-93eb-3c8bfc302774_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F0321%252F20240321%252Fdocs_service_history-1774700667209.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8a0bf660c5865f68cfe7c21e8250c029') HTTP/1.1" 204 0
2026-03-29 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/0321/20240321/docs_service_history-1774700667209.jpg?ixlib=js-3.8.0&auto=format&s=8a0bf660c5865f68cfe7c21e8250c029 saved to cache
2026-03-29 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9c47963b-c2f5-53d3-93eb-3c8bfc302774
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a5fe90>
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54f21971-08d0-5b0f-b4c4-5565f68c325b/54f21971-08d0-5b0f-b4c4-5565f68c325b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9821%252F12889821%252Fwheels_front_driver-1774706547590.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9821/12889821/wheels_front_driver-1774706547590.jpg saved to cache
2026-03-29 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 54f21971-08d0-5b0f-b4c4-5565f68c325b
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586fea10>
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c47963b-c2f5-53d3-93eb-3c8bfc302774/9c47963b-c2f5-53d3-93eb-3c8bfc302774_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0321%252F20240321%252Finstrument_cluster-1774696395172.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0321/20240321/instrument_cluster-1774696395172.jpg saved to cache
2026-03-29 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9c47963b-c2f5-53d3-93eb-3c8bfc302774
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598f2490>
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c47963b-c2f5-53d3-93eb-3c8bfc302774/9c47963b-c2f5-53d3-93eb-3c8bfc302774_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0321%252F20240321%252Fexterior_rear_passenger-1774700694272.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0321/20240321/exterior_rear_passenger-1774700694272.jpg saved to cache
2026-03-29 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c47963b-c2f5-53d3-93eb-3c8bfc302774
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586fd6d0>
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c47963b-c2f5-53d3-93eb-3c8bfc302774/9c47963b-c2f5-53d3-93eb-3c8bfc302774_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0321%252F20240321%252Finterior_front_seats-1774696507920.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0321/20240321/interior_front_seats-1774696507920.jpg saved to cache
2026-03-29 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c47963b-c2f5-53d3-93eb-3c8bfc302774
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658b45490>
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c47963b-c2f5-53d3-93eb-3c8bfc302774/9c47963b-c2f5-53d3-93eb-3c8bfc302774_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0321%252F20240321%252Finterior_boot-1774700709797.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0321/20240321/interior_boot-1774700709797.jpg saved to cache
2026-03-29 20:16:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9c47963b-c2f5-53d3-93eb-3c8bfc302774
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65869be10>
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c47963b-c2f5-53d3-93eb-3c8bfc302774/9c47963b-c2f5-53d3-93eb-3c8bfc302774_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0321%252F20240321%252Finterior_dashboard-1774696442497.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0321/20240321/interior_dashboard-1774696442497.jpg saved to cache
2026-03-29 20:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9c47963b-c2f5-53d3-93eb-3c8bfc302774
2026-03-29 20:16:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0321/20240321/exterior_front_driver-1774700682413.jpg> (referer: None)
2026-03-29 20:16:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0321/20240321/exterior_rear_driver-1774695300108.jpg> (referer: None)
2026-03-29 20:16:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9821/12889821/interior_boot-1774762909056.jpg> (referer: None)
2026-03-29 20:16:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5367/18015367/instrument_cluster-1774696540134.jpg> (referer: None)
2026-03-29 20:16:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9821/12889821/interior_dashboard-1774707042900.jpg> (referer: None)
2026-03-29 20:16:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9821/12889821/instrument_cluster-1774707185108.jpg> (referer: None)
2026-03-29 20:16:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9821/12889821/interior_rear_seats-1774707073876.jpg> (referer: None)
2026-03-29 20:16:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a0ad90>
2026-03-29 20:16:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c47963b-c2f5-53d3-93eb-3c8bfc302774/9c47963b-c2f5-53d3-93eb-3c8bfc302774_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0321%252F20240321%252Fexterior_front_driver-1774700682413.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0321/20240321/exterior_front_driver-1774700682413.jpg saved to cache
2026-03-29 20:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c47963b-c2f5-53d3-93eb-3c8bfc302774
2026-03-29 20:16:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65813cc90>
2026-03-29 20:16:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c47963b-c2f5-53d3-93eb-3c8bfc302774/9c47963b-c2f5-53d3-93eb-3c8bfc302774_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0321%252F20240321%252Fexterior_rear_driver-1774695300108.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0321/20240321/exterior_rear_driver-1774695300108.jpg saved to cache
2026-03-29 20:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c47963b-c2f5-53d3-93eb-3c8bfc302774
2026-03-29 20:16:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c47963b-c2f5-53d3-93eb-3c8bfc302774, skipping ID generation
2026-03-29 20:16:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c47963b-c2f5-53d3-93eb-3c8bfc302774 with scrape type 1
2026-03-29 20:16:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c47963b-c2f5-53d3-93eb-3c8bfc302774 sending to next pipeline
2026-03-29 20:16:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9c47963b-c2f5-53d3-93eb-3c8bfc302774, identifier: 20240321
2026-03-29 20:16:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/4255654.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9c47963b-c2f5-53d3-93eb-3c8bfc302774 with identifier: 20240321
2026-03-29 20:16:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9c47963b-c2f5-53d3-93eb-3c8bfc302774 with identifier: 20240321
2026-03-29 20:16:37 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9c47963b-c2f5-53d3-93eb-3c8bfc302774 with identifier: 20240321 to the API
2026-03-29 20:16:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0321/20240321/exterior_rear_driver-1774695300108.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '9c47963b-c2f5-53d3-93eb-3c8bfc302774',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GJ58 UYB',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20240321',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Peugeot',
'model': '308',
'odometer': 66848,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c47963b-c2f5-53d3-93eb-3c8bfc302774/9c47963b-c2f5-53d3-93eb-3c8bfc302774_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1905150,
'Height': 2543,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0321/20240321/exterior_front_driver-1774700682413.jpg',
'Width': 3391},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c47963b-c2f5-53d3-93eb-3c8bfc302774/9c47963b-c2f5-53d3-93eb-3c8bfc302774_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1280623,
'Height': 2365,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0321/20240321/exterior_rear_driver-1774695300108.jpg',
'Width': 3153},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c47963b-c2f5-53d3-93eb-3c8bfc302774/9c47963b-c2f5-53d3-93eb-3c8bfc302774_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1018043,
'Height': 2117,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0321/20240321/exterior_front_passenger-1774695311376.jpg',
'Width': 2823},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c47963b-c2f5-53d3-93eb-3c8bfc302774/9c47963b-c2f5-53d3-93eb-3c8bfc302774_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2476474,
'Height': 2481,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0321/20240321/exterior_rear_passenger-1774700694272.jpg',
'Width': 3308},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c47963b-c2f5-53d3-93eb-3c8bfc302774/9c47963b-c2f5-53d3-93eb-3c8bfc302774_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2652762,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0321/20240321/interior_front_seats-1774696507920.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c47963b-c2f5-53d3-93eb-3c8bfc302774/9c47963b-c2f5-53d3-93eb-3c8bfc302774_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3169354,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0321/20240321/interior_rear_seats-1774696559890.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c47963b-c2f5-53d3-93eb-3c8bfc302774/9c47963b-c2f5-53d3-93eb-3c8bfc302774_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2847675,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0321/20240321/interior_dashboard-1774696442497.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c47963b-c2f5-53d3-93eb-3c8bfc302774/9c47963b-c2f5-53d3-93eb-3c8bfc302774_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2172579,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0321/20240321/instrument_cluster-1774696395172.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c47963b-c2f5-53d3-93eb-3c8bfc302774/9c47963b-c2f5-53d3-93eb-3c8bfc302774_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2749372,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0321/20240321/interior_boot-1774700709797.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c47963b-c2f5-53d3-93eb-3c8bfc302774/9c47963b-c2f5-53d3-93eb-3c8bfc302774_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1937319,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/0321/20240321/docs_service_history-1774700667209.jpg?ixlib=js-3.8.0&auto=format&s=8a0bf660c5865f68cfe7c21e8250c029',
'Width': 2880}],
'price': 1496,
'price_includes_vat': False,
'registration_date': '2008-10-24',
'seats_number': None,
'seller_name': None,
'title': 'Peugeot 308 SE Auto',
'transmission': 'automatic',
'trim': 'SE Auto',
'vin': 'VF34C5FTF55354708',
'year': 2008}
2026-03-29 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720240321%27 HTTP/1.1" 200 None
2026-03-29 20:16:37 [motorway.uk] INFO: Saving data for 20240321: {'created_time': 1774815397.873875, 'last_price_update_time': 1774815397.873885, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20240321') HTTP/1.1" 204 0
2026-03-29 20:16:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be91cd0>
2026-03-29 20:16:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54f21971-08d0-5b0f-b4c4-5565f68c325b/54f21971-08d0-5b0f-b4c4-5565f68c325b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9821%252F12889821%252Finterior_boot-1774762909056.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9821/12889821/interior_boot-1774762909056.jpg saved to cache
2026-03-29 20:16:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 54f21971-08d0-5b0f-b4c4-5565f68c325b
2026-03-29 20:16:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ef5010>
2026-03-29 20:16:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86552590-891f-5a98-81cd-496dbf676116/86552590-891f-5a98-81cd-496dbf676116_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5367%252F18015367%252Finstrument_cluster-1774696540134.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5367/18015367/instrument_cluster-1774696540134.jpg saved to cache
2026-03-29 20:16:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 86552590-891f-5a98-81cd-496dbf676116
2026-03-29 20:16:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a316d0>
2026-03-29 20:16:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54f21971-08d0-5b0f-b4c4-5565f68c325b/54f21971-08d0-5b0f-b4c4-5565f68c325b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9821%252F12889821%252Finterior_dashboard-1774707042900.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9821/12889821/interior_dashboard-1774707042900.jpg saved to cache
2026-03-29 20:16:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 54f21971-08d0-5b0f-b4c4-5565f68c325b
2026-03-29 20:16:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658b29810>
2026-03-29 20:16:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54f21971-08d0-5b0f-b4c4-5565f68c325b/54f21971-08d0-5b0f-b4c4-5565f68c325b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9821%252F12889821%252Finstrument_cluster-1774707185108.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9821/12889821/instrument_cluster-1774707185108.jpg saved to cache
2026-03-29 20:16:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 54f21971-08d0-5b0f-b4c4-5565f68c325b
2026-03-29 20:16:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b31710>
2026-03-29 20:16:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54f21971-08d0-5b0f-b4c4-5565f68c325b/54f21971-08d0-5b0f-b4c4-5565f68c325b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9821%252F12889821%252Finterior_rear_seats-1774707073876.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9821/12889821/interior_rear_seats-1774707073876.jpg saved to cache
2026-03-29 20:16:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 54f21971-08d0-5b0f-b4c4-5565f68c325b
2026-03-29 20:16:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54f21971-08d0-5b0f-b4c4-5565f68c325b, skipping ID generation
2026-03-29 20:16:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54f21971-08d0-5b0f-b4c4-5565f68c325b with scrape type 1
2026-03-29 20:16:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54f21971-08d0-5b0f-b4c4-5565f68c325b sending to next pipeline
2026-03-29 20:16:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 54f21971-08d0-5b0f-b4c4-5565f68c325b, identifier: 12889821
2026-03-29 20:16:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 54f21971-08d0-5b0f-b4c4-5565f68c325b with identifier: 12889821
2026-03-29 20:16:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 54f21971-08d0-5b0f-b4c4-5565f68c325b with identifier: 12889821
2026-03-29 20:16:38 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 54f21971-08d0-5b0f-b4c4-5565f68c325b with identifier: 12889821 to the API
2026-03-29 20:16:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/9821/12889821/interior_rear_seats-1774707073876.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '54f21971-08d0-5b0f-b4c4-5565f68c325b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YK24 LXE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/12889821',
'listing': 'auction',
'location': 'North Yorkshire Harrogate',
'make': 'Mercedes',
'model': 'A Class',
'odometer': 18500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54f21971-08d0-5b0f-b4c4-5565f68c325b/54f21971-08d0-5b0f-b4c4-5565f68c325b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1786910,
'Height': 2324,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9821/12889821/exterior_front_driver-1774706432624.jpg',
'Width': 3098},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54f21971-08d0-5b0f-b4c4-5565f68c325b/54f21971-08d0-5b0f-b4c4-5565f68c325b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1520973,
'Height': 2097,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9821/12889821/exterior_rear_driver-1774706439400.jpg',
'Width': 2796},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54f21971-08d0-5b0f-b4c4-5565f68c325b/54f21971-08d0-5b0f-b4c4-5565f68c325b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1298314,
'Height': 1958,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9821/12889821/exterior_front_passenger-1774706455489.jpg',
'Width': 2610},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54f21971-08d0-5b0f-b4c4-5565f68c325b/54f21971-08d0-5b0f-b4c4-5565f68c325b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1988424,
'Height': 2502,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9821/12889821/exterior_rear_passenger-1774706447295.jpg',
'Width': 3336},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54f21971-08d0-5b0f-b4c4-5565f68c325b/54f21971-08d0-5b0f-b4c4-5565f68c325b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3137534,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9821/12889821/interior_front_seats-1774707073866.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54f21971-08d0-5b0f-b4c4-5565f68c325b/54f21971-08d0-5b0f-b4c4-5565f68c325b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2931850,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9821/12889821/interior_rear_seats-1774707073876.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54f21971-08d0-5b0f-b4c4-5565f68c325b/54f21971-08d0-5b0f-b4c4-5565f68c325b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2148373,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9821/12889821/interior_dashboard-1774707042900.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54f21971-08d0-5b0f-b4c4-5565f68c325b/54f21971-08d0-5b0f-b4c4-5565f68c325b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2536012,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9821/12889821/instrument_cluster-1774707185108.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54f21971-08d0-5b0f-b4c4-5565f68c325b/54f21971-08d0-5b0f-b4c4-5565f68c325b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1534811,
'Height': 2220,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9821/12889821/interior_boot-1774762909056.jpg',
'Width': 2960},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54f21971-08d0-5b0f-b4c4-5565f68c325b/54f21971-08d0-5b0f-b4c4-5565f68c325b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1336595,
'Height': 2484,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9821/12889821/wheels_front_driver-1774706547590.jpg',
'Width': 3312}],
'price': 20897,
'price_includes_vat': False,
'registration_date': '2024-03-01',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes A 200 AMG Line Premium MHEV A',
'transmission': 'automatic',
'trim': 'A 200 AMG Line Premium MHEV A',
'vin': 'W1K3F8HB9RV195490',
'year': 2024}
2026-03-29 20:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712889821%27 HTTP/1.1" 200 None
2026-03-29 20:16:38 [motorway.uk] INFO: Saving data for 12889821: {'created_time': 1774815398.886998, 'last_price_update_time': 1774815398.887011, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='12889821') HTTP/1.1" 204 0
2026-03-29 20:16:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecbf7fad-f6ac-542e-968e-285dd7234699 with identifier: 4255654
2026-03-29 20:16:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecbf7fad-f6ac-542e-968e-285dd7234699 with scrape type 1
2026-03-29 20:16:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ecbf7fad-f6ac-542e-968e-285dd7234699
2026-03-29 20:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5654%252F4255654%252Fexterior_front_driver-1774719417981.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5654/4255654/exterior_front_driver-1774719417981.jpg not downloaded yet
2026-03-29 20:16:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8584/3408584/3408584-docs_service_history-default-1774629529626.jpg?ixlib=js-3.8.0&auto=format&s=6cc8300a51ecc4c475a6be6f52ebf1f8> (referer: None)
2026-03-29 20:16:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5654%252F4255654%252Fexterior_rear_driver-1774782292540.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5654/4255654/exterior_rear_driver-1774782292540.jpg not downloaded yet
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5654%252F4255654%252Fexterior_front_passenger-1774719489416.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5654/4255654/exterior_front_passenger-1774719489416.jpg not downloaded yet
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5654%252F4255654%252Fexterior_rear_passenger-1774782309243.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5654/4255654/exterior_rear_passenger-1774782309243.jpg not downloaded yet
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5654%252F4255654%252Finterior_front_seats-1774720535282.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5654/4255654/interior_front_seats-1774720535282.jpg not downloaded yet
2026-03-29 20:16:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5367/18015367/interior_front_seats-1774696526105.jpg> (referer: None)
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5654%252F4255654%252Finterior_rear_seats-1774720549920.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5654/4255654/interior_rear_seats-1774720549920.jpg not downloaded yet
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5654%252F4255654%252Finterior_dashboard-1774782334338.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5654/4255654/interior_dashboard-1774782334338.jpg not downloaded yet
2026-03-29 20:16:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5367/18015367/exterior_front_passenger-1774633403776.jpg> (referer: None)
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5654%252F4255654%252Finstrument_cluster-1774720639224.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5654/4255654/instrument_cluster-1774720639224.jpg not downloaded yet
2026-03-29 20:16:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658b2a450>
2026-03-29 20:16:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6a5659c-145e-52fc-ae7f-6e84f637968b/a6a5659c-145e-52fc-ae7f-6e84f637968b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8584%252F3408584%252F3408584-docs_service_history-default-1774629529626.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6cc8300a51ecc4c475a6be6f52ebf1f8') HTTP/1.1" 204 0
2026-03-29 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8584/3408584/3408584-docs_service_history-default-1774629529626.jpg?ixlib=js-3.8.0&auto=format&s=6cc8300a51ecc4c475a6be6f52ebf1f8 saved to cache
2026-03-29 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a6a5659c-145e-52fc-ae7f-6e84f637968b
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5654%252F4255654%252Finterior_boot-1774720581458.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5654/4255654/interior_boot-1774720581458.jpg not downloaded yet
2026-03-29 20:16:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8584/3408584/interior_boot-1774632100159.jpg> (referer: None)
2026-03-29 20:16:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5367/18015367/exterior_rear_passenger-1774633402933.jpg> (referer: None)
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F5654%252F4255654%252Fdocs_service_history-1774782691009.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D39e8cd5bd4cac23eb10fafcb819703c2%27 HTTP/1.1" 200 None
2026-03-29 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/5654/4255654/docs_service_history-1774782691009.jpg?ixlib=js-3.8.0&auto=format&s=39e8cd5bd4cac23eb10fafcb819703c2 not downloaded yet
2026-03-29 20:16:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b191d0>
2026-03-29 20:16:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86552590-891f-5a98-81cd-496dbf676116/86552590-891f-5a98-81cd-496dbf676116_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5367%252F18015367%252Finterior_front_seats-1774696526105.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5367/18015367/interior_front_seats-1774696526105.jpg saved to cache
2026-03-29 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 86552590-891f-5a98-81cd-496dbf676116
2026-03-29 20:16:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658563cd0>
2026-03-29 20:16:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86552590-891f-5a98-81cd-496dbf676116/86552590-891f-5a98-81cd-496dbf676116_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5367%252F18015367%252Fexterior_front_passenger-1774633403776.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5367/18015367/exterior_front_passenger-1774633403776.jpg saved to cache
2026-03-29 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 86552590-891f-5a98-81cd-496dbf676116
2026-03-29 20:16:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8638/20418638/exterior_rear_driver-1774772965255.jpg> (referer: None)
2026-03-29 20:16:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5367/18015367/interior_rear_seats-1774696527424.jpg> (referer: None)
2026-03-29 20:16:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f51810>
2026-03-29 20:16:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6a5659c-145e-52fc-ae7f-6e84f637968b/a6a5659c-145e-52fc-ae7f-6e84f637968b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8584%252F3408584%252Finterior_boot-1774632100159.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8584/3408584/interior_boot-1774632100159.jpg saved to cache
2026-03-29 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a6a5659c-145e-52fc-ae7f-6e84f637968b
2026-03-29 20:16:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658492a10>
2026-03-29 20:16:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86552590-891f-5a98-81cd-496dbf676116/86552590-891f-5a98-81cd-496dbf676116_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5367%252F18015367%252Fexterior_rear_passenger-1774633402933.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5367/18015367/exterior_rear_passenger-1774633402933.jpg saved to cache
2026-03-29 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 86552590-891f-5a98-81cd-496dbf676116
2026-03-29 20:16:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c3f150>
2026-03-29 20:16:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81bd5520-fa3a-5ba3-90b6-a772cd67f702/81bd5520-fa3a-5ba3-90b6-a772cd67f702_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8638%252F20418638%252Fexterior_rear_driver-1774772965255.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8638/20418638/exterior_rear_driver-1774772965255.jpg saved to cache
2026-03-29 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 81bd5520-fa3a-5ba3-90b6-a772cd67f702
2026-03-29 20:16:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 81bd5520-fa3a-5ba3-90b6-a772cd67f702, skipping ID generation
2026-03-29 20:16:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81bd5520-fa3a-5ba3-90b6-a772cd67f702 with scrape type 1
2026-03-29 20:16:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 81bd5520-fa3a-5ba3-90b6-a772cd67f702 sending to next pipeline
2026-03-29 20:16:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 81bd5520-fa3a-5ba3-90b6-a772cd67f702, identifier: 20418638
2026-03-29 20:16:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f53f90>
2026-03-29 20:16:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86552590-891f-5a98-81cd-496dbf676116/86552590-891f-5a98-81cd-496dbf676116_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5367%252F18015367%252Finterior_rear_seats-1774696527424.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5367/18015367/interior_rear_seats-1774696527424.jpg saved to cache
2026-03-29 20:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 86552590-891f-5a98-81cd-496dbf676116
2026-03-29 20:16:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 81bd5520-fa3a-5ba3-90b6-a772cd67f702 with identifier: 20418638
2026-03-29 20:16:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 81bd5520-fa3a-5ba3-90b6-a772cd67f702 with identifier: 20418638
2026-03-29 20:16:40 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 81bd5520-fa3a-5ba3-90b6-a772cd67f702 with identifier: 20418638 to the API
2026-03-29 20:16:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/8638/20418638/exterior_rear_driver-1774772965255.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '81bd5520-fa3a-5ba3-90b6-a772cd67f702',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LL22 HHJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20418638',
'listing': 'auction',
'location': 'East Dunbartonshire Council Glasgow',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 41000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81bd5520-fa3a-5ba3-90b6-a772cd67f702/81bd5520-fa3a-5ba3-90b6-a772cd67f702_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1631255,
'Height': 2541,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8638/20418638/exterior_rear_driver-1774772965255.jpg',
'Width': 3388},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81bd5520-fa3a-5ba3-90b6-a772cd67f702/81bd5520-fa3a-5ba3-90b6-a772cd67f702_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1490085,
'Height': 2501,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8638/20418638/exterior_front_passenger-1774772743754.jpg',
'Width': 3335},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81bd5520-fa3a-5ba3-90b6-a772cd67f702/81bd5520-fa3a-5ba3-90b6-a772cd67f702_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1830206,
'Height': 2701,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8638/20418638/exterior_rear_passenger-1774773002827.jpg',
'Width': 3601},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81bd5520-fa3a-5ba3-90b6-a772cd67f702/81bd5520-fa3a-5ba3-90b6-a772cd67f702_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2430346,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8638/20418638/interior_front_seats-1774623670137.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81bd5520-fa3a-5ba3-90b6-a772cd67f702/81bd5520-fa3a-5ba3-90b6-a772cd67f702_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2472442,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8638/20418638/interior_rear_seats-1774623532817.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81bd5520-fa3a-5ba3-90b6-a772cd67f702/81bd5520-fa3a-5ba3-90b6-a772cd67f702_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1691032,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8638/20418638/interior_dashboard-1774772766734.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81bd5520-fa3a-5ba3-90b6-a772cd67f702/81bd5520-fa3a-5ba3-90b6-a772cd67f702_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2068491,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8638/20418638/instrument_cluster-1774623879207.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81bd5520-fa3a-5ba3-90b6-a772cd67f702/81bd5520-fa3a-5ba3-90b6-a772cd67f702_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2521782,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/8638/20418638/interior_boot-1774623527735.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81bd5520-fa3a-5ba3-90b6-a772cd67f702/81bd5520-fa3a-5ba3-90b6-a772cd67f702_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66180,
'Height': 895,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8638/20418638/docs_service_history-1774691110546.jpg?ixlib=js-3.8.0&auto=format&s=5e97f2ffe35f963e059aecedcd030dde',
'Width': 1290}],
'price': 12285,
'price_includes_vat': False,
'registration_date': '2022-05-27',
'seats_number': None,
'seller_name': None,
'title': 'Skoda Fabia Monte Carlo TSI S-A',
'transmission': 'automatic',
'trim': 'Monte Carlo TSI S-A',
'vin': 'TMBFR6PJ8N4041185',
'year': 2022}
2026-03-29 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720418638%27 HTTP/1.1" 200 None
2026-03-29 20:16:40 [motorway.uk] INFO: Saving data for 20418638: {'created_time': 1774815400.548471, 'last_price_update_time': 1774815400.548481, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20418638') HTTP/1.1" 204 0
2026-03-29 20:16:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5367/18015367/interior_dashboard-1774696541795.jpg> (referer: None)
2026-03-29 20:16:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8584/3408584/interior_rear_seats-1774632051933.jpg> (referer: None)
2026-03-29 20:16:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5367/18015367/exterior_front_driver-1774699057959.jpg> (referer: None)
2026-03-29 20:16:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/5654/4255654/docs_service_history-1774782691009.jpg?ixlib=js-3.8.0&auto=format&s=39e8cd5bd4cac23eb10fafcb819703c2> (referer: None)
2026-03-29 20:16:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8584/3408584/instrument_cluster-1774632142084.jpg> (referer: None)
2026-03-29 20:16:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8584/3408584/3408584-interior_dashboard-modified-1774710230324.jpeg> (referer: None)
2026-03-29 20:16:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5654/4255654/exterior_rear_passenger-1774782309243.jpg> (referer: None)
2026-03-29 20:16:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5654/4255654/instrument_cluster-1774720639224.jpg> (referer: None)
2026-03-29 20:16:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5456/20445456/instrument_cluster-1774631008768.jpg> (referer: None)
2026-03-29 20:16:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5456/20445456/interior_dashboard-1774630945698.jpg> (referer: None)
2026-03-29 20:16:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5654/4255654/interior_dashboard-1774782334338.jpg> (referer: None)
2026-03-29 20:16:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c72e50>
2026-03-29 20:16:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86552590-891f-5a98-81cd-496dbf676116/86552590-891f-5a98-81cd-496dbf676116_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5367%252F18015367%252Finterior_dashboard-1774696541795.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5367/18015367/interior_dashboard-1774696541795.jpg saved to cache
2026-03-29 20:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 86552590-891f-5a98-81cd-496dbf676116
2026-03-29 20:16:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658491c10>
2026-03-29 20:16:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6a5659c-145e-52fc-ae7f-6e84f637968b/a6a5659c-145e-52fc-ae7f-6e84f637968b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8584%252F3408584%252Finterior_rear_seats-1774632051933.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8584/3408584/interior_rear_seats-1774632051933.jpg saved to cache
2026-03-29 20:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a6a5659c-145e-52fc-ae7f-6e84f637968b
2026-03-29 20:16:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598da650>
2026-03-29 20:16:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86552590-891f-5a98-81cd-496dbf676116/86552590-891f-5a98-81cd-496dbf676116_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5367%252F18015367%252Fexterior_front_driver-1774699057959.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5367/18015367/exterior_front_driver-1774699057959.jpg saved to cache
2026-03-29 20:16:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86552590-891f-5a98-81cd-496dbf676116
2026-03-29 20:16:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 86552590-891f-5a98-81cd-496dbf676116, skipping ID generation
2026-03-29 20:16:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86552590-891f-5a98-81cd-496dbf676116 with scrape type 1
2026-03-29 20:16:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86552590-891f-5a98-81cd-496dbf676116 sending to next pipeline
2026-03-29 20:16:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 86552590-891f-5a98-81cd-496dbf676116, identifier: 18015367
2026-03-29 20:16:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658535090>
2026-03-29 20:16:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbf7fad-f6ac-542e-968e-285dd7234699/ecbf7fad-f6ac-542e-968e-285dd7234699_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F5654%252F4255654%252Fdocs_service_history-1774782691009.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D39e8cd5bd4cac23eb10fafcb819703c2') HTTP/1.1" 204 0
2026-03-29 20:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/5654/4255654/docs_service_history-1774782691009.jpg?ixlib=js-3.8.0&auto=format&s=39e8cd5bd4cac23eb10fafcb819703c2 saved to cache
2026-03-29 20:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ecbf7fad-f6ac-542e-968e-285dd7234699
2026-03-29 20:16:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658526990>
2026-03-29 20:16:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6a5659c-145e-52fc-ae7f-6e84f637968b/a6a5659c-145e-52fc-ae7f-6e84f637968b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8584%252F3408584%252Finstrument_cluster-1774632142084.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8584/3408584/instrument_cluster-1774632142084.jpg saved to cache
2026-03-29 20:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a6a5659c-145e-52fc-ae7f-6e84f637968b
2026-03-29 20:16:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e6ba50>
2026-03-29 20:16:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6a5659c-145e-52fc-ae7f-6e84f637968b/a6a5659c-145e-52fc-ae7f-6e84f637968b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8584%252F3408584%252F3408584-interior_dashboard-modified-1774710230324.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8584/3408584/3408584-interior_dashboard-modified-1774710230324.jpeg saved to cache
2026-03-29 20:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a6a5659c-145e-52fc-ae7f-6e84f637968b
2026-03-29 20:16:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6a5659c-145e-52fc-ae7f-6e84f637968b, skipping ID generation
2026-03-29 20:16:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6a5659c-145e-52fc-ae7f-6e84f637968b with scrape type 1
2026-03-29 20:16:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a6a5659c-145e-52fc-ae7f-6e84f637968b sending to next pipeline
2026-03-29 20:16:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a6a5659c-145e-52fc-ae7f-6e84f637968b, identifier: 3408584
2026-03-29 20:16:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f521d0>
2026-03-29 20:16:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbf7fad-f6ac-542e-968e-285dd7234699/ecbf7fad-f6ac-542e-968e-285dd7234699_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5654%252F4255654%252Fexterior_rear_passenger-1774782309243.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5654/4255654/exterior_rear_passenger-1774782309243.jpg saved to cache
2026-03-29 20:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ecbf7fad-f6ac-542e-968e-285dd7234699
2026-03-29 20:16:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c73590>
2026-03-29 20:16:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbf7fad-f6ac-542e-968e-285dd7234699/ecbf7fad-f6ac-542e-968e-285dd7234699_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5654%252F4255654%252Finstrument_cluster-1774720639224.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5654/4255654/instrument_cluster-1774720639224.jpg saved to cache
2026-03-29 20:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ecbf7fad-f6ac-542e-968e-285dd7234699
2026-03-29 20:16:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e6b8d0>
2026-03-29 20:16:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_489c0a9f-68f9-508b-ab83-5d1e64be4252/489c0a9f-68f9-508b-ab83-5d1e64be4252_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5456%252F20445456%252Finstrument_cluster-1774631008768.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5456/20445456/instrument_cluster-1774631008768.jpg saved to cache
2026-03-29 20:16:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 489c0a9f-68f9-508b-ab83-5d1e64be4252
2026-03-29 20:16:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6585165d0>
2026-03-29 20:16:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_489c0a9f-68f9-508b-ab83-5d1e64be4252/489c0a9f-68f9-508b-ab83-5d1e64be4252_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5456%252F20445456%252Finterior_dashboard-1774630945698.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5456/20445456/interior_dashboard-1774630945698.jpg saved to cache
2026-03-29 20:16:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 489c0a9f-68f9-508b-ab83-5d1e64be4252
2026-03-29 20:16:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c4cc50>
2026-03-29 20:16:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbf7fad-f6ac-542e-968e-285dd7234699/ecbf7fad-f6ac-542e-968e-285dd7234699_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5654%252F4255654%252Finterior_dashboard-1774782334338.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5654/4255654/interior_dashboard-1774782334338.jpg saved to cache
2026-03-29 20:16:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ecbf7fad-f6ac-542e-968e-285dd7234699
2026-03-29 20:16:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 86552590-891f-5a98-81cd-496dbf676116 with identifier: 18015367
2026-03-29 20:16:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 86552590-891f-5a98-81cd-496dbf676116 with identifier: 18015367
2026-03-29 20:16:42 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 86552590-891f-5a98-81cd-496dbf676116 with identifier: 18015367 to the API
2026-03-29 20:16:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/5367/18015367/exterior_front_driver-1774699057959.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '86552590-891f-5a98-81cd-496dbf676116',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'MV67 HMG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18015367',
'listing': 'auction',
'location': 'Stoke-on-Trent Stoke-on-Trent',
'make': 'Peugeot',
'model': '2008',
'odometer': 49048,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86552590-891f-5a98-81cd-496dbf676116/86552590-891f-5a98-81cd-496dbf676116_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2057813,
'Height': 2830,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5367/18015367/exterior_front_driver-1774699057959.jpg',
'Width': 3773},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86552590-891f-5a98-81cd-496dbf676116/86552590-891f-5a98-81cd-496dbf676116_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1548104,
'Height': 2602,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5367/18015367/exterior_rear_driver-1774633401173.jpg',
'Width': 3469},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86552590-891f-5a98-81cd-496dbf676116/86552590-891f-5a98-81cd-496dbf676116_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1095858,
'Height': 2437,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5367/18015367/exterior_front_passenger-1774633403776.jpg',
'Width': 3249},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86552590-891f-5a98-81cd-496dbf676116/86552590-891f-5a98-81cd-496dbf676116_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1497590,
'Height': 2843,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5367/18015367/exterior_rear_passenger-1774633402933.jpg',
'Width': 3790},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86552590-891f-5a98-81cd-496dbf676116/86552590-891f-5a98-81cd-496dbf676116_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2503099,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5367/18015367/interior_front_seats-1774696526105.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86552590-891f-5a98-81cd-496dbf676116/86552590-891f-5a98-81cd-496dbf676116_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2677875,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5367/18015367/interior_rear_seats-1774696527424.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86552590-891f-5a98-81cd-496dbf676116/86552590-891f-5a98-81cd-496dbf676116_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2102822,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5367/18015367/interior_dashboard-1774696541795.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86552590-891f-5a98-81cd-496dbf676116/86552590-891f-5a98-81cd-496dbf676116_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2055973,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5367/18015367/instrument_cluster-1774696540134.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86552590-891f-5a98-81cd-496dbf676116/86552590-891f-5a98-81cd-496dbf676116_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2485397,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5367/18015367/interior_boot-1774696530051.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86552590-891f-5a98-81cd-496dbf676116/86552590-891f-5a98-81cd-496dbf676116_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2364602,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5367/18015367/docs_service_history-1774696879196.jpg?ixlib=js-3.8.0&auto=format&s=d0180698c7a6ce86dd94c61079ff2c03',
'Width': 3840}],
'price': 4248,
'price_includes_vat': False,
'registration_date': '2017-09-30',
'seats_number': None,
'seller_name': None,
'title': 'Peugeot 2008 Allure S/S',
'transmission': 'manual',
'trim': 'Allure S/S',
'vin': 'VF3CUHNZ6HY115085',
'year': 2017}
2026-03-29 20:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718015367%27 HTTP/1.1" 200 None
2026-03-29 20:16:42 [motorway.uk] INFO: Saving data for 18015367: {'created_time': 1774815402.618967, 'last_price_update_time': 1774815402.618982, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18015367') HTTP/1.1" 204 0
2026-03-29 20:16:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a6a5659c-145e-52fc-ae7f-6e84f637968b with identifier: 3408584
2026-03-29 20:16:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a6a5659c-145e-52fc-ae7f-6e84f637968b with identifier: 3408584
2026-03-29 20:16:42 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a6a5659c-145e-52fc-ae7f-6e84f637968b with identifier: 3408584 to the API
2026-03-29 20:16:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/8584/3408584/3408584-interior_dashboard-modified-1774710230324.jpeg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'a6a5659c-145e-52fc-ae7f-6e84f637968b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LK65 YSN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/3408584',
'listing': 'auction',
'location': 'South Yorkshire Sheffield',
'make': 'Nissan',
'model': 'Pulsar',
'odometer': 52622,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6a5659c-145e-52fc-ae7f-6e84f637968b/a6a5659c-145e-52fc-ae7f-6e84f637968b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 898169,
'Height': 1893,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8584/3408584/3408584-exterior_front_driver-modified-1774710214850.jpeg',
'Width': 2524},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6a5659c-145e-52fc-ae7f-6e84f637968b/a6a5659c-145e-52fc-ae7f-6e84f637968b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 730835,
'Height': 1759,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8584/3408584/3408584-exterior_rear_driver-modified-1774710600216.jpeg',
'Width': 2345},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6a5659c-145e-52fc-ae7f-6e84f637968b/a6a5659c-145e-52fc-ae7f-6e84f637968b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 621556,
'Height': 1724,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8584/3408584/3408584-exterior_front_passenger-modified-1774710609462.jpeg',
'Width': 2299},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6a5659c-145e-52fc-ae7f-6e84f637968b/a6a5659c-145e-52fc-ae7f-6e84f637968b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 606831,
'Height': 1719,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8584/3408584/3408584-exterior_rear_passenger-modified-1774710625374.jpeg',
'Width': 2292},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6a5659c-145e-52fc-ae7f-6e84f637968b/a6a5659c-145e-52fc-ae7f-6e84f637968b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2032866,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8584/3408584/3408584-interior_front_seats-modified-1774710646048.jpeg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6a5659c-145e-52fc-ae7f-6e84f637968b/a6a5659c-145e-52fc-ae7f-6e84f637968b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1331409,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/8584/3408584/interior_rear_seats-1774632051933.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6a5659c-145e-52fc-ae7f-6e84f637968b/a6a5659c-145e-52fc-ae7f-6e84f637968b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2131291,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8584/3408584/3408584-interior_dashboard-modified-1774710230324.jpeg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6a5659c-145e-52fc-ae7f-6e84f637968b/a6a5659c-145e-52fc-ae7f-6e84f637968b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2367380,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8584/3408584/instrument_cluster-1774632142084.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6a5659c-145e-52fc-ae7f-6e84f637968b/a6a5659c-145e-52fc-ae7f-6e84f637968b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1900702,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/8584/3408584/interior_boot-1774632100159.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6a5659c-145e-52fc-ae7f-6e84f637968b/a6a5659c-145e-52fc-ae7f-6e84f637968b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1314555,
'Height': 3000,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8584/3408584/3408584-docs_service_history-default-1774629529626.jpg?ixlib=js-3.8.0&auto=format&s=6cc8300a51ecc4c475a6be6f52ebf1f8',
'Width': 4000}],
'price': 4020,
'price_includes_vat': False,
'registration_date': '2015-09-30',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Pulsar N-Tec DiG-T',
'transmission': 'manual',
'trim': 'N-Tec DiG-T',
'vin': 'VSKDDAC13U0046008',
'year': 2015}
2026-03-29 20:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273408584%27 HTTP/1.1" 200 None
2026-03-29 20:16:43 [motorway.uk] INFO: Saving data for 3408584: {'created_time': 1774815403.026312, 'last_price_update_time': 1774815403.026323, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='3408584') HTTP/1.1" 204 0
2026-03-29 20:16:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5654/4255654/exterior_front_passenger-1774719489416.jpg> (referer: None)
2026-03-29 20:16:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5654/4255654/interior_rear_seats-1774720549920.jpg> (referer: None)
2026-03-29 20:16:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5654/4255654/interior_front_seats-1774720535282.jpg> (referer: None)
2026-03-29 20:16:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b14c10>
2026-03-29 20:16:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbf7fad-f6ac-542e-968e-285dd7234699/ecbf7fad-f6ac-542e-968e-285dd7234699_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5654%252F4255654%252Fexterior_front_passenger-1774719489416.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5654/4255654/exterior_front_passenger-1774719489416.jpg saved to cache
2026-03-29 20:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ecbf7fad-f6ac-542e-968e-285dd7234699
2026-03-29 20:16:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a49550>
2026-03-29 20:16:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbf7fad-f6ac-542e-968e-285dd7234699/ecbf7fad-f6ac-542e-968e-285dd7234699_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5654%252F4255654%252Finterior_rear_seats-1774720549920.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5654/4255654/interior_rear_seats-1774720549920.jpg saved to cache
2026-03-29 20:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ecbf7fad-f6ac-542e-968e-285dd7234699
2026-03-29 20:16:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659aaab50>
2026-03-29 20:16:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbf7fad-f6ac-542e-968e-285dd7234699/ecbf7fad-f6ac-542e-968e-285dd7234699_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5654%252F4255654%252Finterior_front_seats-1774720535282.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5654/4255654/interior_front_seats-1774720535282.jpg saved to cache
2026-03-29 20:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ecbf7fad-f6ac-542e-968e-285dd7234699
2026-03-29 20:16:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1953/20141953/docs_service_history-1774695779046.jpg?ixlib=js-3.8.0&auto=format&s=f1ee303d278e5cc7de2d5f4028cf0ab6> (referer: None)
2026-03-29 20:16:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5456/20445456/exterior_rear_passenger-1774630325007.jpg> (referer: None)
2026-03-29 20:16:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5456/20445456/exterior_front_passenger-1774630352608.jpg> (referer: None)
2026-03-29 20:16:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5654/4255654/exterior_rear_driver-1774782292540.jpg> (referer: None)
2026-03-29 20:16:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5654/4255654/exterior_front_driver-1774719417981.jpg> (referer: None)
2026-03-29 20:16:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5456/20445456/interior_front_seats-1774630890936.jpg> (referer: None)
2026-03-29 20:16:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583c5fd0>
2026-03-29 20:16:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d683d739-09d3-5192-81c1-83ed9a59adf2/d683d739-09d3-5192-81c1-83ed9a59adf2_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1953%252F20141953%252Fdocs_service_history-1774695779046.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df1ee303d278e5cc7de2d5f4028cf0ab6') HTTP/1.1" 204 0
2026-03-29 20:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1953/20141953/docs_service_history-1774695779046.jpg?ixlib=js-3.8.0&auto=format&s=f1ee303d278e5cc7de2d5f4028cf0ab6 saved to cache
2026-03-29 20:16:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d683d739-09d3-5192-81c1-83ed9a59adf2
2026-03-29 20:16:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65830d6d0>
2026-03-29 20:16:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_489c0a9f-68f9-508b-ab83-5d1e64be4252/489c0a9f-68f9-508b-ab83-5d1e64be4252_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5456%252F20445456%252Fexterior_rear_passenger-1774630325007.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5456/20445456/exterior_rear_passenger-1774630325007.jpg saved to cache
2026-03-29 20:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 489c0a9f-68f9-508b-ab83-5d1e64be4252
2026-03-29 20:16:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587f61d0>
2026-03-29 20:16:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_489c0a9f-68f9-508b-ab83-5d1e64be4252/489c0a9f-68f9-508b-ab83-5d1e64be4252_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5456%252F20445456%252Fexterior_front_passenger-1774630352608.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5456/20445456/exterior_front_passenger-1774630352608.jpg saved to cache
2026-03-29 20:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 489c0a9f-68f9-508b-ab83-5d1e64be4252
2026-03-29 20:16:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65c0eec50>
2026-03-29 20:16:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbf7fad-f6ac-542e-968e-285dd7234699/ecbf7fad-f6ac-542e-968e-285dd7234699_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5654%252F4255654%252Fexterior_rear_driver-1774782292540.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5654/4255654/exterior_rear_driver-1774782292540.jpg saved to cache
2026-03-29 20:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ecbf7fad-f6ac-542e-968e-285dd7234699
2026-03-29 20:16:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587f4d10>
2026-03-29 20:16:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbf7fad-f6ac-542e-968e-285dd7234699/ecbf7fad-f6ac-542e-968e-285dd7234699_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5654%252F4255654%252Fexterior_front_driver-1774719417981.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5654/4255654/exterior_front_driver-1774719417981.jpg saved to cache
2026-03-29 20:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ecbf7fad-f6ac-542e-968e-285dd7234699
2026-03-29 20:16:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587f5510>
2026-03-29 20:16:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_489c0a9f-68f9-508b-ab83-5d1e64be4252/489c0a9f-68f9-508b-ab83-5d1e64be4252_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5456%252F20445456%252Finterior_front_seats-1774630890936.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5456/20445456/interior_front_seats-1774630890936.jpg saved to cache
2026-03-29 20:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 489c0a9f-68f9-508b-ab83-5d1e64be4252
2026-03-29 20:16:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5654/4255654/interior_boot-1774720581458.jpg> (referer: None)
2026-03-29 20:16:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1953/20141953/docs_service_history-1774695764667.jpg?ixlib=js-3.8.0&auto=format&s=b60094095c26900ddb8c54345c4640ec> (referer: None)
2026-03-29 20:16:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5456/20445456/exterior_front_driver-1774630455262.jpg> (referer: None)
2026-03-29 20:16:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0109/20500109/docs_service_history-1774776952239.jpg?ixlib=js-3.8.0&auto=format&s=0c13fe2d5ad76292e04357a555b5853e> (referer: None)
2026-03-29 20:16:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ce5dd0>
2026-03-29 20:16:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbf7fad-f6ac-542e-968e-285dd7234699/ecbf7fad-f6ac-542e-968e-285dd7234699_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5654%252F4255654%252Finterior_boot-1774720581458.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5654/4255654/interior_boot-1774720581458.jpg saved to cache
2026-03-29 20:16:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ecbf7fad-f6ac-542e-968e-285dd7234699
2026-03-29 20:16:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ecbf7fad-f6ac-542e-968e-285dd7234699, skipping ID generation
2026-03-29 20:16:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecbf7fad-f6ac-542e-968e-285dd7234699 with scrape type 1
2026-03-29 20:16:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ecbf7fad-f6ac-542e-968e-285dd7234699 sending to next pipeline
2026-03-29 20:16:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ecbf7fad-f6ac-542e-968e-285dd7234699, identifier: 4255654
2026-03-29 20:16:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ecbf7fad-f6ac-542e-968e-285dd7234699 with identifier: 4255654
2026-03-29 20:16:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ecbf7fad-f6ac-542e-968e-285dd7234699 with identifier: 4255654
2026-03-29 20:16:45 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ecbf7fad-f6ac-542e-968e-285dd7234699 with identifier: 4255654 to the API
2026-03-29 20:16:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/5654/4255654/interior_boot-1774720581458.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.1L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'ecbf7fad-f6ac-542e-968e-285dd7234699',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DH18 HDG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/4255654',
'listing': 'auction',
'location': 'Essex Brentwood',
'make': 'Mercedes',
'model': 'A Class',
'odometer': 59638,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecbf7fad-f6ac-542e-968e-285dd7234699/ecbf7fad-f6ac-542e-968e-285dd7234699_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1479573,
'Height': 2491,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5654/4255654/exterior_front_driver-1774719417981.jpg',
'Width': 3321},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecbf7fad-f6ac-542e-968e-285dd7234699/ecbf7fad-f6ac-542e-968e-285dd7234699_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1932986,
'Height': 2626,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5654/4255654/exterior_rear_driver-1774782292540.jpg',
'Width': 3501},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecbf7fad-f6ac-542e-968e-285dd7234699/ecbf7fad-f6ac-542e-968e-285dd7234699_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1692110,
'Height': 2594,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5654/4255654/exterior_front_passenger-1774719489416.jpg',
'Width': 3459},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecbf7fad-f6ac-542e-968e-285dd7234699/ecbf7fad-f6ac-542e-968e-285dd7234699_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2006496,
'Height': 2603,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5654/4255654/exterior_rear_passenger-1774782309243.jpg',
'Width': 3471},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecbf7fad-f6ac-542e-968e-285dd7234699/ecbf7fad-f6ac-542e-968e-285dd7234699_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4208974,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5654/4255654/interior_front_seats-1774720535282.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecbf7fad-f6ac-542e-968e-285dd7234699/ecbf7fad-f6ac-542e-968e-285dd7234699_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4934012,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5654/4255654/interior_rear_seats-1774720549920.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecbf7fad-f6ac-542e-968e-285dd7234699/ecbf7fad-f6ac-542e-968e-285dd7234699_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2649516,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5654/4255654/interior_dashboard-1774782334338.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecbf7fad-f6ac-542e-968e-285dd7234699/ecbf7fad-f6ac-542e-968e-285dd7234699_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2299102,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5654/4255654/instrument_cluster-1774720639224.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecbf7fad-f6ac-542e-968e-285dd7234699/ecbf7fad-f6ac-542e-968e-285dd7234699_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3815530,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5654/4255654/interior_boot-1774720581458.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecbf7fad-f6ac-542e-968e-285dd7234699/ecbf7fad-f6ac-542e-968e-285dd7234699_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1077699,
'Height': 3311,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/5654/4255654/docs_service_history-1774782691009.jpg?ixlib=js-3.8.0&auto=format&s=39e8cd5bd4cac23eb10fafcb819703c2',
'Width': 2483}],
'price': 7188,
'price_includes_vat': False,
'registration_date': '2018-06-11',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes A 200 D SE',
'transmission': 'manual',
'trim': 'A 200 D SE',
'vin': 'WDD1760082J656290',
'year': 2018}
2026-03-29 20:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%274255654%27 HTTP/1.1" 200 None
2026-03-29 20:16:45 [motorway.uk] INFO: Saving data for 4255654: {'created_time': 1774815405.321969, 'last_price_update_time': 1774815405.321981, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='4255654') HTTP/1.1" 204 0
2026-03-29 20:16:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c83850>
2026-03-29 20:16:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d683d739-09d3-5192-81c1-83ed9a59adf2/d683d739-09d3-5192-81c1-83ed9a59adf2_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1953%252F20141953%252Fdocs_service_history-1774695764667.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db60094095c26900ddb8c54345c4640ec') HTTP/1.1" 204 0
2026-03-29 20:16:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1953/20141953/docs_service_history-1774695764667.jpg?ixlib=js-3.8.0&auto=format&s=b60094095c26900ddb8c54345c4640ec saved to cache
2026-03-29 20:16:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d683d739-09d3-5192-81c1-83ed9a59adf2
2026-03-29 20:16:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658409b50>
2026-03-29 20:16:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_489c0a9f-68f9-508b-ab83-5d1e64be4252/489c0a9f-68f9-508b-ab83-5d1e64be4252_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5456%252F20445456%252Fexterior_front_driver-1774630455262.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5456/20445456/exterior_front_driver-1774630455262.jpg saved to cache
2026-03-29 20:16:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 489c0a9f-68f9-508b-ab83-5d1e64be4252
2026-03-29 20:16:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 489c0a9f-68f9-508b-ab83-5d1e64be4252, skipping ID generation
2026-03-29 20:16:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 489c0a9f-68f9-508b-ab83-5d1e64be4252 with scrape type 1
2026-03-29 20:16:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 489c0a9f-68f9-508b-ab83-5d1e64be4252 sending to next pipeline
2026-03-29 20:16:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 489c0a9f-68f9-508b-ab83-5d1e64be4252, identifier: 20445456
2026-03-29 20:16:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587a8150>
2026-03-29 20:16:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc41ada-3469-5224-9894-ca7faf4481cf/ffc41ada-3469-5224-9894-ca7faf4481cf_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0109%252F20500109%252Fdocs_service_history-1774776952239.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0c13fe2d5ad76292e04357a555b5853e') HTTP/1.1" 204 0
2026-03-29 20:16:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0109/20500109/docs_service_history-1774776952239.jpg?ixlib=js-3.8.0&auto=format&s=0c13fe2d5ad76292e04357a555b5853e saved to cache
2026-03-29 20:16:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ffc41ada-3469-5224-9894-ca7faf4481cf
2026-03-29 20:16:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 489c0a9f-68f9-508b-ab83-5d1e64be4252 with identifier: 20445456
2026-03-29 20:16:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 489c0a9f-68f9-508b-ab83-5d1e64be4252 with identifier: 20445456
2026-03-29 20:16:45 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 489c0a9f-68f9-508b-ab83-5d1e64be4252 with identifier: 20445456 to the API
2026-03-29 20:16:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5456/20445456/exterior_front_driver-1774630455262.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '489c0a9f-68f9-508b-ab83-5d1e64be4252',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'FV71 NKC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20445456',
'listing': 'auction',
'location': 'East Sussex Bexhill-on-Sea',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 61100,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_489c0a9f-68f9-508b-ab83-5d1e64be4252/489c0a9f-68f9-508b-ab83-5d1e64be4252_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1731387,
'Height': 2759,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5456/20445456/exterior_front_driver-1774630455262.jpg',
'Width': 3678},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_489c0a9f-68f9-508b-ab83-5d1e64be4252/489c0a9f-68f9-508b-ab83-5d1e64be4252_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1296268,
'Height': 2273,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5456/20445456/exterior_rear_driver-1774630315131.jpg',
'Width': 3030},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_489c0a9f-68f9-508b-ab83-5d1e64be4252/489c0a9f-68f9-508b-ab83-5d1e64be4252_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1932664,
'Height': 2764,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5456/20445456/exterior_front_passenger-1774630352608.jpg',
'Width': 3685},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_489c0a9f-68f9-508b-ab83-5d1e64be4252/489c0a9f-68f9-508b-ab83-5d1e64be4252_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1649349,
'Height': 2671,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5456/20445456/exterior_rear_passenger-1774630325007.jpg',
'Width': 3561},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_489c0a9f-68f9-508b-ab83-5d1e64be4252/489c0a9f-68f9-508b-ab83-5d1e64be4252_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2544389,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5456/20445456/interior_front_seats-1774630890936.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_489c0a9f-68f9-508b-ab83-5d1e64be4252/489c0a9f-68f9-508b-ab83-5d1e64be4252_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2296144,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5456/20445456/interior_rear_seats-1774630903542.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_489c0a9f-68f9-508b-ab83-5d1e64be4252/489c0a9f-68f9-508b-ab83-5d1e64be4252_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3693014,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5456/20445456/interior_dashboard-1774630945698.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_489c0a9f-68f9-508b-ab83-5d1e64be4252/489c0a9f-68f9-508b-ab83-5d1e64be4252_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3602016,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5456/20445456/instrument_cluster-1774631008768.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_489c0a9f-68f9-508b-ab83-5d1e64be4252/489c0a9f-68f9-508b-ab83-5d1e64be4252_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4269174,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5456/20445456/interior_boot-1774630954937.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_489c0a9f-68f9-508b-ab83-5d1e64be4252/489c0a9f-68f9-508b-ab83-5d1e64be4252_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1833562,
'Height': 2632,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5456/20445456/docs_service_history-1774631081242.jpg?ixlib=js-3.8.0&auto=format&s=422533452a3709f1d2ac682dafde215b',
'Width': 2680}],
'price': 10386,
'price_includes_vat': False,
'registration_date': '2021-11-22',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Qashqai Acenta Prem T MHEV CVT',
'transmission': 'automatic',
'trim': 'Acenta Prem T MHEV CVT',
'vin': 'SJNTAAJ12U1045086',
'year': 2021}
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720445456%27 HTTP/1.1" 200 None
2026-03-29 20:16:46 [motorway.uk] INFO: Saving data for 20445456: {'created_time': 1774815406.119397, 'last_price_update_time': 1774815406.119407, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20445456') HTTP/1.1" 204 0
2026-03-29 20:16:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20381378.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1953/20141953/interior_dashboard-1774695600652.jpg> (referer: None)
2026-03-29 20:16:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0109/20500109/docs_service_history-1774776945378.jpg?ixlib=js-3.8.0&auto=format&s=e581dfcd06ef754c2a32319dd9f50ca6> (referer: None)
2026-03-29 20:16:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1953/20141953/interior_boot-1774695617053.jpg> (referer: None)
2026-03-29 20:16:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0109/20500109/interior_boot-1774776766195.jpg> (referer: None)
2026-03-29 20:16:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 756e8471-a548-52eb-af51-af6e8d0451f8 with identifier: 20381378
2026-03-29 20:16:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 756e8471-a548-52eb-af51-af6e8d0451f8 with scrape type 1
2026-03-29 20:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 756e8471-a548-52eb-af51-af6e8d0451f8
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1378%252F20381378%252Fexterior_front_driver-1774715598785.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1378/20381378/exterior_front_driver-1774715598785.jpg not downloaded yet
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1378%252F20381378%252Fexterior_rear_driver-1774715627667.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1378/20381378/exterior_rear_driver-1774715627667.jpg not downloaded yet
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1378%252F20381378%252Fexterior_front_passenger-1774714854913.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1378/20381378/exterior_front_passenger-1774714854913.jpg not downloaded yet
2026-03-29 20:16:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65850f410>
2026-03-29 20:16:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d683d739-09d3-5192-81c1-83ed9a59adf2/d683d739-09d3-5192-81c1-83ed9a59adf2_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1953%252F20141953%252Finterior_dashboard-1774695600652.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1953/20141953/interior_dashboard-1774695600652.jpg saved to cache
2026-03-29 20:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d683d739-09d3-5192-81c1-83ed9a59adf2
2026-03-29 20:16:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586f4510>
2026-03-29 20:16:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc41ada-3469-5224-9894-ca7faf4481cf/ffc41ada-3469-5224-9894-ca7faf4481cf_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0109%252F20500109%252Fdocs_service_history-1774776945378.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De581dfcd06ef754c2a32319dd9f50ca6') HTTP/1.1" 204 0
2026-03-29 20:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0109/20500109/docs_service_history-1774776945378.jpg?ixlib=js-3.8.0&auto=format&s=e581dfcd06ef754c2a32319dd9f50ca6 saved to cache
2026-03-29 20:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ffc41ada-3469-5224-9894-ca7faf4481cf
2026-03-29 20:16:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658aa3b10>
2026-03-29 20:16:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d683d739-09d3-5192-81c1-83ed9a59adf2/d683d739-09d3-5192-81c1-83ed9a59adf2_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1953%252F20141953%252Finterior_boot-1774695617053.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1953/20141953/interior_boot-1774695617053.jpg saved to cache
2026-03-29 20:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d683d739-09d3-5192-81c1-83ed9a59adf2
2026-03-29 20:16:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659af8a10>
2026-03-29 20:16:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc41ada-3469-5224-9894-ca7faf4481cf/ffc41ada-3469-5224-9894-ca7faf4481cf_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0109%252F20500109%252Finterior_boot-1774776766195.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0109/20500109/interior_boot-1774776766195.jpg saved to cache
2026-03-29 20:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ffc41ada-3469-5224-9894-ca7faf4481cf
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1378%252F20381378%252Fexterior_rear_passenger-1774715892676.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1378/20381378/exterior_rear_passenger-1774715892676.jpg not downloaded yet
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1378%252F20381378%252Finterior_front_seats-1774715403742.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1378/20381378/interior_front_seats-1774715403742.jpg not downloaded yet
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1378%252F20381378%252Finterior_rear_seats-1774715419469.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1378/20381378/interior_rear_seats-1774715419469.jpg not downloaded yet
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1378%252F20381378%252Finterior_dashboard-1774715457899.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1378/20381378/interior_dashboard-1774715457899.jpg not downloaded yet
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1378%252F20381378%252Finstrument_cluster-1774715490823.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1378/20381378/instrument_cluster-1774715490823.jpg not downloaded yet
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1378%252F20381378%252Finterior_boot-1774715466415.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1378/20381378/interior_boot-1774715466415.jpg not downloaded yet
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1378%252F20381378%252Fdocs_service_history-1774715755005.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc6f7a721d79984af41099d1994b283a7%27 HTTP/1.1" 200 None
2026-03-29 20:16:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1378/20381378/docs_service_history-1774715755005.jpg?ixlib=js-3.8.0&auto=format&s=c6f7a721d79984af41099d1994b283a7 not downloaded yet
2026-03-29 20:16:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1953/20141953/interior_front_seats-1774695634774.jpg> (referer: None)
2026-03-29 20:16:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1953/20141953/interior_rear_seats-1774695628920.jpg> (referer: None)
2026-03-29 20:16:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0109/20500109/20500109-interior_dashboard-modified-1774777972953.jpeg> (referer: None)
2026-03-29 20:16:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20175346.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b326d0>
2026-03-29 20:16:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d683d739-09d3-5192-81c1-83ed9a59adf2/d683d739-09d3-5192-81c1-83ed9a59adf2_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1953%252F20141953%252Finterior_front_seats-1774695634774.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1953/20141953/interior_front_seats-1774695634774.jpg saved to cache
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d683d739-09d3-5192-81c1-83ed9a59adf2
2026-03-29 20:16:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659eabe90>
2026-03-29 20:16:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d683d739-09d3-5192-81c1-83ed9a59adf2/d683d739-09d3-5192-81c1-83ed9a59adf2_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1953%252F20141953%252Finterior_rear_seats-1774695628920.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1953/20141953/interior_rear_seats-1774695628920.jpg saved to cache
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d683d739-09d3-5192-81c1-83ed9a59adf2
2026-03-29 20:16:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658130d90>
2026-03-29 20:16:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc41ada-3469-5224-9894-ca7faf4481cf/ffc41ada-3469-5224-9894-ca7faf4481cf_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0109%252F20500109%252F20500109-interior_dashboard-modified-1774777972953.jpeg') HTTP/1.1" 204 0
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0109/20500109/20500109-interior_dashboard-modified-1774777972953.jpeg saved to cache
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ffc41ada-3469-5224-9894-ca7faf4481cf
2026-03-29 20:16:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8 with identifier: 20175346
2026-03-29 20:16:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8 with scrape type 1
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5346%252F20175346%252Fexterior_front_driver-1773231869958.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5346/20175346/exterior_front_driver-1773231869958.jpg not downloaded yet
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5346%252F20175346%252Fexterior_rear_driver-1773233214791.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5346/20175346/exterior_rear_driver-1773233214791.jpg not downloaded yet
2026-03-29 20:16:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1378/20381378/exterior_rear_passenger-1774715892676.jpg> (referer: None)
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5346%252F20175346%252Fexterior_front_passenger-1773232028094.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5346/20175346/exterior_front_passenger-1773232028094.jpg not downloaded yet
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5346%252F20175346%252Fexterior_rear_passenger-1773760551028.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5346/20175346/exterior_rear_passenger-1773760551028.jpg not downloaded yet
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5346%252F20175346%252Finterior_front_seats-1773761059153.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5346/20175346/interior_front_seats-1773761059153.jpg not downloaded yet
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5346%252F20175346%252Finterior_rear_seats-1773232493715.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5346/20175346/interior_rear_seats-1773232493715.jpg not downloaded yet
2026-03-29 20:16:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1378/20381378/docs_service_history-1774715755005.jpg?ixlib=js-3.8.0&auto=format&s=c6f7a721d79984af41099d1994b283a7> (referer: None)
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5346%252F20175346%252Finterior_dashboard-1773232454886.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5346/20175346/interior_dashboard-1773232454886.jpg not downloaded yet
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5346%252F20175346%252Finterior_boot-1773233232515.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5346/20175346/interior_boot-1773233232515.jpg not downloaded yet
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5346%252F20175346%252Fdamage_scratches-1773762117034.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5346/20175346/damage_scratches-1773762117034.jpg not downloaded yet
2026-03-29 20:16:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658109b50>
2026-03-29 20:16:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_756e8471-a548-52eb-af51-af6e8d0451f8/756e8471-a548-52eb-af51-af6e8d0451f8_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1378%252F20381378%252Fexterior_rear_passenger-1774715892676.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1378/20381378/exterior_rear_passenger-1774715892676.jpg saved to cache
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 756e8471-a548-52eb-af51-af6e8d0451f8
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5346%252F20175346%252Fdamage_scratches-1773762166477.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5346/20175346/damage_scratches-1773762166477.jpg not downloaded yet
2026-03-29 20:16:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65813df50>
2026-03-29 20:16:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_756e8471-a548-52eb-af51-af6e8d0451f8/756e8471-a548-52eb-af51-af6e8d0451f8_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1378%252F20381378%252Fdocs_service_history-1774715755005.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc6f7a721d79984af41099d1994b283a7') HTTP/1.1" 204 0
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1378/20381378/docs_service_history-1774715755005.jpg?ixlib=js-3.8.0&auto=format&s=c6f7a721d79984af41099d1994b283a7 saved to cache
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 756e8471-a548-52eb-af51-af6e8d0451f8
2026-03-29 20:16:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1378/20381378/exterior_front_passenger-1774714854913.jpg> (referer: None)
2026-03-29 20:16:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1378/20381378/interior_boot-1774715466415.jpg> (referer: None)
2026-03-29 20:16:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5346/20175346/exterior_front_driver-1773231869958.jpg> (referer: None)
2026-03-29 20:16:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf11250>
2026-03-29 20:16:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_756e8471-a548-52eb-af51-af6e8d0451f8/756e8471-a548-52eb-af51-af6e8d0451f8_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1378%252F20381378%252Fexterior_front_passenger-1774714854913.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1378/20381378/exterior_front_passenger-1774714854913.jpg saved to cache
2026-03-29 20:16:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 756e8471-a548-52eb-af51-af6e8d0451f8
2026-03-29 20:16:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5346/20175346/damage_scratches-1773762166477.jpg> (referer: None)
2026-03-29 20:16:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598f3150>
2026-03-29 20:16:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_756e8471-a548-52eb-af51-af6e8d0451f8/756e8471-a548-52eb-af51-af6e8d0451f8_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1378%252F20381378%252Finterior_boot-1774715466415.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1378/20381378/interior_boot-1774715466415.jpg saved to cache
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 756e8471-a548-52eb-af51-af6e8d0451f8
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ae80d0>
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8/fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5346%252F20175346%252Fexterior_front_driver-1773231869958.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5346/20175346/exterior_front_driver-1773231869958.jpg saved to cache
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8
2026-03-29 20:16:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1378/20381378/instrument_cluster-1774715490823.jpg> (referer: None)
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ab9b90>
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8/fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5346%252F20175346%252Fdamage_scratches-1773762166477.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5346/20175346/damage_scratches-1773762166477.jpg saved to cache
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8
2026-03-29 20:16:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1378/20381378/interior_dashboard-1774715457899.jpg> (referer: None)
2026-03-29 20:16:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5346/20175346/damage_scratches-1773762117034.jpg> (referer: None)
2026-03-29 20:16:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c244d0>
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_756e8471-a548-52eb-af51-af6e8d0451f8/756e8471-a548-52eb-af51-af6e8d0451f8_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1378%252F20381378%252Finstrument_cluster-1774715490823.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1378/20381378/instrument_cluster-1774715490823.jpg saved to cache
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 756e8471-a548-52eb-af51-af6e8d0451f8
2026-03-29 20:16:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ae96d0>
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_756e8471-a548-52eb-af51-af6e8d0451f8/756e8471-a548-52eb-af51-af6e8d0451f8_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1378%252F20381378%252Finterior_dashboard-1774715457899.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1378/20381378/interior_dashboard-1774715457899.jpg saved to cache
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 756e8471-a548-52eb-af51-af6e8d0451f8
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659cc1510>
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8/fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5346%252F20175346%252Fdamage_scratches-1773762117034.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5346/20175346/damage_scratches-1773762117034.jpg saved to cache
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8
2026-03-29 20:16:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5346/20175346/exterior_rear_passenger-1773760551028.jpg> (referer: None)
2026-03-29 20:16:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5346/20175346/exterior_front_passenger-1773232028094.jpg> (referer: None)
2026-03-29 20:16:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5346/20175346/interior_rear_seats-1773232493715.jpg> (referer: None)
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ce7a50>
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8/fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5346%252F20175346%252Fexterior_rear_passenger-1773760551028.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5346/20175346/exterior_rear_passenger-1773760551028.jpg saved to cache
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65813cc90>
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8/fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5346%252F20175346%252Fexterior_front_passenger-1773232028094.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5346/20175346/exterior_front_passenger-1773232028094.jpg saved to cache
2026-03-29 20:16:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8
2026-03-29 20:16:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:16:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:16:48 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xf0\x0f\x00\x00'
2026-03-29 20:16:48 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-A176B\x00'
2026-03-29 20:16:48 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:16:48 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'A176BXXS2AYI3\x00'
2026-03-29 20:16:48 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\xf4\x0b\x00\x00'
2026-03-29 20:16:48 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:16:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xe1\x00\x00\x00'
2026-03-29 20:16:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x06\x00'
2026-03-29 20:16:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:16:48 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:11 12:33:24\x00'
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658aebf10>
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8/fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5346%252F20175346%252Finterior_rear_seats-1773232493715.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5346/20175346/interior_rear_seats-1773232493715.jpg saved to cache
2026-03-29 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8
2026-03-29 20:16:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5346/20175346/exterior_rear_driver-1773233214791.jpg> (referer: None)
2026-03-29 20:16:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5346/20175346/interior_boot-1773233232515.jpg> (referer: None)
2026-03-29 20:16:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1378/20381378/interior_rear_seats-1774715419469.jpg> (referer: None)
2026-03-29 20:16:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ae8050>
2026-03-29 20:16:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8/fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5346%252F20175346%252Fexterior_rear_driver-1773233214791.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5346/20175346/exterior_rear_driver-1773233214791.jpg saved to cache
2026-03-29 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8
2026-03-29 20:16:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:16:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:16:49 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xf0\x0f\x00\x00'
2026-03-29 20:16:49 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-A176B\x00'
2026-03-29 20:16:49 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:16:49 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'A176BXXS2AYI3\x00'
2026-03-29 20:16:49 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\xf4\x0b\x00\x00'
2026-03-29 20:16:49 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:16:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xe1\x00\x00\x00'
2026-03-29 20:16:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x06\x00'
2026-03-29 20:16:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:16:49 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:11 12:33:46\x00'
2026-03-29 20:16:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587060d0>
2026-03-29 20:16:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8/fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5346%252F20175346%252Finterior_boot-1773233232515.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5346/20175346/interior_boot-1773233232515.jpg saved to cache
2026-03-29 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8
2026-03-29 20:16:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586e2750>
2026-03-29 20:16:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_756e8471-a548-52eb-af51-af6e8d0451f8/756e8471-a548-52eb-af51-af6e8d0451f8_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1378%252F20381378%252Finterior_rear_seats-1774715419469.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1378/20381378/interior_rear_seats-1774715419469.jpg saved to cache
2026-03-29 20:16:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 756e8471-a548-52eb-af51-af6e8d0451f8
2026-03-29 20:16:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1378/20381378/exterior_rear_driver-1774715627667.jpg> (referer: None)
2026-03-29 20:16:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1378/20381378/interior_front_seats-1774715403742.jpg> (referer: None)
2026-03-29 20:16:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e2f450>
2026-03-29 20:16:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_756e8471-a548-52eb-af51-af6e8d0451f8/756e8471-a548-52eb-af51-af6e8d0451f8_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1378%252F20381378%252Fexterior_rear_driver-1774715627667.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1378/20381378/exterior_rear_driver-1774715627667.jpg saved to cache
2026-03-29 20:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 756e8471-a548-52eb-af51-af6e8d0451f8
2026-03-29 20:16:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5346/20175346/interior_dashboard-1773232454886.jpg> (referer: None)
2026-03-29 20:16:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65811b310>
2026-03-29 20:16:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_756e8471-a548-52eb-af51-af6e8d0451f8/756e8471-a548-52eb-af51-af6e8d0451f8_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1378%252F20381378%252Finterior_front_seats-1774715403742.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1378/20381378/interior_front_seats-1774715403742.jpg saved to cache
2026-03-29 20:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 756e8471-a548-52eb-af51-af6e8d0451f8
2026-03-29 20:16:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:16:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:16:50 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xf0\x0f\x00\x00'
2026-03-29 20:16:50 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-A176B\x00'
2026-03-29 20:16:50 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:16:50 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'A176BXXS2AYI3\x00'
2026-03-29 20:16:50 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\xf4\x0b\x00\x00'
2026-03-29 20:16:50 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:16:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xe1\x00\x00\x00'
2026-03-29 20:16:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x06\x00'
2026-03-29 20:16:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:16:50 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:11 12:33:33\x00'
2026-03-29 20:16:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584def50>
2026-03-29 20:16:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8/fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5346%252F20175346%252Finterior_dashboard-1773232454886.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5346/20175346/interior_dashboard-1773232454886.jpg saved to cache
2026-03-29 20:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8
2026-03-29 20:16:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20489356.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1378/20381378/exterior_front_driver-1774715598785.jpg> (referer: None)
2026-03-29 20:16:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1953/20141953/exterior_rear_passenger-1774690201751.jpg> (referer: None)
2026-03-29 20:16:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0109/20500109/interior_front_seats-1774776734691.jpg> (referer: None)
2026-03-29 20:16:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc with identifier: 20489356
2026-03-29 20:16:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc with scrape type 1
2026-03-29 20:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc
2026-03-29 20:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9356%252F20489356%252Fexterior_front_driver-1774716029503.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9356/20489356/exterior_front_driver-1774716029503.jpg not downloaded yet
2026-03-29 20:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9356%252F20489356%252Fexterior_rear_driver-1774716037196.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9356/20489356/exterior_rear_driver-1774716037196.jpg not downloaded yet
2026-03-29 20:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9356%252F20489356%252Fexterior_front_passenger-1774716064487.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9356/20489356/exterior_front_passenger-1774716064487.jpg not downloaded yet
2026-03-29 20:16:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ab86d0>
2026-03-29 20:16:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_756e8471-a548-52eb-af51-af6e8d0451f8/756e8471-a548-52eb-af51-af6e8d0451f8_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1378%252F20381378%252Fexterior_front_driver-1774715598785.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1378/20381378/exterior_front_driver-1774715598785.jpg saved to cache
2026-03-29 20:16:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 756e8471-a548-52eb-af51-af6e8d0451f8
2026-03-29 20:16:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 756e8471-a548-52eb-af51-af6e8d0451f8, skipping ID generation
2026-03-29 20:16:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 756e8471-a548-52eb-af51-af6e8d0451f8 with scrape type 1
2026-03-29 20:16:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 756e8471-a548-52eb-af51-af6e8d0451f8 sending to next pipeline
2026-03-29 20:16:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 756e8471-a548-52eb-af51-af6e8d0451f8, identifier: 20381378
2026-03-29 20:16:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a6e250>
2026-03-29 20:16:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d683d739-09d3-5192-81c1-83ed9a59adf2/d683d739-09d3-5192-81c1-83ed9a59adf2_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1953%252F20141953%252Fexterior_rear_passenger-1774690201751.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1953/20141953/exterior_rear_passenger-1774690201751.jpg saved to cache
2026-03-29 20:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d683d739-09d3-5192-81c1-83ed9a59adf2
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9356%252F20489356%252Fexterior_rear_passenger-1774716047607.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9356/20489356/exterior_rear_passenger-1774716047607.jpg not downloaded yet
2026-03-29 20:16:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 756e8471-a548-52eb-af51-af6e8d0451f8 with identifier: 20381378
2026-03-29 20:16:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 756e8471-a548-52eb-af51-af6e8d0451f8 with identifier: 20381378
2026-03-29 20:16:51 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 756e8471-a548-52eb-af51-af6e8d0451f8 with identifier: 20381378 to the API
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1378/20381378/exterior_front_driver-1774715598785.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '756e8471-a548-52eb-af51-af6e8d0451f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'MK02 AJK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20381378',
'listing': 'auction',
'location': 'Northamptonshire Kettering',
'make': 'Nissan',
'model': 'Juke',
'odometer': 58000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_756e8471-a548-52eb-af51-af6e8d0451f8/756e8471-a548-52eb-af51-af6e8d0451f8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1374371,
'Height': 2458,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1378/20381378/exterior_front_driver-1774715598785.jpg',
'Width': 3277},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_756e8471-a548-52eb-af51-af6e8d0451f8/756e8471-a548-52eb-af51-af6e8d0451f8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1650486,
'Height': 2450,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1378/20381378/exterior_rear_driver-1774715627667.jpg',
'Width': 3266},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_756e8471-a548-52eb-af51-af6e8d0451f8/756e8471-a548-52eb-af51-af6e8d0451f8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1856692,
'Height': 2825,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1378/20381378/exterior_front_passenger-1774714854913.jpg',
'Width': 3766},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_756e8471-a548-52eb-af51-af6e8d0451f8/756e8471-a548-52eb-af51-af6e8d0451f8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1081101,
'Height': 2354,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1378/20381378/exterior_rear_passenger-1774715892676.jpg',
'Width': 3139},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_756e8471-a548-52eb-af51-af6e8d0451f8/756e8471-a548-52eb-af51-af6e8d0451f8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3228470,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1378/20381378/interior_front_seats-1774715403742.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_756e8471-a548-52eb-af51-af6e8d0451f8/756e8471-a548-52eb-af51-af6e8d0451f8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2884934,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1378/20381378/interior_rear_seats-1774715419469.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_756e8471-a548-52eb-af51-af6e8d0451f8/756e8471-a548-52eb-af51-af6e8d0451f8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2893349,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1378/20381378/interior_dashboard-1774715457899.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_756e8471-a548-52eb-af51-af6e8d0451f8/756e8471-a548-52eb-af51-af6e8d0451f8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1537843,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1378/20381378/instrument_cluster-1774715490823.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_756e8471-a548-52eb-af51-af6e8d0451f8/756e8471-a548-52eb-af51-af6e8d0451f8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3987944,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1378/20381378/interior_boot-1774715466415.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_756e8471-a548-52eb-af51-af6e8d0451f8/756e8471-a548-52eb-af51-af6e8d0451f8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 948287,
'Height': 2453,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1378/20381378/docs_service_history-1774715755005.jpg?ixlib=js-3.8.0&auto=format&s=c6f7a721d79984af41099d1994b283a7',
'Width': 3538}],
'price': 7744,
'price_includes_vat': False,
'registration_date': '2019-03-29',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Juke Tekna CVT',
'transmission': 'automatic',
'trim': 'Tekna CVT',
'vin': 'SJNFBAF15U8061446',
'year': 2019}
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720381378%27 HTTP/1.1" 200 None
2026-03-29 20:16:51 [motorway.uk] INFO: Saving data for 20381378: {'created_time': 1774815411.641674, 'last_price_update_time': 1774815411.641685, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20381378') HTTP/1.1" 204 0
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9356%252F20489356%252Finterior_front_seats-1774716361438.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9356/20489356/interior_front_seats-1774716361438.jpg not downloaded yet
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9356%252F20489356%252Finterior_rear_seats-1774716373225.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9356/20489356/interior_rear_seats-1774716373225.jpg not downloaded yet
2026-03-29 20:16:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658108d50>
2026-03-29 20:16:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc41ada-3469-5224-9894-ca7faf4481cf/ffc41ada-3469-5224-9894-ca7faf4481cf_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0109%252F20500109%252Finterior_front_seats-1774776734691.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0109/20500109/interior_front_seats-1774776734691.jpg saved to cache
2026-03-29 20:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ffc41ada-3469-5224-9894-ca7faf4481cf
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9356%252F20489356%252Finterior_dashboard-1774716452307.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9356/20489356/interior_dashboard-1774716452307.jpg not downloaded yet
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9356%252F20489356%252Finterior_boot-1774716402470.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9356/20489356/interior_boot-1774716402470.jpg not downloaded yet
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9356%252F20489356%252Fdamage_dents-1774716080579.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9356/20489356/damage_dents-1774716080579.jpg not downloaded yet
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9356%252F20489356%252Fwheels_front_driver-1774716104522.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:16:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9356/20489356/wheels_front_driver-1774716104522.jpg not downloaded yet
2026-03-29 20:16:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1953/20141953/exterior_front_passenger-1774690207822.jpg> (referer: None)
2026-03-29 20:16:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1953/20141953/exterior_rear_driver-1774690202921.jpg> (referer: None)
2026-03-29 20:16:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0109/20500109/exterior_rear_passenger-1774776101187.jpg> (referer: None)
2026-03-29 20:16:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5346/20175346/interior_front_seats-1773761059153.jpg> (referer: None)
2026-03-29 20:16:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c5afd0>
2026-03-29 20:16:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d683d739-09d3-5192-81c1-83ed9a59adf2/d683d739-09d3-5192-81c1-83ed9a59adf2_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1953%252F20141953%252Fexterior_front_passenger-1774690207822.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1953/20141953/exterior_front_passenger-1774690207822.jpg saved to cache
2026-03-29 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d683d739-09d3-5192-81c1-83ed9a59adf2
2026-03-29 20:16:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658b2f8d0>
2026-03-29 20:16:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d683d739-09d3-5192-81c1-83ed9a59adf2/d683d739-09d3-5192-81c1-83ed9a59adf2_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1953%252F20141953%252Fexterior_rear_driver-1774690202921.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1953/20141953/exterior_rear_driver-1774690202921.jpg saved to cache
2026-03-29 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d683d739-09d3-5192-81c1-83ed9a59adf2
2026-03-29 20:16:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658dabfd0>
2026-03-29 20:16:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc41ada-3469-5224-9894-ca7faf4481cf/ffc41ada-3469-5224-9894-ca7faf4481cf_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0109%252F20500109%252Fexterior_rear_passenger-1774776101187.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0109/20500109/exterior_rear_passenger-1774776101187.jpg saved to cache
2026-03-29 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ffc41ada-3469-5224-9894-ca7faf4481cf
2026-03-29 20:16:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:16:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:16:52 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xf0\x0f\x00\x00'
2026-03-29 20:16:52 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-A176B\x00'
2026-03-29 20:16:52 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:16:52 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'A176BXXS2AYI3\x00'
2026-03-29 20:16:52 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\xf4\x0b\x00\x00'
2026-03-29 20:16:52 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:16:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\xe1\x00\x00\x00'
2026-03-29 20:16:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x06\x00'
2026-03-29 20:16:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:16:52 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:17 15:24:04\x00'
2026-03-29 20:16:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c3c050>
2026-03-29 20:16:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8/fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5346%252F20175346%252Finterior_front_seats-1773761059153.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5346/20175346/interior_front_seats-1773761059153.jpg saved to cache
2026-03-29 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8
2026-03-29 20:16:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8, skipping ID generation
2026-03-29 20:16:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8 with scrape type 1
2026-03-29 20:16:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8 sending to next pipeline
2026-03-29 20:16:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8, identifier: 20175346
2026-03-29 20:16:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8 with identifier: 20175346
2026-03-29 20:16:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8 with identifier: 20175346
2026-03-29 20:16:52 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8 with identifier: 20175346 to the API
2026-03-29 20:16:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:16:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:16:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/5346/20175346/interior_front_seats-1773761059153.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'AO12 OPM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20175346',
'listing': 'auction',
'location': 'Central Bedfordshire Dunstable',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 122700,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8/fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 811217,
'Height': 2051,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5346/20175346/exterior_front_driver-1773231869958.jpg',
'Width': 2734},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8/fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 932403,
'Height': 2159,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5346/20175346/exterior_rear_driver-1773233214791.jpg',
'Width': 2878},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8/fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 935193,
'Height': 1954,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5346/20175346/exterior_front_passenger-1773232028094.jpg',
'Width': 2605},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8/fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 685376,
'Height': 2000,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5346/20175346/exterior_rear_passenger-1773760551028.jpg',
'Width': 2666},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8/fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 8996196,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/5346/20175346/interior_front_seats-1773761059153.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8/fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 10383026,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/5346/20175346/interior_rear_seats-1773232493715.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8/fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 10369412,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5346/20175346/interior_dashboard-1773232454886.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8/fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 10222569,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/5346/20175346/interior_boot-1773233232515.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8/fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51159,
'Height': 419,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5346/20175346/damage_scratches-1773762117034.jpg',
'Width': 558},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8/fa2e6b0a-9fe8-5d9c-bdc9-034e7e760fb8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 30634,
'Height': 323,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5346/20175346/damage_scratches-1773762166477.jpg',
'Width': 430}],
'price': 1031,
'price_includes_vat': False,
'registration_date': '2012-04-27',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Polo Match TDI',
'transmission': 'manual',
'trim': 'Match TDI',
'vin': 'WVWZZZ6RZCU055451',
'year': 2012}
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720175346%27 HTTP/1.1" 200 None
2026-03-29 20:16:53 [motorway.uk] INFO: Saving data for 20175346: {'created_time': 1774815413.07732, 'last_price_update_time': 1774815413.07733, 'auction_closing_time': 1774884600.0}
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20175346') HTTP/1.1" 204 0
2026-03-29 20:16:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1152&page=32&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:16:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:16:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9356/20489356/wheels_front_driver-1774716104522.jpg> (referer: None)
2026-03-29 20:16:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9356/20489356/interior_dashboard-1774716452307.jpg> (referer: None)
2026-03-29 20:16:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9356/20489356/damage_dents-1774716080579.jpg> (referer: None)
2026-03-29 20:16:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9356/20489356/interior_boot-1774716402470.jpg> (referer: None)
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 18037733
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 20357003
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720357003%27 HTTP/1.1" 200 None
2026-03-29 20:16:53 [motorway.uk] INFO: Scrape type for 20357003: 1
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 20419987
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720419987%27 HTTP/1.1" 200 None
2026-03-29 20:16:53 [motorway.uk] INFO: Scrape type for 20419987: 1
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 20487473
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 20355479
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 12517194
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 17744204
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717744204%27 HTTP/1.1" 200 None
2026-03-29 20:16:53 [motorway.uk] INFO: Scrape type for 17744204: 1
2026-03-29 20:16:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf08190>
2026-03-29 20:16:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc/3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9356%252F20489356%252Fwheels_front_driver-1774716104522.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9356/20489356/wheels_front_driver-1774716104522.jpg saved to cache
2026-03-29 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 20209184
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 9654966
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 17811380
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 20487082
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 20405903
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 20335691
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 20492519
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720492519%27 HTTP/1.1" 200 None
2026-03-29 20:16:53 [motorway.uk] INFO: Scrape type for 20492519: 1
2026-03-29 20:16:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c5b810>
2026-03-29 20:16:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc/3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9356%252F20489356%252Finterior_dashboard-1774716452307.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9356/20489356/interior_dashboard-1774716452307.jpg saved to cache
2026-03-29 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc
2026-03-29 20:16:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658439710>
2026-03-29 20:16:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc/3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9356%252F20489356%252Fdamage_dents-1774716080579.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9356/20489356/damage_dents-1774716080579.jpg saved to cache
2026-03-29 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 19185025
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719185025%27 HTTP/1.1" 200 None
2026-03-29 20:16:53 [motorway.uk] INFO: Scrape type for 19185025: 1
2026-03-29 20:16:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a80a90>
2026-03-29 20:16:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc/3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9356%252F20489356%252Finterior_boot-1774716402470.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9356/20489356/interior_boot-1774716402470.jpg saved to cache
2026-03-29 20:16:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 20473857
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720473857%27 HTTP/1.1" 200 None
2026-03-29 20:16:53 [motorway.uk] INFO: Scrape type for 20473857: 1
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 18463422
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 20432038
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 20466969
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 16001492
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 20488676
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 19668749
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719668749%27 HTTP/1.1" 200 None
2026-03-29 20:16:53 [motorway.uk] INFO: Scrape type for 19668749: 1
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 20386402
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 20456408
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 20144250
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720144250%27 HTTP/1.1" 200 None
2026-03-29 20:16:53 [motorway.uk] INFO: Scrape type for 20144250: 1
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 19436717
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 20482913
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720482913%27 HTTP/1.1" 200 None
2026-03-29 20:16:53 [motorway.uk] INFO: Scrape type for 20482913: 1
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 20165260
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 20420247
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 20458630
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 18085024
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 20484226
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 15574359
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 20469502
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 20453801
2026-03-29 20:16:53 [motorway.uk] INFO: Found listing with ID: 20497569
2026-03-29 20:16:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9356/20489356/exterior_rear_passenger-1774716047607.jpg> (referer: None)
2026-03-29 20:16:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9356/20489356/exterior_rear_driver-1774716037196.jpg> (referer: None)
2026-03-29 20:16:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9356/20489356/exterior_front_passenger-1774716064487.jpg> (referer: None)
2026-03-29 20:16:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9356/20489356/interior_front_seats-1774716361438.jpg> (referer: None)
2026-03-29 20:16:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9356/20489356/interior_rear_seats-1774716373225.jpg> (referer: None)
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ec5f90>
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc/3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9356%252F20489356%252Fexterior_rear_passenger-1774716047607.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9356/20489356/exterior_rear_passenger-1774716047607.jpg saved to cache
2026-03-29 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a46d10>
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc/3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9356%252F20489356%252Fexterior_rear_driver-1774716037196.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9356/20489356/exterior_rear_driver-1774716037196.jpg saved to cache
2026-03-29 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658493b90>
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc/3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9356%252F20489356%252Fexterior_front_passenger-1774716064487.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9356/20489356/exterior_front_passenger-1774716064487.jpg saved to cache
2026-03-29 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc
2026-03-29 20:16:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583e7e10>
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc/3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9356%252F20489356%252Finterior_front_seats-1774716361438.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9356/20489356/interior_front_seats-1774716361438.jpg saved to cache
2026-03-29 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc
2026-03-29 20:16:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:16:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:16:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:16:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658491f90>
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:16:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc/3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:16:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9356%252F20489356%252Finterior_rear_seats-1774716373225.jpg') HTTP/1.1" 204 0
2026-03-29 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9356/20489356/interior_rear_seats-1774716373225.jpg saved to cache
2026-03-29 20:16:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3deb9b7a-91c9-5ece-ad17-b7e6bfd68dfc
2026-03-29 20:17:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13316160.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b458cbe5-b009-5a2e-a174-b65d4f1d89da with identifier: 13316160
2026-03-29 20:17:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b458cbe5-b009-5a2e-a174-b65d4f1d89da with scrape type 1
2026-03-29 20:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b458cbe5-b009-5a2e-a174-b65d4f1d89da
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6160%252F13316160%252Fexterior_front_driver-1774539481177.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6160/13316160/exterior_front_driver-1774539481177.jpg not downloaded yet
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6160%252F13316160%252Fexterior_rear_driver-1774539494041.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6160/13316160/exterior_rear_driver-1774539494041.jpg not downloaded yet
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6160%252F13316160%252Fexterior_front_passenger-1774539507591.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6160/13316160/exterior_front_passenger-1774539507591.jpg not downloaded yet
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6160%252F13316160%252Fexterior_rear_passenger-1774539522078.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6160/13316160/exterior_rear_passenger-1774539522078.jpg not downloaded yet
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6160%252F13316160%252Finterior_front_seats-1774538159744.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6160/13316160/interior_front_seats-1774538159744.jpg not downloaded yet
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6160%252F13316160%252Finterior_rear_seats-1774538178567.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6160/13316160/interior_rear_seats-1774538178567.jpg not downloaded yet
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6160%252F13316160%252Finterior_dashboard-1774539543361.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6160/13316160/interior_dashboard-1774539543361.jpg not downloaded yet
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6160%252F13316160%252Finterior_boot-1774538301503.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6160/13316160/interior_boot-1774538301503.jpg not downloaded yet
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6160%252F13316160%252Fdamage_scratches-1774542478078.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6160/13316160/damage_scratches-1774542478078.jpg not downloaded yet
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6160%252F13316160%252Fdamage_scratches-1774704019167.png%27 HTTP/1.1" 200 None
2026-03-29 20:17:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6160/13316160/damage_scratches-1774704019167.png not downloaded yet
2026-03-29 20:17:05 [scrapy.extensions.logstats] INFO: Crawled 275 pages (at 27 pages/min), scraped 143 items (at 22 items/min)
2026-03-29 20:17:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 304MiB
2026-03-29 20:17:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20467526.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6160/13316160/damage_scratches-1774704019167.png> (referer: None)
2026-03-29 20:17:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6149bd8f-a432-5856-9a3c-0fb5ab0ad703 with identifier: 20467526
2026-03-29 20:17:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6149bd8f-a432-5856-9a3c-0fb5ab0ad703 with scrape type 1
2026-03-29 20:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6149bd8f-a432-5856-9a3c-0fb5ab0ad703
2026-03-29 20:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7526%252F20467526%252Fexterior_front_driver-1774789163756.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7526/20467526/exterior_front_driver-1774789163756.jpg not downloaded yet
2026-03-29 20:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7526%252F20467526%252Fexterior_rear_driver-1774776802668.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7526/20467526/exterior_rear_driver-1774776802668.jpg not downloaded yet
2026-03-29 20:17:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6160/13316160/damage_scratches-1774542478078.jpg> (referer: None)
2026-03-29 20:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7526%252F20467526%252Fexterior_front_passenger-1774776829851.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7526/20467526/exterior_front_passenger-1774776829851.jpg not downloaded yet
2026-03-29 20:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7526%252F20467526%252Fexterior_rear_passenger-1774776814388.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7526/20467526/exterior_rear_passenger-1774776814388.jpg not downloaded yet
2026-03-29 20:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7526%252F20467526%252Finterior_front_seats-1774777637429.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7526/20467526/interior_front_seats-1774777637429.jpg not downloaded yet
2026-03-29 20:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7526%252F20467526%252Finterior_rear_seats-1774777501408.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7526/20467526/interior_rear_seats-1774777501408.jpg not downloaded yet
2026-03-29 20:17:10 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-29 20:17:10 [PIL.PngImagePlugin] DEBUG: STREAM b'sRGB' 41 1
2026-03-29 20:17:10 [PIL.PngImagePlugin] DEBUG: STREAM b'gAMA' 54 4
2026-03-29 20:17:10 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 70 9
2026-03-29 20:17:10 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 91 65445
2026-03-29 20:17:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65815a450>
2026-03-29 20:17:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b458cbe5-b009-5a2e-a174-b65d4f1d89da/b458cbe5-b009-5a2e-a174-b65d4f1d89da_image_9.png HTTP/1.1" 201 0
2026-03-29 20:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6160%252F13316160%252Fdamage_scratches-1774704019167.png') HTTP/1.1" 204 0
2026-03-29 20:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6160/13316160/damage_scratches-1774704019167.png saved to cache
2026-03-29 20:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b458cbe5-b009-5a2e-a174-b65d4f1d89da
2026-03-29 20:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7526%252F20467526%252Finterior_dashboard-1774777642399.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7526/20467526/interior_dashboard-1774777642399.jpg not downloaded yet
2026-03-29 20:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7526%252F20467526%252Finstrument_cluster-1774777386049.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7526/20467526/instrument_cluster-1774777386049.jpg not downloaded yet
2026-03-29 20:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7526%252F20467526%252Finterior_boot-1774777648345.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7526/20467526/interior_boot-1774777648345.jpg not downloaded yet
2026-03-29 20:17:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599837d0>
2026-03-29 20:17:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b458cbe5-b009-5a2e-a174-b65d4f1d89da/b458cbe5-b009-5a2e-a174-b65d4f1d89da_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6160%252F13316160%252Fdamage_scratches-1774542478078.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6160/13316160/damage_scratches-1774542478078.jpg saved to cache
2026-03-29 20:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b458cbe5-b009-5a2e-a174-b65d4f1d89da
2026-03-29 20:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7526%252F20467526%252Fdocs_service_history-1774777828585.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dae2e8979c9a75e0d388435a6ebb16406%27 HTTP/1.1" 200 None
2026-03-29 20:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7526/20467526/docs_service_history-1774777828585.jpg?ixlib=js-3.8.0&auto=format&s=ae2e8979c9a75e0d388435a6ebb16406 not downloaded yet
2026-03-29 20:17:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7526/20467526/exterior_rear_driver-1774776802668.jpg> (referer: None)
2026-03-29 20:17:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f53610>
2026-03-29 20:17:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6149bd8f-a432-5856-9a3c-0fb5ab0ad703/6149bd8f-a432-5856-9a3c-0fb5ab0ad703_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7526%252F20467526%252Fexterior_rear_driver-1774776802668.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7526/20467526/exterior_rear_driver-1774776802668.jpg saved to cache
2026-03-29 20:17:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6149bd8f-a432-5856-9a3c-0fb5ab0ad703
2026-03-29 20:17:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7526/20467526/docs_service_history-1774777828585.jpg?ixlib=js-3.8.0&auto=format&s=ae2e8979c9a75e0d388435a6ebb16406> (referer: None)
2026-03-29 20:17:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65852d990>
2026-03-29 20:17:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6149bd8f-a432-5856-9a3c-0fb5ab0ad703/6149bd8f-a432-5856-9a3c-0fb5ab0ad703_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7526%252F20467526%252Fdocs_service_history-1774777828585.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dae2e8979c9a75e0d388435a6ebb16406') HTTP/1.1" 204 0
2026-03-29 20:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7526/20467526/docs_service_history-1774777828585.jpg?ixlib=js-3.8.0&auto=format&s=ae2e8979c9a75e0d388435a6ebb16406 saved to cache
2026-03-29 20:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6149bd8f-a432-5856-9a3c-0fb5ab0ad703
2026-03-29 20:17:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7526/20467526/interior_boot-1774777648345.jpg> (referer: None)
2026-03-29 20:17:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587b8450>
2026-03-29 20:17:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6149bd8f-a432-5856-9a3c-0fb5ab0ad703/6149bd8f-a432-5856-9a3c-0fb5ab0ad703_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7526%252F20467526%252Finterior_boot-1774777648345.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7526/20467526/interior_boot-1774777648345.jpg saved to cache
2026-03-29 20:17:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6149bd8f-a432-5856-9a3c-0fb5ab0ad703
2026-03-29 20:17:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7526/20467526/instrument_cluster-1774777386049.jpg> (referer: None)
2026-03-29 20:17:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65852cc90>
2026-03-29 20:17:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6149bd8f-a432-5856-9a3c-0fb5ab0ad703/6149bd8f-a432-5856-9a3c-0fb5ab0ad703_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7526%252F20467526%252Finstrument_cluster-1774777386049.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7526/20467526/instrument_cluster-1774777386049.jpg saved to cache
2026-03-29 20:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6149bd8f-a432-5856-9a3c-0fb5ab0ad703
2026-03-29 20:17:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7526/20467526/interior_dashboard-1774777642399.jpg> (referer: None)
2026-03-29 20:17:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6585626d0>
2026-03-29 20:17:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6149bd8f-a432-5856-9a3c-0fb5ab0ad703/6149bd8f-a432-5856-9a3c-0fb5ab0ad703_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7526%252F20467526%252Finterior_dashboard-1774777642399.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7526/20467526/interior_dashboard-1774777642399.jpg saved to cache
2026-03-29 20:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6149bd8f-a432-5856-9a3c-0fb5ab0ad703
2026-03-29 20:17:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7526/20467526/interior_rear_seats-1774777501408.jpg> (referer: None)
2026-03-29 20:17:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f52990>
2026-03-29 20:17:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6149bd8f-a432-5856-9a3c-0fb5ab0ad703/6149bd8f-a432-5856-9a3c-0fb5ab0ad703_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7526%252F20467526%252Finterior_rear_seats-1774777501408.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7526/20467526/interior_rear_seats-1774777501408.jpg saved to cache
2026-03-29 20:17:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6149bd8f-a432-5856-9a3c-0fb5ab0ad703
2026-03-29 20:17:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7526/20467526/interior_front_seats-1774777637429.jpg> (referer: None)
2026-03-29 20:17:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c95a90>
2026-03-29 20:17:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6149bd8f-a432-5856-9a3c-0fb5ab0ad703/6149bd8f-a432-5856-9a3c-0fb5ab0ad703_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:17:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7526%252F20467526%252Finterior_front_seats-1774777637429.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7526/20467526/interior_front_seats-1774777637429.jpg saved to cache
2026-03-29 20:17:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6149bd8f-a432-5856-9a3c-0fb5ab0ad703
2026-03-29 20:17:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7526/20467526/exterior_rear_passenger-1774776814388.jpg> (referer: None)
2026-03-29 20:17:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65852f850>
2026-03-29 20:17:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6149bd8f-a432-5856-9a3c-0fb5ab0ad703/6149bd8f-a432-5856-9a3c-0fb5ab0ad703_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7526%252F20467526%252Fexterior_rear_passenger-1774776814388.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7526/20467526/exterior_rear_passenger-1774776814388.jpg saved to cache
2026-03-29 20:17:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6149bd8f-a432-5856-9a3c-0fb5ab0ad703
2026-03-29 20:17:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7526/20467526/exterior_front_passenger-1774776829851.jpg> (referer: None)
2026-03-29 20:17:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599fd490>
2026-03-29 20:17:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6149bd8f-a432-5856-9a3c-0fb5ab0ad703/6149bd8f-a432-5856-9a3c-0fb5ab0ad703_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7526%252F20467526%252Fexterior_front_passenger-1774776829851.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7526/20467526/exterior_front_passenger-1774776829851.jpg saved to cache
2026-03-29 20:17:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6149bd8f-a432-5856-9a3c-0fb5ab0ad703
2026-03-29 20:17:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7526/20467526/exterior_front_driver-1774789163756.jpg> (referer: None)
2026-03-29 20:17:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658dd5a50>
2026-03-29 20:17:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6149bd8f-a432-5856-9a3c-0fb5ab0ad703/6149bd8f-a432-5856-9a3c-0fb5ab0ad703_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7526%252F20467526%252Fexterior_front_driver-1774789163756.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7526/20467526/exterior_front_driver-1774789163756.jpg saved to cache
2026-03-29 20:17:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6149bd8f-a432-5856-9a3c-0fb5ab0ad703
2026-03-29 20:17:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6149bd8f-a432-5856-9a3c-0fb5ab0ad703, skipping ID generation
2026-03-29 20:17:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6149bd8f-a432-5856-9a3c-0fb5ab0ad703 with scrape type 1
2026-03-29 20:17:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6149bd8f-a432-5856-9a3c-0fb5ab0ad703 sending to next pipeline
2026-03-29 20:17:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6149bd8f-a432-5856-9a3c-0fb5ab0ad703, identifier: 20467526
2026-03-29 20:17:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6149bd8f-a432-5856-9a3c-0fb5ab0ad703 with identifier: 20467526
2026-03-29 20:17:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6149bd8f-a432-5856-9a3c-0fb5ab0ad703 with identifier: 20467526
2026-03-29 20:17:16 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6149bd8f-a432-5856-9a3c-0fb5ab0ad703 with identifier: 20467526 to the API
2026-03-29 20:17:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:17:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:17:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/7526/20467526/exterior_front_driver-1774789163756.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '2.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '6149bd8f-a432-5856-9a3c-0fb5ab0ad703',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GN66 XLA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20467526',
'listing': 'auction',
'location': 'Cambridgeshire Huntingdon',
'make': 'Mazda',
'model': '6',
'odometer': 73810,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6149bd8f-a432-5856-9a3c-0fb5ab0ad703/6149bd8f-a432-5856-9a3c-0fb5ab0ad703_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2591950,
'Height': 2465,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7526/20467526/exterior_front_driver-1774789163756.jpg',
'Width': 3287},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6149bd8f-a432-5856-9a3c-0fb5ab0ad703/6149bd8f-a432-5856-9a3c-0fb5ab0ad703_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1768385,
'Height': 2349,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7526/20467526/exterior_rear_driver-1774776802668.jpg',
'Width': 3132},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6149bd8f-a432-5856-9a3c-0fb5ab0ad703/6149bd8f-a432-5856-9a3c-0fb5ab0ad703_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1335654,
'Height': 2179,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7526/20467526/exterior_front_passenger-1774776829851.jpg',
'Width': 2905},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6149bd8f-a432-5856-9a3c-0fb5ab0ad703/6149bd8f-a432-5856-9a3c-0fb5ab0ad703_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2284194,
'Height': 2658,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7526/20467526/exterior_rear_passenger-1774776814388.jpg',
'Width': 3544},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6149bd8f-a432-5856-9a3c-0fb5ab0ad703/6149bd8f-a432-5856-9a3c-0fb5ab0ad703_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3065434,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7526/20467526/interior_front_seats-1774777637429.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6149bd8f-a432-5856-9a3c-0fb5ab0ad703/6149bd8f-a432-5856-9a3c-0fb5ab0ad703_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2740010,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7526/20467526/interior_rear_seats-1774777501408.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6149bd8f-a432-5856-9a3c-0fb5ab0ad703/6149bd8f-a432-5856-9a3c-0fb5ab0ad703_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1918727,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7526/20467526/interior_dashboard-1774777642399.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6149bd8f-a432-5856-9a3c-0fb5ab0ad703/6149bd8f-a432-5856-9a3c-0fb5ab0ad703_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2621198,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7526/20467526/instrument_cluster-1774777386049.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6149bd8f-a432-5856-9a3c-0fb5ab0ad703/6149bd8f-a432-5856-9a3c-0fb5ab0ad703_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4359943,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7526/20467526/interior_boot-1774777648345.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6149bd8f-a432-5856-9a3c-0fb5ab0ad703/6149bd8f-a432-5856-9a3c-0fb5ab0ad703_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3804241,
'Height': 3614,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7526/20467526/docs_service_history-1774777828585.jpg?ixlib=js-3.8.0&auto=format&s=ae2e8979c9a75e0d388435a6ebb16406',
'Width': 2492}],
'price': 5672,
'price_includes_vat': False,
'registration_date': '2016-09-07',
'seats_number': None,
'seller_name': None,
'title': 'Mazda 6 Sport NAV D',
'transmission': 'manual',
'trim': 'Sport NAV D',
'vin': 'JMZGJ692671359497',
'year': 2016}
2026-03-29 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720467526%27 HTTP/1.1" 200 None
2026-03-29 20:17:16 [motorway.uk] INFO: Saving data for 20467526: {'created_time': 1774815436.723501, 'last_price_update_time': 1774815436.723511, 'auction_closing_time': 1774884600.0}
2026-03-29 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20467526') HTTP/1.1" 204 0
2026-03-29 20:17:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6160/13316160/interior_boot-1774538301503.jpg> (referer: None)
2026-03-29 20:17:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658560510>
2026-03-29 20:17:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b458cbe5-b009-5a2e-a174-b65d4f1d89da/b458cbe5-b009-5a2e-a174-b65d4f1d89da_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6160%252F13316160%252Finterior_boot-1774538301503.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6160/13316160/interior_boot-1774538301503.jpg saved to cache
2026-03-29 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b458cbe5-b009-5a2e-a174-b65d4f1d89da
2026-03-29 20:17:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6160/13316160/interior_dashboard-1774539543361.jpg> (referer: None)
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a479d0>
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b458cbe5-b009-5a2e-a174-b65d4f1d89da/b458cbe5-b009-5a2e-a174-b65d4f1d89da_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6160%252F13316160%252Finterior_dashboard-1774539543361.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6160/13316160/interior_dashboard-1774539543361.jpg saved to cache
2026-03-29 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b458cbe5-b009-5a2e-a174-b65d4f1d89da
2026-03-29 20:17:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6160/13316160/interior_rear_seats-1774538178567.jpg> (referer: None)
2026-03-29 20:17:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658edf990>
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b458cbe5-b009-5a2e-a174-b65d4f1d89da/b458cbe5-b009-5a2e-a174-b65d4f1d89da_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6160%252F13316160%252Finterior_rear_seats-1774538178567.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6160/13316160/interior_rear_seats-1774538178567.jpg saved to cache
2026-03-29 20:17:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b458cbe5-b009-5a2e-a174-b65d4f1d89da
2026-03-29 20:17:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6160/13316160/interior_front_seats-1774538159744.jpg> (referer: None)
2026-03-29 20:17:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599fdb90>
2026-03-29 20:17:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b458cbe5-b009-5a2e-a174-b65d4f1d89da/b458cbe5-b009-5a2e-a174-b65d4f1d89da_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6160%252F13316160%252Finterior_front_seats-1774538159744.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6160/13316160/interior_front_seats-1774538159744.jpg saved to cache
2026-03-29 20:17:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b458cbe5-b009-5a2e-a174-b65d4f1d89da
2026-03-29 20:17:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6160/13316160/exterior_rear_passenger-1774539522078.jpg> (referer: None)
2026-03-29 20:17:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658dd5110>
2026-03-29 20:17:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b458cbe5-b009-5a2e-a174-b65d4f1d89da/b458cbe5-b009-5a2e-a174-b65d4f1d89da_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6160%252F13316160%252Fexterior_rear_passenger-1774539522078.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6160/13316160/exterior_rear_passenger-1774539522078.jpg saved to cache
2026-03-29 20:17:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b458cbe5-b009-5a2e-a174-b65d4f1d89da
2026-03-29 20:17:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6160/13316160/exterior_front_passenger-1774539507591.jpg> (referer: None)
2026-03-29 20:17:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a38790>
2026-03-29 20:17:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b458cbe5-b009-5a2e-a174-b65d4f1d89da/b458cbe5-b009-5a2e-a174-b65d4f1d89da_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6160%252F13316160%252Fexterior_front_passenger-1774539507591.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6160/13316160/exterior_front_passenger-1774539507591.jpg saved to cache
2026-03-29 20:17:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b458cbe5-b009-5a2e-a174-b65d4f1d89da
2026-03-29 20:17:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6160/13316160/exterior_rear_driver-1774539494041.jpg> (referer: None)
2026-03-29 20:17:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599ff6d0>
2026-03-29 20:17:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b458cbe5-b009-5a2e-a174-b65d4f1d89da/b458cbe5-b009-5a2e-a174-b65d4f1d89da_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6160%252F13316160%252Fexterior_rear_driver-1774539494041.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6160/13316160/exterior_rear_driver-1774539494041.jpg saved to cache
2026-03-29 20:17:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b458cbe5-b009-5a2e-a174-b65d4f1d89da
2026-03-29 20:17:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6160/13316160/exterior_front_driver-1774539481177.jpg> (referer: None)
2026-03-29 20:17:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c954d0>
2026-03-29 20:17:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b458cbe5-b009-5a2e-a174-b65d4f1d89da/b458cbe5-b009-5a2e-a174-b65d4f1d89da_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6160%252F13316160%252Fexterior_front_driver-1774539481177.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6160/13316160/exterior_front_driver-1774539481177.jpg saved to cache
2026-03-29 20:17:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b458cbe5-b009-5a2e-a174-b65d4f1d89da
2026-03-29 20:17:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b458cbe5-b009-5a2e-a174-b65d4f1d89da, skipping ID generation
2026-03-29 20:17:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b458cbe5-b009-5a2e-a174-b65d4f1d89da with scrape type 1
2026-03-29 20:17:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b458cbe5-b009-5a2e-a174-b65d4f1d89da sending to next pipeline
2026-03-29 20:17:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b458cbe5-b009-5a2e-a174-b65d4f1d89da, identifier: 13316160
2026-03-29 20:17:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b458cbe5-b009-5a2e-a174-b65d4f1d89da with identifier: 13316160
2026-03-29 20:17:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b458cbe5-b009-5a2e-a174-b65d4f1d89da with identifier: 13316160
2026-03-29 20:17:19 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b458cbe5-b009-5a2e-a174-b65d4f1d89da with identifier: 13316160 to the API
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:17:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:17:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/6160/13316160/exterior_front_driver-1774539481177.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'b458cbe5-b009-5a2e-a174-b65d4f1d89da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'V888 SAF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/13316160',
'listing': 'auction',
'location': 'West Sussex Littlehampton',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 70062,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b458cbe5-b009-5a2e-a174-b65d4f1d89da/b458cbe5-b009-5a2e-a174-b65d4f1d89da_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3301463,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6160/13316160/exterior_front_driver-1774539481177.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b458cbe5-b009-5a2e-a174-b65d4f1d89da/b458cbe5-b009-5a2e-a174-b65d4f1d89da_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3547366,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6160/13316160/exterior_rear_driver-1774539494041.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b458cbe5-b009-5a2e-a174-b65d4f1d89da/b458cbe5-b009-5a2e-a174-b65d4f1d89da_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3495109,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6160/13316160/exterior_front_passenger-1774539507591.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b458cbe5-b009-5a2e-a174-b65d4f1d89da/b458cbe5-b009-5a2e-a174-b65d4f1d89da_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3874263,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6160/13316160/exterior_rear_passenger-1774539522078.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b458cbe5-b009-5a2e-a174-b65d4f1d89da/b458cbe5-b009-5a2e-a174-b65d4f1d89da_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4442651,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6160/13316160/interior_front_seats-1774538159744.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b458cbe5-b009-5a2e-a174-b65d4f1d89da/b458cbe5-b009-5a2e-a174-b65d4f1d89da_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3870414,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6160/13316160/interior_rear_seats-1774538178567.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b458cbe5-b009-5a2e-a174-b65d4f1d89da/b458cbe5-b009-5a2e-a174-b65d4f1d89da_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2120464,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6160/13316160/interior_dashboard-1774539543361.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b458cbe5-b009-5a2e-a174-b65d4f1d89da/b458cbe5-b009-5a2e-a174-b65d4f1d89da_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3576454,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6160/13316160/interior_boot-1774538301503.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b458cbe5-b009-5a2e-a174-b65d4f1d89da/b458cbe5-b009-5a2e-a174-b65d4f1d89da_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28357,
'Height': 352,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6160/13316160/damage_scratches-1774542478078.jpg',
'Width': 469},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b458cbe5-b009-5a2e-a174-b65d4f1d89da/b458cbe5-b009-5a2e-a174-b65d4f1d89da_image_9.png',
'Extension': 'png',
'FileSizeInBytes': 718198,
'Height': 479,
'OriginUrl': 'https://motorway-photos.imgix.net/6160/13316160/damage_scratches-1774704019167.png',
'Width': 1162}],
'price': 7674,
'price_includes_vat': False,
'registration_date': '2015-01-15',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Range Rover Evoque D-LUX SD4A',
'transmission': 'automatic',
'trim': 'Evoque D-LUX SD4A',
'vin': 'SALVA2AEXFH032501',
'year': 2015}
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713316160%27 HTTP/1.1" 200 None
2026-03-29 20:17:20 [motorway.uk] INFO: Saving data for 13316160: {'created_time': 1774815440.057709, 'last_price_update_time': 1774815440.057719, 'auction_closing_time': 1774884600.0}
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='13316160') HTTP/1.1" 204 0
2026-03-29 20:17:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20473047.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dffb452-c67b-5d3d-a184-60af1fc76f79 with identifier: 20473047
2026-03-29 20:17:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dffb452-c67b-5d3d-a184-60af1fc76f79 with scrape type 1
2026-03-29 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2dffb452-c67b-5d3d-a184-60af1fc76f79
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3047%252F20473047%252Fexterior_front_driver-1774620249507.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3047/20473047/exterior_front_driver-1774620249507.jpeg not downloaded yet
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3047%252F20473047%252Fexterior_rear_driver-1774620329972.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3047/20473047/exterior_rear_driver-1774620329972.jpeg not downloaded yet
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3047%252F20473047%252Fexterior_front_passenger-1774620269598.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3047/20473047/exterior_front_passenger-1774620269598.jpeg not downloaded yet
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3047%252F20473047%252Fexterior_rear_passenger-1774620307688.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3047/20473047/exterior_rear_passenger-1774620307688.jpeg not downloaded yet
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3047%252F20473047%252Finterior_front_seats-1774620526347.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3047/20473047/interior_front_seats-1774620526347.jpeg not downloaded yet
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3047%252F20473047%252Finterior_rear_seats-1774620699283.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3047/20473047/interior_rear_seats-1774620699283.jpeg not downloaded yet
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3047%252F20473047%252F20473047-interior_dashboard-modified-1774622370059.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3047/20473047/20473047-interior_dashboard-modified-1774622370059.jpeg not downloaded yet
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3047%252F20473047%252F20473047-instrument_cluster-modified-1774622350658.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3047/20473047/20473047-instrument_cluster-modified-1774622350658.jpeg not downloaded yet
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3047%252F20473047%252Finterior_boot-1774620897920.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3047/20473047/interior_boot-1774620897920.jpeg not downloaded yet
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3047%252F20473047%252Fdocs_service_history-1774621668312.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D05a30c4d97cb93b2e37606d4d542c90b%27 HTTP/1.1" 200 None
2026-03-29 20:17:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3047/20473047/docs_service_history-1774621668312.jpeg?ixlib=js-3.8.0&auto=format&s=05a30c4d97cb93b2e37606d4d542c90b not downloaded yet
2026-03-29 20:17:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20438823.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3553b9ab-51d5-53c8-a15f-fb42400252c2 with identifier: 20438823
2026-03-29 20:17:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3553b9ab-51d5-53c8-a15f-fb42400252c2 with scrape type 1
2026-03-29 20:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3553b9ab-51d5-53c8-a15f-fb42400252c2
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8823%252F20438823%252Fexterior_front_driver-1774621147258.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8823/20438823/exterior_front_driver-1774621147258.jpg not downloaded yet
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8823%252F20438823%252Fexterior_rear_driver-1774621172220.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8823/20438823/exterior_rear_driver-1774621172220.jpg not downloaded yet
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8823%252F20438823%252Fexterior_front_passenger-1774621196698.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8823/20438823/exterior_front_passenger-1774621196698.jpg not downloaded yet
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8823%252F20438823%252Fexterior_rear_passenger-1774621185215.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8823/20438823/exterior_rear_passenger-1774621185215.jpg not downloaded yet
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8823%252F20438823%252Finterior_front_seats-1774621666896.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8823/20438823/interior_front_seats-1774621666896.jpg not downloaded yet
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8823%252F20438823%252Finterior_rear_seats-1774621688705.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8823/20438823/interior_rear_seats-1774621688705.jpg not downloaded yet
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8823%252F20438823%252Finterior_dashboard-1774779258957.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8823/20438823/interior_dashboard-1774779258957.jpg not downloaded yet
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8823%252F20438823%252Finstrument_cluster-1774621755293.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8823/20438823/instrument_cluster-1774621755293.jpg not downloaded yet
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8823%252F20438823%252Finterior_boot-1774621748170.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8823/20438823/interior_boot-1774621748170.jpg not downloaded yet
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8823%252F20438823%252Fdocs_service_history-1774713257261.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D22a21f4169dc52dd41c678a63a05d022%27 HTTP/1.1" 200 None
2026-03-29 20:17:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8823/20438823/docs_service_history-1774713257261.jpg?ixlib=js-3.8.0&auto=format&s=22a21f4169dc52dd41c678a63a05d022 not downloaded yet
2026-03-29 20:17:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3047/20473047/docs_service_history-1774621668312.jpeg?ixlib=js-3.8.0&auto=format&s=05a30c4d97cb93b2e37606d4d542c90b> (referer: None)
2026-03-29 20:17:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:17:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658edc210>
2026-03-29 20:17:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dffb452-c67b-5d3d-a184-60af1fc76f79/2dffb452-c67b-5d3d-a184-60af1fc76f79_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3047%252F20473047%252Fdocs_service_history-1774621668312.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D05a30c4d97cb93b2e37606d4d542c90b') HTTP/1.1" 204 0
2026-03-29 20:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3047/20473047/docs_service_history-1774621668312.jpeg?ixlib=js-3.8.0&auto=format&s=05a30c4d97cb93b2e37606d4d542c90b saved to cache
2026-03-29 20:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2dffb452-c67b-5d3d-a184-60af1fc76f79
2026-03-29 20:17:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8823/20438823/docs_service_history-1774713257261.jpg?ixlib=js-3.8.0&auto=format&s=22a21f4169dc52dd41c678a63a05d022> (referer: None)
2026-03-29 20:17:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ef5bd0>
2026-03-29 20:17:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3553b9ab-51d5-53c8-a15f-fb42400252c2/3553b9ab-51d5-53c8-a15f-fb42400252c2_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8823%252F20438823%252Fdocs_service_history-1774713257261.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D22a21f4169dc52dd41c678a63a05d022') HTTP/1.1" 204 0
2026-03-29 20:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8823/20438823/docs_service_history-1774713257261.jpg?ixlib=js-3.8.0&auto=format&s=22a21f4169dc52dd41c678a63a05d022 saved to cache
2026-03-29 20:17:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3553b9ab-51d5-53c8-a15f-fb42400252c2
2026-03-29 20:17:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8823/20438823/interior_boot-1774621748170.jpg> (referer: None)
2026-03-29 20:17:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d74810>
2026-03-29 20:17:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3553b9ab-51d5-53c8-a15f-fb42400252c2/3553b9ab-51d5-53c8-a15f-fb42400252c2_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8823%252F20438823%252Finterior_boot-1774621748170.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8823/20438823/interior_boot-1774621748170.jpg saved to cache
2026-03-29 20:17:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3553b9ab-51d5-53c8-a15f-fb42400252c2
2026-03-29 20:17:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1188&page=33&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8823/20438823/instrument_cluster-1774621755293.jpg> (referer: None)
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 20484945
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 14357475
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 20175875
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720175875%27 HTTP/1.1" 200 None
2026-03-29 20:17:23 [motorway.uk] INFO: Scrape type for 20175875: 1
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 20016415
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 18975319
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718975319%27 HTTP/1.1" 200 None
2026-03-29 20:17:23 [motorway.uk] INFO: Scrape type for 18975319: 1
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 20492267
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 20435647
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 20487216
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 18947501
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718947501%27 HTTP/1.1" 200 None
2026-03-29 20:17:23 [motorway.uk] INFO: Scrape type for 18947501: 1
2026-03-29 20:17:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf096d0>
2026-03-29 20:17:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3553b9ab-51d5-53c8-a15f-fb42400252c2/3553b9ab-51d5-53c8-a15f-fb42400252c2_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8823%252F20438823%252Finstrument_cluster-1774621755293.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8823/20438823/instrument_cluster-1774621755293.jpg saved to cache
2026-03-29 20:17:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3553b9ab-51d5-53c8-a15f-fb42400252c2
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 20381015
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 20482805
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 9373677
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 20339850
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 20478886
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 19640893
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 16034385
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716034385%27 HTTP/1.1" 200 None
2026-03-29 20:17:23 [motorway.uk] INFO: Scrape type for 16034385: 1
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 20490883
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 18780849
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718780849%27 HTTP/1.1" 200 None
2026-03-29 20:17:23 [motorway.uk] INFO: Scrape type for 18780849: 1
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 18169442
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718169442%27 HTTP/1.1" 200 None
2026-03-29 20:17:23 [motorway.uk] INFO: Scrape type for 18169442: 1
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 20467557
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720467557%27 HTTP/1.1" 200 None
2026-03-29 20:17:23 [motorway.uk] INFO: Scrape type for 20467557: 1
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 20172298
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 20481158
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 20009659
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 19320604
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 20473409
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 20388349
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 14416221
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 15999217
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 20500662
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720500662%27 HTTP/1.1" 200 None
2026-03-29 20:17:23 [motorway.uk] INFO: Scrape type for 20500662: 1
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 19873015
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 20398790
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 13687661
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713687661%27 HTTP/1.1" 200 None
2026-03-29 20:17:23 [motorway.uk] INFO: Scrape type for 13687661: 1
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 13044273
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 11047706
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 20388848
2026-03-29 20:17:23 [motorway.uk] INFO: Found listing with ID: 18340983
2026-03-29 20:17:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8823/20438823/interior_dashboard-1774779258957.jpg> (referer: None)
2026-03-29 20:17:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8823/20438823/interior_rear_seats-1774621688705.jpg> (referer: None)
2026-03-29 20:17:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583e6210>
2026-03-29 20:17:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3553b9ab-51d5-53c8-a15f-fb42400252c2/3553b9ab-51d5-53c8-a15f-fb42400252c2_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:17:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8823%252F20438823%252Finterior_dashboard-1774779258957.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8823/20438823/interior_dashboard-1774779258957.jpg saved to cache
2026-03-29 20:17:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3553b9ab-51d5-53c8-a15f-fb42400252c2
2026-03-29 20:17:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658491190>
2026-03-29 20:17:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3553b9ab-51d5-53c8-a15f-fb42400252c2/3553b9ab-51d5-53c8-a15f-fb42400252c2_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8823%252F20438823%252Finterior_rear_seats-1774621688705.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8823/20438823/interior_rear_seats-1774621688705.jpg saved to cache
2026-03-29 20:17:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3553b9ab-51d5-53c8-a15f-fb42400252c2
2026-03-29 20:17:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14032750.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6e1948c-a468-5fdb-9364-74999e4e0b60 with identifier: 14032750
2026-03-29 20:17:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6e1948c-a468-5fdb-9364-74999e4e0b60 with scrape type 1
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a6e1948c-a468-5fdb-9364-74999e4e0b60
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2750%252F14032750%252Fexterior_front_driver-1774781541131.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2750/14032750/exterior_front_driver-1774781541131.jpg not downloaded yet
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2750%252F14032750%252Fexterior_rear_driver-1774781537919.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2750/14032750/exterior_rear_driver-1774781537919.jpg not downloaded yet
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2750%252F14032750%252Fexterior_front_passenger-1774781587875.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2750/14032750/exterior_front_passenger-1774781587875.jpg not downloaded yet
2026-03-29 20:17:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19185025.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2750%252F14032750%252Fexterior_rear_passenger-1774781540280.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2750/14032750/exterior_rear_passenger-1774781540280.jpg not downloaded yet
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2750%252F14032750%252Finterior_front_seats-1774782092070.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2750/14032750/interior_front_seats-1774782092070.jpg not downloaded yet
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2750%252F14032750%252Finterior_rear_seats-1774782090145.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2750/14032750/interior_rear_seats-1774782090145.jpg not downloaded yet
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2750%252F14032750%252Finterior_dashboard-1774786136463.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2750/14032750/interior_dashboard-1774786136463.jpg not downloaded yet
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2750%252F14032750%252Finstrument_cluster-1774786142324.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2750/14032750/instrument_cluster-1774786142324.jpg not downloaded yet
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2750%252F14032750%252Finterior_boot-1774782088941.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2750/14032750/interior_boot-1774782088941.jpg not downloaded yet
2026-03-29 20:17:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77dcfc59-beff-52d5-9bc3-c8a198907a70 with identifier: 19185025
2026-03-29 20:17:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77dcfc59-beff-52d5-9bc3-c8a198907a70 with scrape type 1
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 77dcfc59-beff-52d5-9bc3-c8a198907a70
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5025%252F19185025%252Fexterior_front_driver-1774781987985.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5025/19185025/exterior_front_driver-1774781987985.jpg not downloaded yet
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2750%252F14032750%252Fdocs_service_history-1774783252716-2.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dffd6ce90b73583d8dc0c297c23e96af0%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2750/14032750/docs_service_history-1774783252716-2.jpeg?ixlib=js-3.8.0&auto=format&s=ffd6ce90b73583d8dc0c297c23e96af0 not downloaded yet
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5025%252F19185025%252Fexterior_rear_driver-1774780025674.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5025/19185025/exterior_rear_driver-1774780025674.jpg not downloaded yet
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5025%252F19185025%252Fexterior_front_passenger-1774782024830.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5025/19185025/exterior_front_passenger-1774782024830.jpg not downloaded yet
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5025%252F19185025%252Fexterior_rear_passenger-1774780038140.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5025/19185025/exterior_rear_passenger-1774780038140.jpg not downloaded yet
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5025%252F19185025%252Finterior_front_seats-1774780482165.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5025/19185025/interior_front_seats-1774780482165.jpg not downloaded yet
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5025%252F19185025%252Finterior_rear_seats-1774780502820.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5025/19185025/interior_rear_seats-1774780502820.jpg not downloaded yet
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5025%252F19185025%252Finterior_dashboard-1774782069944.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5025/19185025/interior_dashboard-1774782069944.jpg not downloaded yet
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5025%252F19185025%252Finterior_boot-1774782087868.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5025/19185025/interior_boot-1774782087868.jpg not downloaded yet
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5025%252F19185025%252Fdamage_scratches-1774781379512.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5025/19185025/damage_scratches-1774781379512.jpg not downloaded yet
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5025%252F19185025%252Fdamage_scratches-1774780111109.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5025/19185025/damage_scratches-1774780111109.jpg not downloaded yet
2026-03-29 20:17:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2750/14032750/exterior_rear_driver-1774781537919.jpg> (referer: None)
2026-03-29 20:17:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658faba90>
2026-03-29 20:17:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6e1948c-a468-5fdb-9364-74999e4e0b60/a6e1948c-a468-5fdb-9364-74999e4e0b60_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2750%252F14032750%252Fexterior_rear_driver-1774781537919.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2750/14032750/exterior_rear_driver-1774781537919.jpg saved to cache
2026-03-29 20:17:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a6e1948c-a468-5fdb-9364-74999e4e0b60
2026-03-29 20:17:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5025/19185025/damage_scratches-1774780111109.jpg> (referer: None)
2026-03-29 20:17:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fab650>
2026-03-29 20:17:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77dcfc59-beff-52d5-9bc3-c8a198907a70/77dcfc59-beff-52d5-9bc3-c8a198907a70_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5025%252F19185025%252Fdamage_scratches-1774780111109.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5025/19185025/damage_scratches-1774780111109.jpg saved to cache
2026-03-29 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 77dcfc59-beff-52d5-9bc3-c8a198907a70
2026-03-29 20:17:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5025/19185025/damage_scratches-1774781379512.jpg> (referer: None)
2026-03-29 20:17:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65850c810>
2026-03-29 20:17:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77dcfc59-beff-52d5-9bc3-c8a198907a70/77dcfc59-beff-52d5-9bc3-c8a198907a70_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5025%252F19185025%252Fdamage_scratches-1774781379512.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5025/19185025/damage_scratches-1774781379512.jpg saved to cache
2026-03-29 20:17:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 77dcfc59-beff-52d5-9bc3-c8a198907a70
2026-03-29 20:17:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5025/19185025/interior_boot-1774782087868.jpg> (referer: None)
2026-03-29 20:17:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fa8290>
2026-03-29 20:17:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77dcfc59-beff-52d5-9bc3-c8a198907a70/77dcfc59-beff-52d5-9bc3-c8a198907a70_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:17:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5025%252F19185025%252Finterior_boot-1774782087868.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5025/19185025/interior_boot-1774782087868.jpg saved to cache
2026-03-29 20:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 77dcfc59-beff-52d5-9bc3-c8a198907a70
2026-03-29 20:17:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5025/19185025/interior_dashboard-1774782069944.jpg> (referer: None)
2026-03-29 20:17:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658460890>
2026-03-29 20:17:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77dcfc59-beff-52d5-9bc3-c8a198907a70/77dcfc59-beff-52d5-9bc3-c8a198907a70_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5025%252F19185025%252Finterior_dashboard-1774782069944.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5025/19185025/interior_dashboard-1774782069944.jpg saved to cache
2026-03-29 20:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 77dcfc59-beff-52d5-9bc3-c8a198907a70
2026-03-29 20:17:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5025/19185025/interior_rear_seats-1774780502820.jpg> (referer: None)
2026-03-29 20:17:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c24650>
2026-03-29 20:17:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77dcfc59-beff-52d5-9bc3-c8a198907a70/77dcfc59-beff-52d5-9bc3-c8a198907a70_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5025%252F19185025%252Finterior_rear_seats-1774780502820.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5025/19185025/interior_rear_seats-1774780502820.jpg saved to cache
2026-03-29 20:17:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 77dcfc59-beff-52d5-9bc3-c8a198907a70
2026-03-29 20:17:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5025/19185025/interior_front_seats-1774780482165.jpg> (referer: None)
2026-03-29 20:17:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658feff10>
2026-03-29 20:17:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77dcfc59-beff-52d5-9bc3-c8a198907a70/77dcfc59-beff-52d5-9bc3-c8a198907a70_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5025%252F19185025%252Finterior_front_seats-1774780482165.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5025/19185025/interior_front_seats-1774780482165.jpg saved to cache
2026-03-29 20:17:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 77dcfc59-beff-52d5-9bc3-c8a198907a70
2026-03-29 20:17:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5025/19185025/exterior_rear_passenger-1774780038140.jpg> (referer: None)
2026-03-29 20:17:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658b47410>
2026-03-29 20:17:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77dcfc59-beff-52d5-9bc3-c8a198907a70/77dcfc59-beff-52d5-9bc3-c8a198907a70_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5025%252F19185025%252Fexterior_rear_passenger-1774780038140.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5025/19185025/exterior_rear_passenger-1774780038140.jpg saved to cache
2026-03-29 20:17:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 77dcfc59-beff-52d5-9bc3-c8a198907a70
2026-03-29 20:17:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5025/19185025/exterior_front_passenger-1774782024830.jpg> (referer: None)
2026-03-29 20:17:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a1df90>
2026-03-29 20:17:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77dcfc59-beff-52d5-9bc3-c8a198907a70/77dcfc59-beff-52d5-9bc3-c8a198907a70_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5025%252F19185025%252Fexterior_front_passenger-1774782024830.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5025/19185025/exterior_front_passenger-1774782024830.jpg saved to cache
2026-03-29 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 77dcfc59-beff-52d5-9bc3-c8a198907a70
2026-03-29 20:17:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20144250.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2750/14032750/docs_service_history-1774783252716-2.jpeg?ixlib=js-3.8.0&auto=format&s=ffd6ce90b73583d8dc0c297c23e96af0> (referer: None)
2026-03-29 20:17:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5025/19185025/exterior_rear_driver-1774780025674.jpg> (referer: None)
2026-03-29 20:17:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 497a1c26-8195-58e6-88d2-30de4d192840 with identifier: 20144250
2026-03-29 20:17:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 497a1c26-8195-58e6-88d2-30de4d192840 with scrape type 1
2026-03-29 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 497a1c26-8195-58e6-88d2-30de4d192840
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4250%252F20144250%252Fexterior_front_driver-1772898177013.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4250/20144250/exterior_front_driver-1772898177013.jpg already downloaded
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4250%252F20144250%252Fexterior_rear_driver-1772898204812.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4250/20144250/exterior_rear_driver-1772898204812.jpg already downloaded
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4250%252F20144250%252Fexterior_front_passenger-1772898262622.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4250/20144250/exterior_front_passenger-1772898262622.jpg already downloaded
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4250%252F20144250%252Fexterior_rear_passenger-1772898227585.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4250/20144250/exterior_rear_passenger-1772898227585.jpg already downloaded
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4250%252F20144250%252Finterior_front_seats-1773236308149.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4250/20144250/interior_front_seats-1773236308149.jpg already downloaded
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4250%252F20144250%252Finterior_rear_seats-1772976493215.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4250/20144250/interior_rear_seats-1772976493215.jpg already downloaded
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4250%252F20144250%252Finterior_dashboard-1772976534257.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4250/20144250/interior_dashboard-1772976534257.jpg already downloaded
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4250%252F20144250%252Finterior_boot-1772978045576.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4250/20144250/interior_boot-1772978045576.jpg already downloaded
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4250%252F20144250%252Fdocs_service_history-1773236149408-1.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8ea59a5ea13472891a587c11a6219438%27 HTTP/1.1" 200 None
2026-03-29 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4250/20144250/docs_service_history-1773236149408-1.jpeg?ixlib=js-3.8.0&auto=format&s=8ea59a5ea13472891a587c11a6219438 already downloaded
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4250%252F20144250%252Fdamage_scratches-1772898394460.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4250/20144250/damage_scratches-1772898394460.jpg not downloaded yet
2026-03-29 20:17:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b57750>
2026-03-29 20:17:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6e1948c-a468-5fdb-9364-74999e4e0b60/a6e1948c-a468-5fdb-9364-74999e4e0b60_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2750%252F14032750%252Fdocs_service_history-1774783252716-2.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dffd6ce90b73583d8dc0c297c23e96af0') HTTP/1.1" 204 0
2026-03-29 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2750/14032750/docs_service_history-1774783252716-2.jpeg?ixlib=js-3.8.0&auto=format&s=ffd6ce90b73583d8dc0c297c23e96af0 saved to cache
2026-03-29 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a6e1948c-a468-5fdb-9364-74999e4e0b60
2026-03-29 20:17:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658719810>
2026-03-29 20:17:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77dcfc59-beff-52d5-9bc3-c8a198907a70/77dcfc59-beff-52d5-9bc3-c8a198907a70_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5025%252F19185025%252Fexterior_rear_driver-1774780025674.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5025/19185025/exterior_rear_driver-1774780025674.jpg saved to cache
2026-03-29 20:17:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 77dcfc59-beff-52d5-9bc3-c8a198907a70
2026-03-29 20:17:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2750/14032750/interior_boot-1774782088941.jpg> (referer: None)
2026-03-29 20:17:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5025/19185025/exterior_front_driver-1774781987985.jpg> (referer: None)
2026-03-29 20:17:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a72dd0>
2026-03-29 20:17:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6e1948c-a468-5fdb-9364-74999e4e0b60/a6e1948c-a468-5fdb-9364-74999e4e0b60_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2750%252F14032750%252Finterior_boot-1774782088941.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2750/14032750/interior_boot-1774782088941.jpg saved to cache
2026-03-29 20:17:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a6e1948c-a468-5fdb-9364-74999e4e0b60
2026-03-29 20:17:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b57250>
2026-03-29 20:17:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77dcfc59-beff-52d5-9bc3-c8a198907a70/77dcfc59-beff-52d5-9bc3-c8a198907a70_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5025%252F19185025%252Fexterior_front_driver-1774781987985.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5025/19185025/exterior_front_driver-1774781987985.jpg saved to cache
2026-03-29 20:17:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 77dcfc59-beff-52d5-9bc3-c8a198907a70
2026-03-29 20:17:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 77dcfc59-beff-52d5-9bc3-c8a198907a70, skipping ID generation
2026-03-29 20:17:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77dcfc59-beff-52d5-9bc3-c8a198907a70 with scrape type 1
2026-03-29 20:17:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 77dcfc59-beff-52d5-9bc3-c8a198907a70 sending to next pipeline
2026-03-29 20:17:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 77dcfc59-beff-52d5-9bc3-c8a198907a70, identifier: 19185025
2026-03-29 20:17:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 77dcfc59-beff-52d5-9bc3-c8a198907a70 with identifier: 19185025
2026-03-29 20:17:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 77dcfc59-beff-52d5-9bc3-c8a198907a70 with identifier: 19185025
2026-03-29 20:17:30 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 77dcfc59-beff-52d5-9bc3-c8a198907a70 with identifier: 19185025 to the API
2026-03-29 20:17:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:17:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:17:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/5025/19185025/exterior_front_driver-1774781987985.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '77dcfc59-beff-52d5-9bc3-c8a198907a70',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'CV66 VUP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19185025',
'listing': 'auction',
'location': 'Cornwall Saint Austell',
'make': 'Audi',
'model': 'A1',
'odometer': 89000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77dcfc59-beff-52d5-9bc3-c8a198907a70/77dcfc59-beff-52d5-9bc3-c8a198907a70_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2431945,
'Height': 2841,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5025/19185025/exterior_front_driver-1774781987985.jpg',
'Width': 3788},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77dcfc59-beff-52d5-9bc3-c8a198907a70/77dcfc59-beff-52d5-9bc3-c8a198907a70_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1756078,
'Height': 2640,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5025/19185025/exterior_rear_driver-1774780025674.jpg',
'Width': 3520},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77dcfc59-beff-52d5-9bc3-c8a198907a70/77dcfc59-beff-52d5-9bc3-c8a198907a70_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1979404,
'Height': 2517,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5025/19185025/exterior_front_passenger-1774782024830.jpg',
'Width': 3356},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77dcfc59-beff-52d5-9bc3-c8a198907a70/77dcfc59-beff-52d5-9bc3-c8a198907a70_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1311945,
'Height': 2323,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5025/19185025/exterior_rear_passenger-1774780038140.jpg',
'Width': 3097},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77dcfc59-beff-52d5-9bc3-c8a198907a70/77dcfc59-beff-52d5-9bc3-c8a198907a70_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3305809,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5025/19185025/interior_front_seats-1774780482165.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77dcfc59-beff-52d5-9bc3-c8a198907a70/77dcfc59-beff-52d5-9bc3-c8a198907a70_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4858233,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5025/19185025/interior_rear_seats-1774780502820.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77dcfc59-beff-52d5-9bc3-c8a198907a70/77dcfc59-beff-52d5-9bc3-c8a198907a70_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3047699,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5025/19185025/interior_dashboard-1774782069944.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77dcfc59-beff-52d5-9bc3-c8a198907a70/77dcfc59-beff-52d5-9bc3-c8a198907a70_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2868578,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5025/19185025/interior_boot-1774782087868.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77dcfc59-beff-52d5-9bc3-c8a198907a70/77dcfc59-beff-52d5-9bc3-c8a198907a70_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196013,
'Height': 1102,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5025/19185025/damage_scratches-1774781379512.jpg',
'Width': 1469},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77dcfc59-beff-52d5-9bc3-c8a198907a70/77dcfc59-beff-52d5-9bc3-c8a198907a70_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2709522,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5025/19185025/damage_scratches-1774780111109.jpg',
'Width': 4032}],
'price': 4684,
'price_includes_vat': False,
'registration_date': '2016-10-11',
'seats_number': None,
'seller_name': None,
'title': 'Audi A1 Sport TFSI',
'transmission': 'manual',
'trim': 'Sport TFSI',
'vin': 'WAUZZZ8X2HB031508',
'year': 2016}
2026-03-29 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719185025%27 HTTP/1.1" 200 None
2026-03-29 20:17:30 [motorway.uk] INFO: Saving data for 19185025: {'created_time': 1774815450.993752, 'last_price_update_time': 1774815450.993763, 'auction_closing_time': 1774884600.0}
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19185025') HTTP/1.1" 204 0
2026-03-29 20:17:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2750/14032750/instrument_cluster-1774786142324.jpg> (referer: None)
2026-03-29 20:17:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c81b90>
2026-03-29 20:17:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6e1948c-a468-5fdb-9364-74999e4e0b60/a6e1948c-a468-5fdb-9364-74999e4e0b60_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2750%252F14032750%252Finstrument_cluster-1774786142324.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2750/14032750/instrument_cluster-1774786142324.jpg saved to cache
2026-03-29 20:17:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a6e1948c-a468-5fdb-9364-74999e4e0b60
2026-03-29 20:17:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2750/14032750/interior_dashboard-1774786136463.jpg> (referer: None)
2026-03-29 20:17:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c81410>
2026-03-29 20:17:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6e1948c-a468-5fdb-9364-74999e4e0b60/a6e1948c-a468-5fdb-9364-74999e4e0b60_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2750%252F14032750%252Finterior_dashboard-1774786136463.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2750/14032750/interior_dashboard-1774786136463.jpg saved to cache
2026-03-29 20:17:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a6e1948c-a468-5fdb-9364-74999e4e0b60
2026-03-29 20:17:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2750/14032750/interior_rear_seats-1774782090145.jpg> (referer: None)
2026-03-29 20:17:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c27490>
2026-03-29 20:17:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6e1948c-a468-5fdb-9364-74999e4e0b60/a6e1948c-a468-5fdb-9364-74999e4e0b60_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2750%252F14032750%252Finterior_rear_seats-1774782090145.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2750/14032750/interior_rear_seats-1774782090145.jpg saved to cache
2026-03-29 20:17:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a6e1948c-a468-5fdb-9364-74999e4e0b60
2026-03-29 20:17:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2750/14032750/interior_front_seats-1774782092070.jpg> (referer: None)
2026-03-29 20:17:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582c4750>
2026-03-29 20:17:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6e1948c-a468-5fdb-9364-74999e4e0b60/a6e1948c-a468-5fdb-9364-74999e4e0b60_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2750%252F14032750%252Finterior_front_seats-1774782092070.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2750/14032750/interior_front_seats-1774782092070.jpg saved to cache
2026-03-29 20:17:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a6e1948c-a468-5fdb-9364-74999e4e0b60
2026-03-29 20:17:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2750/14032750/exterior_rear_passenger-1774781540280.jpg> (referer: None)
2026-03-29 20:17:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a436d0>
2026-03-29 20:17:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6e1948c-a468-5fdb-9364-74999e4e0b60/a6e1948c-a468-5fdb-9364-74999e4e0b60_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2750%252F14032750%252Fexterior_rear_passenger-1774781540280.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2750/14032750/exterior_rear_passenger-1774781540280.jpg saved to cache
2026-03-29 20:17:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a6e1948c-a468-5fdb-9364-74999e4e0b60
2026-03-29 20:17:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2750/14032750/exterior_front_passenger-1774781587875.jpg> (referer: None)
2026-03-29 20:17:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f12b50>
2026-03-29 20:17:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6e1948c-a468-5fdb-9364-74999e4e0b60/a6e1948c-a468-5fdb-9364-74999e4e0b60_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2750%252F14032750%252Fexterior_front_passenger-1774781587875.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2750/14032750/exterior_front_passenger-1774781587875.jpg saved to cache
2026-03-29 20:17:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a6e1948c-a468-5fdb-9364-74999e4e0b60
2026-03-29 20:17:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2750/14032750/exterior_front_driver-1774781541131.jpg> (referer: None)
2026-03-29 20:17:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658817750>
2026-03-29 20:17:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6e1948c-a468-5fdb-9364-74999e4e0b60/a6e1948c-a468-5fdb-9364-74999e4e0b60_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2750%252F14032750%252Fexterior_front_driver-1774781541131.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2750/14032750/exterior_front_driver-1774781541131.jpg saved to cache
2026-03-29 20:17:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a6e1948c-a468-5fdb-9364-74999e4e0b60
2026-03-29 20:17:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6e1948c-a468-5fdb-9364-74999e4e0b60, skipping ID generation
2026-03-29 20:17:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6e1948c-a468-5fdb-9364-74999e4e0b60 with scrape type 1
2026-03-29 20:17:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a6e1948c-a468-5fdb-9364-74999e4e0b60 sending to next pipeline
2026-03-29 20:17:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a6e1948c-a468-5fdb-9364-74999e4e0b60, identifier: 14032750
2026-03-29 20:17:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a6e1948c-a468-5fdb-9364-74999e4e0b60 with identifier: 14032750
2026-03-29 20:17:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a6e1948c-a468-5fdb-9364-74999e4e0b60 with identifier: 14032750
2026-03-29 20:17:33 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a6e1948c-a468-5fdb-9364-74999e4e0b60 with identifier: 14032750 to the API
2026-03-29 20:17:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:17:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2750/14032750/exterior_front_driver-1774781541131.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'a6e1948c-a468-5fdb-9364-74999e4e0b60',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WA15 ZHD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/14032750',
'listing': 'auction',
'location': 'Greater London Edgware',
'make': 'Mercedes',
'model': 'B Class',
'odometer': 103275,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 30,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6e1948c-a468-5fdb-9364-74999e4e0b60/a6e1948c-a468-5fdb-9364-74999e4e0b60_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1762227,
'Height': 2716,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2750/14032750/exterior_front_driver-1774781541131.jpg',
'Width': 3621},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6e1948c-a468-5fdb-9364-74999e4e0b60/a6e1948c-a468-5fdb-9364-74999e4e0b60_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1304596,
'Height': 2608,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2750/14032750/exterior_rear_driver-1774781537919.jpg',
'Width': 3477},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6e1948c-a468-5fdb-9364-74999e4e0b60/a6e1948c-a468-5fdb-9364-74999e4e0b60_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1786407,
'Height': 2756,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2750/14032750/exterior_front_passenger-1774781587875.jpg',
'Width': 3675},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6e1948c-a468-5fdb-9364-74999e4e0b60/a6e1948c-a468-5fdb-9364-74999e4e0b60_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 988667,
'Height': 2355,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2750/14032750/exterior_rear_passenger-1774781540280.jpg',
'Width': 3140},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6e1948c-a468-5fdb-9364-74999e4e0b60/a6e1948c-a468-5fdb-9364-74999e4e0b60_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2352381,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/2750/14032750/interior_front_seats-1774782092070.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6e1948c-a468-5fdb-9364-74999e4e0b60/a6e1948c-a468-5fdb-9364-74999e4e0b60_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1969319,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/2750/14032750/interior_rear_seats-1774782090145.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6e1948c-a468-5fdb-9364-74999e4e0b60/a6e1948c-a468-5fdb-9364-74999e4e0b60_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1804907,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2750/14032750/interior_dashboard-1774786136463.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6e1948c-a468-5fdb-9364-74999e4e0b60/a6e1948c-a468-5fdb-9364-74999e4e0b60_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1410254,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2750/14032750/instrument_cluster-1774786142324.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6e1948c-a468-5fdb-9364-74999e4e0b60/a6e1948c-a468-5fdb-9364-74999e4e0b60_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1391949,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/2750/14032750/interior_boot-1774782088941.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6e1948c-a468-5fdb-9364-74999e4e0b60/a6e1948c-a468-5fdb-9364-74999e4e0b60_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56196,
'Height': 1262,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2750/14032750/docs_service_history-1774783252716-2.jpeg?ixlib=js-3.8.0&auto=format&s=ffd6ce90b73583d8dc0c297c23e96af0',
'Width': 892}],
'price': 2618,
'price_includes_vat': False,
'registration_date': '2015-06-30',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes B180 Sport Executive CDI',
'transmission': 'manual',
'trim': 'B180 Sport Executive CDI',
'vin': 'WDD2462122J347136',
'year': 2015}
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714032750%27 HTTP/1.1" 200 None
2026-03-29 20:17:34 [motorway.uk] INFO: Saving data for 14032750: {'created_time': 1774815454.445972, 'last_price_update_time': 1774815454.445983, 'auction_closing_time': 1774884600.0}
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='14032750') HTTP/1.1" 204 0
2026-03-29 20:17:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4250/20144250/damage_scratches-1772898394460.jpg> (referer: None)
2026-03-29 20:17:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65871a890>
2026-03-29 20:17:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_497a1c26-8195-58e6-88d2-30de4d192840/497a1c26-8195-58e6-88d2-30de4d192840_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4250%252F20144250%252Fdamage_scratches-1772898394460.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4250/20144250/damage_scratches-1772898394460.jpg saved to cache
2026-03-29 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 497a1c26-8195-58e6-88d2-30de4d192840
2026-03-29 20:17:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 497a1c26-8195-58e6-88d2-30de4d192840, skipping ID generation
2026-03-29 20:17:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 497a1c26-8195-58e6-88d2-30de4d192840 with scrape type 1
2026-03-29 20:17:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 497a1c26-8195-58e6-88d2-30de4d192840 sending to next pipeline
2026-03-29 20:17:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 497a1c26-8195-58e6-88d2-30de4d192840, identifier: 20144250
2026-03-29 20:17:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 497a1c26-8195-58e6-88d2-30de4d192840 with identifier: 20144250
2026-03-29 20:17:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 497a1c26-8195-58e6-88d2-30de4d192840 with identifier: 20144250
2026-03-29 20:17:35 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 497a1c26-8195-58e6-88d2-30de4d192840 with identifier: 20144250 to the API
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:17:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/4250/20144250/damage_scratches-1772898394460.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '497a1c26-8195-58e6-88d2-30de4d192840',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LF66 EJJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20144250',
'listing': 'auction',
'location': 'Hampshire Thatcham',
'make': 'Jaguar',
'model': 'F-PACE',
'odometer': 73743,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_844048d8-3adb-5fe2-b55b-e06f48510cfd/844048d8-3adb-5fe2-b55b-e06f48510cfd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1575800,
'Height': 2369,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4250/20144250/exterior_front_driver-1772898177013.jpg',
'Width': 3158},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_844048d8-3adb-5fe2-b55b-e06f48510cfd/844048d8-3adb-5fe2-b55b-e06f48510cfd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1467312,
'Height': 2308,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4250/20144250/exterior_rear_driver-1772898204812.jpg',
'Width': 3077},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_844048d8-3adb-5fe2-b55b-e06f48510cfd/844048d8-3adb-5fe2-b55b-e06f48510cfd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1391213,
'Height': 2296,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4250/20144250/exterior_front_passenger-1772898262622.jpg',
'Width': 3061},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_844048d8-3adb-5fe2-b55b-e06f48510cfd/844048d8-3adb-5fe2-b55b-e06f48510cfd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1786418,
'Height': 2666,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4250/20144250/exterior_rear_passenger-1772898227585.jpg',
'Width': 3554},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_844048d8-3adb-5fe2-b55b-e06f48510cfd/844048d8-3adb-5fe2-b55b-e06f48510cfd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1944031,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4250/20144250/interior_front_seats-1773236308149.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_844048d8-3adb-5fe2-b55b-e06f48510cfd/844048d8-3adb-5fe2-b55b-e06f48510cfd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2596616,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4250/20144250/interior_rear_seats-1772976493215.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_844048d8-3adb-5fe2-b55b-e06f48510cfd/844048d8-3adb-5fe2-b55b-e06f48510cfd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3375084,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4250/20144250/interior_dashboard-1772976534257.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_844048d8-3adb-5fe2-b55b-e06f48510cfd/844048d8-3adb-5fe2-b55b-e06f48510cfd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2924247,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4250/20144250/interior_boot-1772978045576.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_844048d8-3adb-5fe2-b55b-e06f48510cfd/844048d8-3adb-5fe2-b55b-e06f48510cfd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83436,
'Height': 1263,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4250/20144250/docs_service_history-1773236149408-1.jpeg?ixlib=js-3.8.0&auto=format&s=8ea59a5ea13472891a587c11a6219438',
'Width': 892},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_497a1c26-8195-58e6-88d2-30de4d192840/497a1c26-8195-58e6-88d2-30de4d192840_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4969380,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4250/20144250/damage_scratches-1772898394460.jpg',
'Width': 4032}],
'price': 7516,
'price_includes_vat': False,
'registration_date': '2016-09-05',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar F-PACE Prestige AWD D Auto',
'transmission': 'automatic',
'trim': 'Prestige AWD D Auto',
'vin': 'SADCA2AN1HA072187',
'year': 2016}
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720144250%27 HTTP/1.1" 200 None
2026-03-29 20:17:35 [motorway.uk] INFO: Saving data for 20144250: {'created_time': 1774815455.793948, 'last_price_update_time': 1774815455.793959, 'auction_closing_time': 1774884600.0}
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20144250') HTTP/1.1" 204 0
2026-03-29 20:17:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/2216003.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b2f0d2f-8318-5575-958c-9da0f436e848 with identifier: 2216003
2026-03-29 20:17:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b2f0d2f-8318-5575-958c-9da0f436e848 with scrape type 1
2026-03-29 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b2f0d2f-8318-5575-958c-9da0f436e848
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6003%252F2216003%252F2216003-exterior_front_driver-modified-1774110092399.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6003/2216003/2216003-exterior_front_driver-modified-1774110092399.jpeg already downloaded
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6003%252F2216003%252Fexterior_rear_driver-1774108629292.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6003/2216003/exterior_rear_driver-1774108629292.jpeg already downloaded
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6003%252F2216003%252F2216003-exterior_front_passenger-modified-1774109880360.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6003/2216003/2216003-exterior_front_passenger-modified-1774109880360.jpeg already downloaded
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6003%252F2216003%252Fexterior_rear_passenger-1774108597179.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6003/2216003/exterior_rear_passenger-1774108597179.jpeg already downloaded
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6003%252F2216003%252F2216003-interior_front_seats-modified-1774109897491.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6003/2216003/2216003-interior_front_seats-modified-1774109897491.jpeg already downloaded
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6003%252F2216003%252Finterior_rear_seats-1774108855312.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6003/2216003/interior_rear_seats-1774108855312.jpeg already downloaded
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6003%252F2216003%252F2216003-interior_dashboard-modified-1774109908886.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6003/2216003/2216003-interior_dashboard-modified-1774109908886.jpeg already downloaded
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6003%252F2216003%252F2216003-instrument_cluster-modified-1774109810765.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6003/2216003/2216003-instrument_cluster-modified-1774109810765.jpeg already downloaded
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6003%252F2216003%252Finterior_boot-1774109029330.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6003/2216003/interior_boot-1774109029330.jpeg already downloaded
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6003%252F2216003%252Fdocs_service_history-1774108271823.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbc9c075326857f15efc97335a97b809d%27 HTTP/1.1" 200 None
2026-03-29 20:17:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6003/2216003/docs_service_history-1774108271823.jpeg?ixlib=js-3.8.0&auto=format&s=bc9c075326857f15efc97335a97b809d not downloaded yet
2026-03-29 20:17:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19668749.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84deb73d-c21a-5a50-8142-b45925ec00e8 with identifier: 19668749
2026-03-29 20:17:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84deb73d-c21a-5a50-8142-b45925ec00e8 with scrape type 1
2026-03-29 20:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 84deb73d-c21a-5a50-8142-b45925ec00e8
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8749%252F19668749%252Fexterior_front_driver-1774708692180.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8749/19668749/exterior_front_driver-1774708692180.jpg not downloaded yet
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8749%252F19668749%252Fexterior_rear_driver-1774706823208.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8749/19668749/exterior_rear_driver-1774706823208.jpg not downloaded yet
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8749%252F19668749%252Fexterior_front_passenger-1774706821814.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8749/19668749/exterior_front_passenger-1774706821814.jpg not downloaded yet
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8749%252F19668749%252Fexterior_rear_passenger-1774708718761.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8749/19668749/exterior_rear_passenger-1774708718761.jpg not downloaded yet
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8749%252F19668749%252Finterior_front_seats-1774707147440.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8749/19668749/interior_front_seats-1774707147440.jpg not downloaded yet
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8749%252F19668749%252Finterior_rear_seats-1774707166404.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8749/19668749/interior_rear_seats-1774707166404.jpg not downloaded yet
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8749%252F19668749%252Finterior_dashboard-1774708670175.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8749/19668749/interior_dashboard-1774708670175.jpg not downloaded yet
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8749%252F19668749%252Finstrument_cluster-1774707241135.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8749/19668749/instrument_cluster-1774707241135.jpg not downloaded yet
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8749%252F19668749%252Finterior_boot-1774707189378.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8749/19668749/interior_boot-1774707189378.jpg not downloaded yet
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8749%252F19668749%252Fdocs_service_history-1774707662821.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Deda22f7c73c7391186f69d83e08596af%27 HTTP/1.1" 200 None
2026-03-29 20:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8749/19668749/docs_service_history-1774707662821.jpg?ixlib=js-3.8.0&auto=format&s=eda22f7c73c7391186f69d83e08596af not downloaded yet
2026-03-29 20:17:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6003/2216003/docs_service_history-1774108271823.jpeg?ixlib=js-3.8.0&auto=format&s=bc9c075326857f15efc97335a97b809d> (referer: None)
2026-03-29 20:17:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:17:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:44 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:17:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ceefd0>
2026-03-29 20:17:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b2f0d2f-8318-5575-958c-9da0f436e848/9b2f0d2f-8318-5575-958c-9da0f436e848_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6003%252F2216003%252Fdocs_service_history-1774108271823.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbc9c075326857f15efc97335a97b809d') HTTP/1.1" 204 0
2026-03-29 20:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6003/2216003/docs_service_history-1774108271823.jpeg?ixlib=js-3.8.0&auto=format&s=bc9c075326857f15efc97335a97b809d saved to cache
2026-03-29 20:17:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b2f0d2f-8318-5575-958c-9da0f436e848
2026-03-29 20:17:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b2f0d2f-8318-5575-958c-9da0f436e848, skipping ID generation
2026-03-29 20:17:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b2f0d2f-8318-5575-958c-9da0f436e848 with scrape type 1
2026-03-29 20:17:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b2f0d2f-8318-5575-958c-9da0f436e848 sending to next pipeline
2026-03-29 20:17:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9b2f0d2f-8318-5575-958c-9da0f436e848, identifier: 2216003
2026-03-29 20:17:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9b2f0d2f-8318-5575-958c-9da0f436e848 with identifier: 2216003
2026-03-29 20:17:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9b2f0d2f-8318-5575-958c-9da0f436e848 with identifier: 2216003
2026-03-29 20:17:45 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9b2f0d2f-8318-5575-958c-9da0f436e848 with identifier: 2216003 to the API
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:17:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-service-history-photos.imgix.net/redacted/oriented/6003/2216003/docs_service_history-1774108271823.jpeg?ixlib=js-3.8.0&auto=format&s=bc9c075326857f15efc97335a97b809d>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '9b2f0d2f-8318-5575-958c-9da0f436e848',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'SH19 KWX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/2216003',
'listing': 'auction',
'location': 'South Lanarkshire Glasgow',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 55350,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc790cac-0045-5663-80a4-d2ce75909fef/cc790cac-0045-5663-80a4-d2ce75909fef_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2213319,
'Height': 2510,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6003/2216003/2216003-exterior_front_driver-modified-1774110092399.jpeg',
'Width': 3347},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc790cac-0045-5663-80a4-d2ce75909fef/cc790cac-0045-5663-80a4-d2ce75909fef_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1914444,
'Height': 2962,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6003/2216003/exterior_rear_driver-1774108629292.jpeg',
'Width': 3949},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc790cac-0045-5663-80a4-d2ce75909fef/cc790cac-0045-5663-80a4-d2ce75909fef_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2164288,
'Height': 2402,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6003/2216003/2216003-exterior_front_passenger-modified-1774109880360.jpeg',
'Width': 3203},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc790cac-0045-5663-80a4-d2ce75909fef/cc790cac-0045-5663-80a4-d2ce75909fef_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2074494,
'Height': 2696,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6003/2216003/exterior_rear_passenger-1774108597179.jpeg',
'Width': 3594},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc790cac-0045-5663-80a4-d2ce75909fef/cc790cac-0045-5663-80a4-d2ce75909fef_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2764326,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6003/2216003/2216003-interior_front_seats-modified-1774109897491.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc790cac-0045-5663-80a4-d2ce75909fef/cc790cac-0045-5663-80a4-d2ce75909fef_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2927128,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6003/2216003/interior_rear_seats-1774108855312.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc790cac-0045-5663-80a4-d2ce75909fef/cc790cac-0045-5663-80a4-d2ce75909fef_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1643313,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6003/2216003/2216003-interior_dashboard-modified-1774109908886.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc790cac-0045-5663-80a4-d2ce75909fef/cc790cac-0045-5663-80a4-d2ce75909fef_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 500141,
'Height': 1875,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6003/2216003/2216003-instrument_cluster-modified-1774109810765.jpeg',
'Width': 2500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc790cac-0045-5663-80a4-d2ce75909fef/cc790cac-0045-5663-80a4-d2ce75909fef_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2788718,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6003/2216003/interior_boot-1774109029330.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b2f0d2f-8318-5575-958c-9da0f436e848/9b2f0d2f-8318-5575-958c-9da0f436e848_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3086646,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6003/2216003/docs_service_history-1774108271823.jpeg?ixlib=js-3.8.0&auto=format&s=bc9c075326857f15efc97335a97b809d',
'Width': 4032}],
'price': 8110,
'price_includes_vat': False,
'registration_date': '2019-03-29',
'seats_number': None,
'seller_name': None,
'title': 'Renault Kadjar GT Line TCE',
'transmission': 'manual',
'trim': 'GT Line TCE',
'vin': 'VF1RFE00462632062',
'year': 2019}
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%272216003%27 HTTP/1.1" 200 None
2026-03-29 20:17:45 [motorway.uk] INFO: Saving data for 2216003: {'created_time': 1774815465.295352, 'last_price_update_time': 1774815465.295362, 'auction_closing_time': 1774884600.0}
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='2216003') HTTP/1.1" 204 0
2026-03-29 20:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8749/19668749/docs_service_history-1774707662821.jpg?ixlib=js-3.8.0&auto=format&s=eda22f7c73c7391186f69d83e08596af> (referer: None)
2026-03-29 20:17:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659cecb10>
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84deb73d-c21a-5a50-8142-b45925ec00e8/84deb73d-c21a-5a50-8142-b45925ec00e8_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8749%252F19668749%252Fdocs_service_history-1774707662821.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Deda22f7c73c7391186f69d83e08596af') HTTP/1.1" 204 0
2026-03-29 20:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8749/19668749/docs_service_history-1774707662821.jpg?ixlib=js-3.8.0&auto=format&s=eda22f7c73c7391186f69d83e08596af saved to cache
2026-03-29 20:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 84deb73d-c21a-5a50-8142-b45925ec00e8
2026-03-29 20:17:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8749/19668749/interior_boot-1774707189378.jpg> (referer: None)
2026-03-29 20:17:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658354190>
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84deb73d-c21a-5a50-8142-b45925ec00e8/84deb73d-c21a-5a50-8142-b45925ec00e8_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8749%252F19668749%252Finterior_boot-1774707189378.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8749/19668749/interior_boot-1774707189378.jpg saved to cache
2026-03-29 20:17:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 84deb73d-c21a-5a50-8142-b45925ec00e8
2026-03-29 20:17:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8749/19668749/instrument_cluster-1774707241135.jpg> (referer: None)
2026-03-29 20:17:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c14ad0>
2026-03-29 20:17:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84deb73d-c21a-5a50-8142-b45925ec00e8/84deb73d-c21a-5a50-8142-b45925ec00e8_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8749%252F19668749%252Finstrument_cluster-1774707241135.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8749/19668749/instrument_cluster-1774707241135.jpg saved to cache
2026-03-29 20:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 84deb73d-c21a-5a50-8142-b45925ec00e8
2026-03-29 20:17:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8749/19668749/interior_dashboard-1774708670175.jpg> (referer: None)
2026-03-29 20:17:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658356450>
2026-03-29 20:17:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84deb73d-c21a-5a50-8142-b45925ec00e8/84deb73d-c21a-5a50-8142-b45925ec00e8_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8749%252F19668749%252Finterior_dashboard-1774708670175.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8749/19668749/interior_dashboard-1774708670175.jpg saved to cache
2026-03-29 20:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 84deb73d-c21a-5a50-8142-b45925ec00e8
2026-03-29 20:17:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8749/19668749/interior_rear_seats-1774707166404.jpg> (referer: None)
2026-03-29 20:17:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f12750>
2026-03-29 20:17:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84deb73d-c21a-5a50-8142-b45925ec00e8/84deb73d-c21a-5a50-8142-b45925ec00e8_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8749%252F19668749%252Finterior_rear_seats-1774707166404.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8749/19668749/interior_rear_seats-1774707166404.jpg saved to cache
2026-03-29 20:17:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 84deb73d-c21a-5a50-8142-b45925ec00e8
2026-03-29 20:17:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17744204.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4 with identifier: 17744204
2026-03-29 20:17:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4 with scrape type 1
2026-03-29 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4204%252F17744204%252Fexterior_front_driver-1774701360623.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4204/17744204/exterior_front_driver-1774701360623.jpg not downloaded yet
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4204%252F17744204%252Fexterior_rear_driver-1774702336971.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4204/17744204/exterior_rear_driver-1774702336971.jpg not downloaded yet
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4204%252F17744204%252Fexterior_front_passenger-1774702356935.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4204/17744204/exterior_front_passenger-1774702356935.jpg not downloaded yet
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4204%252F17744204%252Fexterior_rear_passenger-1774701467081.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4204/17744204/exterior_rear_passenger-1774701467081.jpg not downloaded yet
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4204%252F17744204%252Finterior_front_seats-1774701838997.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4204/17744204/interior_front_seats-1774701838997.jpg not downloaded yet
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4204%252F17744204%252Finterior_rear_seats-1774701856769.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4204/17744204/interior_rear_seats-1774701856769.jpg not downloaded yet
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4204%252F17744204%252Finterior_dashboard-1774702541135.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4204/17744204/interior_dashboard-1774702541135.jpg not downloaded yet
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4204%252F17744204%252Finstrument_cluster-1774701500552.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4204/17744204/instrument_cluster-1774701500552.jpg not downloaded yet
2026-03-29 20:17:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8749/19668749/exterior_rear_passenger-1774708718761.jpg> (referer: None)
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4204%252F17744204%252Finterior_boot-1774701879907.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4204/17744204/interior_boot-1774701879907.jpg not downloaded yet
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4204%252F17744204%252Fdocs_service_history-1774548286334.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db38753b5419cce2c652e5827d4499b80%27 HTTP/1.1" 200 None
2026-03-29 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4204/17744204/docs_service_history-1774548286334.jpg?ixlib=js-3.8.0&auto=format&s=b38753b5419cce2c652e5827d4499b80 not downloaded yet
2026-03-29 20:17:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8749/19668749/interior_front_seats-1774707147440.jpg> (referer: None)
2026-03-29 20:17:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658701690>
2026-03-29 20:17:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84deb73d-c21a-5a50-8142-b45925ec00e8/84deb73d-c21a-5a50-8142-b45925ec00e8_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8749%252F19668749%252Fexterior_rear_passenger-1774708718761.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8749/19668749/exterior_rear_passenger-1774708718761.jpg saved to cache
2026-03-29 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 84deb73d-c21a-5a50-8142-b45925ec00e8
2026-03-29 20:17:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658701b50>
2026-03-29 20:17:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84deb73d-c21a-5a50-8142-b45925ec00e8/84deb73d-c21a-5a50-8142-b45925ec00e8_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8749%252F19668749%252Finterior_front_seats-1774707147440.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8749/19668749/interior_front_seats-1774707147440.jpg saved to cache
2026-03-29 20:17:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 84deb73d-c21a-5a50-8142-b45925ec00e8
2026-03-29 20:17:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4204/17744204/interior_dashboard-1774702541135.jpg> (referer: None)
2026-03-29 20:17:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584f3650>
2026-03-29 20:17:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4/1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4204%252F17744204%252Finterior_dashboard-1774702541135.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4204/17744204/interior_dashboard-1774702541135.jpg saved to cache
2026-03-29 20:17:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4
2026-03-29 20:17:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4204/17744204/interior_boot-1774701879907.jpg> (referer: None)
2026-03-29 20:17:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658460750>
2026-03-29 20:17:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4/1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4204%252F17744204%252Finterior_boot-1774701879907.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4204/17744204/interior_boot-1774701879907.jpg saved to cache
2026-03-29 20:17:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4
2026-03-29 20:17:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4204/17744204/instrument_cluster-1774701500552.jpg> (referer: None)
2026-03-29 20:17:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584f0610>
2026-03-29 20:17:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4/1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4204%252F17744204%252Finstrument_cluster-1774701500552.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4204/17744204/instrument_cluster-1774701500552.jpg saved to cache
2026-03-29 20:17:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4
2026-03-29 20:17:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4204/17744204/interior_rear_seats-1774701856769.jpg> (referer: None)
2026-03-29 20:17:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4204/17744204/docs_service_history-1774548286334.jpg?ixlib=js-3.8.0&auto=format&s=b38753b5419cce2c652e5827d4499b80> (referer: None)
2026-03-29 20:17:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a40cd0>
2026-03-29 20:17:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4/1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4204%252F17744204%252Finterior_rear_seats-1774701856769.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4204/17744204/interior_rear_seats-1774701856769.jpg saved to cache
2026-03-29 20:17:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4
2026-03-29 20:17:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:17:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:48 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:17:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65871aa10>
2026-03-29 20:17:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4/1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4204%252F17744204%252Fdocs_service_history-1774548286334.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db38753b5419cce2c652e5827d4499b80') HTTP/1.1" 204 0
2026-03-29 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4204/17744204/docs_service_history-1774548286334.jpg?ixlib=js-3.8.0&auto=format&s=b38753b5419cce2c652e5827d4499b80 saved to cache
2026-03-29 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4
2026-03-29 20:17:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4204/17744204/interior_front_seats-1774701838997.jpg> (referer: None)
2026-03-29 20:17:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c17d90>
2026-03-29 20:17:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4/1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4204%252F17744204%252Finterior_front_seats-1774701838997.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4204/17744204/interior_front_seats-1774701838997.jpg saved to cache
2026-03-29 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4
2026-03-29 20:17:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4204/17744204/exterior_front_passenger-1774702356935.jpg> (referer: None)
2026-03-29 20:17:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fa9350>
2026-03-29 20:17:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4/1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4204%252F17744204%252Fexterior_front_passenger-1774702356935.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4204/17744204/exterior_front_passenger-1774702356935.jpg saved to cache
2026-03-29 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4
2026-03-29 20:17:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4204/17744204/exterior_rear_passenger-1774701467081.jpg> (referer: None)
2026-03-29 20:17:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a42a50>
2026-03-29 20:17:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4/1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4204%252F17744204%252Fexterior_rear_passenger-1774701467081.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4204/17744204/exterior_rear_passenger-1774701467081.jpg saved to cache
2026-03-29 20:17:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4
2026-03-29 20:17:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4204/17744204/exterior_front_driver-1774701360623.jpg> (referer: None)
2026-03-29 20:17:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4204/17744204/exterior_rear_driver-1774702336971.jpg> (referer: None)
2026-03-29 20:17:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65885edd0>
2026-03-29 20:17:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4/1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4204%252F17744204%252Fexterior_front_driver-1774701360623.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4204/17744204/exterior_front_driver-1774701360623.jpg saved to cache
2026-03-29 20:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4
2026-03-29 20:17:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586aec90>
2026-03-29 20:17:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4/1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4204%252F17744204%252Fexterior_rear_driver-1774702336971.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4204/17744204/exterior_rear_driver-1774702336971.jpg saved to cache
2026-03-29 20:17:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4
2026-03-29 20:17:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4, skipping ID generation
2026-03-29 20:17:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4 with scrape type 1
2026-03-29 20:17:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4 sending to next pipeline
2026-03-29 20:17:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4, identifier: 17744204
2026-03-29 20:17:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4 with identifier: 17744204
2026-03-29 20:17:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4 with identifier: 17744204
2026-03-29 20:17:50 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4 with identifier: 17744204 to the API
2026-03-29 20:17:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:17:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:17:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/4204/17744204/exterior_rear_driver-1774702336971.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MO15 AAC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17744204',
'listing': 'auction',
'location': 'West Midlands Birmingham',
'make': 'Mercedes',
'model': 'GLE Class',
'odometer': 94863,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4/1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2447832,
'Height': 2894,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4204/17744204/exterior_front_driver-1774701360623.jpg',
'Width': 3859},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4/1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2306489,
'Height': 2762,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4204/17744204/exterior_rear_driver-1774702336971.jpg',
'Width': 3683},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4/1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2047582,
'Height': 2585,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4204/17744204/exterior_front_passenger-1774702356935.jpg',
'Width': 3447},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4/1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1945416,
'Height': 2531,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4204/17744204/exterior_rear_passenger-1774701467081.jpg',
'Width': 3375},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4/1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3485394,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4204/17744204/interior_front_seats-1774701838997.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4/1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2373191,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4204/17744204/interior_rear_seats-1774701856769.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4/1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2531932,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4204/17744204/interior_dashboard-1774702541135.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4/1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1789021,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4204/17744204/instrument_cluster-1774701500552.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4/1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2873751,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4204/17744204/interior_boot-1774701879907.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4/1e6d269e-bb41-5bb0-850a-8d1e5c5b94f4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7105309,
'Height': 4284,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4204/17744204/docs_service_history-1774548286334.jpg?ixlib=js-3.8.0&auto=format&s=b38753b5419cce2c652e5827d4499b80',
'Width': 5712}],
'price': 16405,
'price_includes_vat': False,
'registration_date': '2017-09-15',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes GLE 350 D 4M AMG Line Prem + A',
'transmission': 'automatic',
'trim': 'GLE 350 D 4M AMG Line Prem + A',
'vin': 'WDC1660242A996591',
'year': 2017}
2026-03-29 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717744204%27 HTTP/1.1" 200 None
2026-03-29 20:17:50 [motorway.uk] INFO: Saving data for 17744204: {'created_time': 1774815470.895211, 'last_price_update_time': 1774815470.895222, 'auction_closing_time': 1774884600.0}
2026-03-29 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17744204') HTTP/1.1" 204 0
2026-03-29 20:17:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8749/19668749/exterior_rear_driver-1774706823208.jpg> (referer: None)
2026-03-29 20:17:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8749/19668749/exterior_front_passenger-1774706821814.jpg> (referer: None)
2026-03-29 20:17:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586afe10>
2026-03-29 20:17:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84deb73d-c21a-5a50-8142-b45925ec00e8/84deb73d-c21a-5a50-8142-b45925ec00e8_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8749%252F19668749%252Fexterior_rear_driver-1774706823208.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8749/19668749/exterior_rear_driver-1774706823208.jpg saved to cache
2026-03-29 20:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 84deb73d-c21a-5a50-8142-b45925ec00e8
2026-03-29 20:17:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65beff010>
2026-03-29 20:17:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84deb73d-c21a-5a50-8142-b45925ec00e8/84deb73d-c21a-5a50-8142-b45925ec00e8_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8749%252F19668749%252Fexterior_front_passenger-1774706821814.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8749/19668749/exterior_front_passenger-1774706821814.jpg saved to cache
2026-03-29 20:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 84deb73d-c21a-5a50-8142-b45925ec00e8
2026-03-29 20:17:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8749/19668749/exterior_front_driver-1774708692180.jpg> (referer: None)
2026-03-29 20:17:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a72950>
2026-03-29 20:17:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84deb73d-c21a-5a50-8142-b45925ec00e8/84deb73d-c21a-5a50-8142-b45925ec00e8_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8749%252F19668749%252Fexterior_front_driver-1774708692180.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8749/19668749/exterior_front_driver-1774708692180.jpg saved to cache
2026-03-29 20:17:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84deb73d-c21a-5a50-8142-b45925ec00e8
2026-03-29 20:17:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84deb73d-c21a-5a50-8142-b45925ec00e8, skipping ID generation
2026-03-29 20:17:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84deb73d-c21a-5a50-8142-b45925ec00e8 with scrape type 1
2026-03-29 20:17:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84deb73d-c21a-5a50-8142-b45925ec00e8 sending to next pipeline
2026-03-29 20:17:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 84deb73d-c21a-5a50-8142-b45925ec00e8, identifier: 19668749
2026-03-29 20:17:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 84deb73d-c21a-5a50-8142-b45925ec00e8 with identifier: 19668749
2026-03-29 20:17:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 84deb73d-c21a-5a50-8142-b45925ec00e8 with identifier: 19668749
2026-03-29 20:17:51 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 84deb73d-c21a-5a50-8142-b45925ec00e8 with identifier: 19668749 to the API
2026-03-29 20:17:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:17:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:17:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/8749/19668749/exterior_front_driver-1774708692180.jpg>
{'auction_title': '',
'category': None,
'color': 'Green',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '84deb73d-c21a-5a50-8142-b45925ec00e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YF67 NCA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19668749',
'listing': 'auction',
'location': 'Nottinghamshire Nottingham',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 48344,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 32,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84deb73d-c21a-5a50-8142-b45925ec00e8/84deb73d-c21a-5a50-8142-b45925ec00e8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1753878,
'Height': 2203,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8749/19668749/exterior_front_driver-1774708692180.jpg',
'Width': 2937},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84deb73d-c21a-5a50-8142-b45925ec00e8/84deb73d-c21a-5a50-8142-b45925ec00e8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1211835,
'Height': 2171,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8749/19668749/exterior_rear_driver-1774706823208.jpg',
'Width': 2895},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84deb73d-c21a-5a50-8142-b45925ec00e8/84deb73d-c21a-5a50-8142-b45925ec00e8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1520873,
'Height': 2480,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8749/19668749/exterior_front_passenger-1774706821814.jpg',
'Width': 3307},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84deb73d-c21a-5a50-8142-b45925ec00e8/84deb73d-c21a-5a50-8142-b45925ec00e8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1809461,
'Height': 2485,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8749/19668749/exterior_rear_passenger-1774708718761.jpg',
'Width': 3313},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84deb73d-c21a-5a50-8142-b45925ec00e8/84deb73d-c21a-5a50-8142-b45925ec00e8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3411168,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8749/19668749/interior_front_seats-1774707147440.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84deb73d-c21a-5a50-8142-b45925ec00e8/84deb73d-c21a-5a50-8142-b45925ec00e8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3313828,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8749/19668749/interior_rear_seats-1774707166404.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84deb73d-c21a-5a50-8142-b45925ec00e8/84deb73d-c21a-5a50-8142-b45925ec00e8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2472617,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8749/19668749/interior_dashboard-1774708670175.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84deb73d-c21a-5a50-8142-b45925ec00e8/84deb73d-c21a-5a50-8142-b45925ec00e8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2641839,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8749/19668749/instrument_cluster-1774707241135.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84deb73d-c21a-5a50-8142-b45925ec00e8/84deb73d-c21a-5a50-8142-b45925ec00e8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3182816,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8749/19668749/interior_boot-1774707189378.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84deb73d-c21a-5a50-8142-b45925ec00e8/84deb73d-c21a-5a50-8142-b45925ec00e8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1559548,
'Height': 2311,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8749/19668749/docs_service_history-1774707662821.jpg?ixlib=js-3.8.0&auto=format&s=eda22f7c73c7391186f69d83e08596af',
'Width': 1782}],
'price': 6379,
'price_includes_vat': False,
'registration_date': '2017-10-31',
'seats_number': None,
'seller_name': None,
'title': 'Ford Fiesta B AND O Play Titanium T',
'transmission': 'manual',
'trim': 'B AND O Play Titanium T',
'vin': 'WF0JXXGAHJHC20715',
'year': 2017}
2026-03-29 20:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719668749%27 HTTP/1.1" 200 None
2026-03-29 20:17:51 [motorway.uk] INFO: Saving data for 19668749: {'created_time': 1774815471.871326, 'last_price_update_time': 1774815471.871336, 'auction_closing_time': 1774884600.0}
2026-03-29 20:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19668749') HTTP/1.1" 204 0
2026-03-29 20:17:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20473857.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87da71cb-f8e3-5bf8-b845-0b2cc69d69e3 with identifier: 20473857
2026-03-29 20:17:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87da71cb-f8e3-5bf8-b845-0b2cc69d69e3 with scrape type 1
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 87da71cb-f8e3-5bf8-b845-0b2cc69d69e3
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3857%252F20473857%252Fexterior_front_driver-1774623163385.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3857/20473857/exterior_front_driver-1774623163385.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3857%252F20473857%252Fexterior_rear_driver-1774623191432.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3857/20473857/exterior_rear_driver-1774623191432.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3857%252F20473857%252Fexterior_front_passenger-1774623233218.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3857/20473857/exterior_front_passenger-1774623233218.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3857%252F20473857%252Fexterior_rear_passenger-1774623213896.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3857/20473857/exterior_rear_passenger-1774623213896.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3857%252F20473857%252Finterior_front_seats-1774623818592.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3857/20473857/interior_front_seats-1774623818592.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3857%252F20473857%252Finterior_rear_seats-1774623844436.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3857/20473857/interior_rear_seats-1774623844436.jpg not downloaded yet
2026-03-29 20:17:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20419987.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3857%252F20473857%252Finterior_dashboard-1774623972617.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3857/20473857/interior_dashboard-1774623972617.jpg not downloaded yet
2026-03-29 20:17:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3857%252F20473857%252Finstrument_cluster-1774623911188.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3857/20473857/instrument_cluster-1774623911188.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3857%252F20473857%252Finterior_boot-1774623926053.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3857/20473857/interior_boot-1774623926053.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3857%252F20473857%252Fdocs_service_history-1774624645310.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7401b8786be346cbfe0ab0efcde2111a%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3857/20473857/docs_service_history-1774624645310.jpg?ixlib=js-3.8.0&auto=format&s=7401b8786be346cbfe0ab0efcde2111a not downloaded yet
2026-03-29 20:17:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1238faff-06b0-5b59-899a-f2c4a26dbdca with identifier: 20419987
2026-03-29 20:17:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1238faff-06b0-5b59-899a-f2c4a26dbdca with scrape type 1
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1238faff-06b0-5b59-899a-f2c4a26dbdca
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9987%252F20419987%252Fexterior_front_driver-1774601115897.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9987/20419987/exterior_front_driver-1774601115897.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9987%252F20419987%252Fexterior_rear_driver-1774601115435.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9987/20419987/exterior_rear_driver-1774601115435.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9987%252F20419987%252Fexterior_front_passenger-1774601117623.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9987/20419987/exterior_front_passenger-1774601117623.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9987%252F20419987%252Fexterior_rear_passenger-1774601118068.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9987/20419987/exterior_rear_passenger-1774601118068.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9987%252F20419987%252Finterior_front_seats-1774601021421.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9987/20419987/interior_front_seats-1774601021421.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9987%252F20419987%252Finterior_rear_seats-1774601022981.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9987/20419987/interior_rear_seats-1774601022981.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9987%252F20419987%252Finterior_dashboard-1774601043825.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9987/20419987/interior_dashboard-1774601043825.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9987%252F20419987%252Finstrument_cluster-1774601153561.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9987/20419987/instrument_cluster-1774601153561.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9987%252F20419987%252Finterior_boot-1774601025674.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9987/20419987/interior_boot-1774601025674.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9987%252F20419987%252Fdocs_service_history-1774711535310.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D441a622319d970d225b9f61a03e2bc57%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9987/20419987/docs_service_history-1774711535310.jpg?ixlib=js-3.8.0&auto=format&s=441a622319d970d225b9f61a03e2bc57 not downloaded yet
2026-03-29 20:17:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/5963462.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f3972eb-b81b-57dd-bb4c-b112b97d7b48 with identifier: 5963462
2026-03-29 20:17:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f3972eb-b81b-57dd-bb4c-b112b97d7b48 with scrape type 1
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3f3972eb-b81b-57dd-bb4c-b112b97d7b48
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3462%252F5963462%252Fexterior_front_driver-1774631676406.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3462/5963462/exterior_front_driver-1774631676406.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3462%252F5963462%252Fexterior_rear_driver-1774631681088.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3462/5963462/exterior_rear_driver-1774631681088.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3462%252F5963462%252Fexterior_front_passenger-1774631672782.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3462/5963462/exterior_front_passenger-1774631672782.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3462%252F5963462%252Fexterior_rear_passenger-1774631674289.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3462/5963462/exterior_rear_passenger-1774631674289.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3462%252F5963462%252Finterior_front_seats-1774632509656.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3462/5963462/interior_front_seats-1774632509656.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3462%252F5963462%252Finterior_dashboard-1774632542791.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3462/5963462/interior_dashboard-1774632542791.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3462%252F5963462%252Finstrument_cluster-1774632590425.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3462/5963462/instrument_cluster-1774632590425.jpg not downloaded yet
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3462%252F5963462%252Finterior_boot-1774635787913.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3462/5963462/interior_boot-1774635787913.jpg not downloaded yet
2026-03-29 20:17:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9987/20419987/docs_service_history-1774711535310.jpg?ixlib=js-3.8.0&auto=format&s=441a622319d970d225b9f61a03e2bc57> (referer: None)
2026-03-29 20:17:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3462%252F5963462%252Fdocs_service_history-1774632802087.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D89bbd9f13fa5e26449d1daa1b493a866%27 HTTP/1.1" 200 None
2026-03-29 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3462/5963462/docs_service_history-1774632802087.jpg?ixlib=js-3.8.0&auto=format&s=89bbd9f13fa5e26449d1daa1b493a866 not downloaded yet
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3462%252F5963462%252Fdocs_service_history-1774632814864.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D240a2a286f6fa2e2c62c445ef5cc4961%27 HTTP/1.1" 200 None
2026-03-29 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3462/5963462/docs_service_history-1774632814864.jpg?ixlib=js-3.8.0&auto=format&s=240a2a286f6fa2e2c62c445ef5cc4961 not downloaded yet
2026-03-29 20:17:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c14b10>
2026-03-29 20:17:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1238faff-06b0-5b59-899a-f2c4a26dbdca/1238faff-06b0-5b59-899a-f2c4a26dbdca_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9987%252F20419987%252Fdocs_service_history-1774711535310.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D441a622319d970d225b9f61a03e2bc57') HTTP/1.1" 204 0
2026-03-29 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9987/20419987/docs_service_history-1774711535310.jpg?ixlib=js-3.8.0&auto=format&s=441a622319d970d225b9f61a03e2bc57 saved to cache
2026-03-29 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1238faff-06b0-5b59-899a-f2c4a26dbdca
2026-03-29 20:17:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3857/20473857/interior_rear_seats-1774623844436.jpg> (referer: None)
2026-03-29 20:17:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1224&page=34&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:17:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:17:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:17:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:17:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c15390>
2026-03-29 20:17:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87da71cb-f8e3-5bf8-b845-0b2cc69d69e3/87da71cb-f8e3-5bf8-b845-0b2cc69d69e3_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3857%252F20473857%252Finterior_rear_seats-1774623844436.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3857/20473857/interior_rear_seats-1774623844436.jpg saved to cache
2026-03-29 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 87da71cb-f8e3-5bf8-b845-0b2cc69d69e3
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 19861645
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 20152688
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 18699505
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 20455511
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720455511%27 HTTP/1.1" 200 None
2026-03-29 20:17:53 [motorway.uk] INFO: Scrape type for 20455511: 1
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 19242613
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719242613%27 HTTP/1.1" 200 None
2026-03-29 20:17:53 [motorway.uk] INFO: Scrape type for 19242613: 1
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 17909162
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 8203355
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 20378089
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 20299221
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 18086482
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 19449183
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719449183%27 HTTP/1.1" 200 None
2026-03-29 20:17:53 [motorway.uk] INFO: Scrape type for 19449183: 1
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 20485669
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 20451319
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720451319%27 HTTP/1.1" 200 None
2026-03-29 20:17:53 [motorway.uk] INFO: Scrape type for 20451319: 1
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 20410678
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 13676396
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 2387574
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 13149221
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 20498874
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 19958948
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 20435928
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720435928%27 HTTP/1.1" 200 None
2026-03-29 20:17:53 [motorway.uk] INFO: Scrape type for 20435928: 1
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 20487335
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 20279875
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720279875%27 HTTP/1.1" 200 None
2026-03-29 20:17:53 [motorway.uk] INFO: Scrape type for 20279875: 1
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 11436867
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711436867%27 HTTP/1.1" 200 None
2026-03-29 20:17:53 [motorway.uk] INFO: Scrape type for 11436867: 1
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 20385406
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 19712537
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 17056470
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 19080843
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 20261314
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 19037322
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 10154809
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 17587362
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717587362%27 HTTP/1.1" 200 None
2026-03-29 20:17:53 [motorway.uk] INFO: Scrape type for 17587362: 1
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 20488866
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 20475825
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 20485471
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 19631185
2026-03-29 20:17:53 [motorway.uk] INFO: Found listing with ID: 20482587
2026-03-29 20:17:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3462/5963462/interior_boot-1774635787913.jpg> (referer: None)
2026-03-29 20:17:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3462/5963462/docs_service_history-1774632814864.jpg?ixlib=js-3.8.0&auto=format&s=240a2a286f6fa2e2c62c445ef5cc4961> (referer: None)
2026-03-29 20:17:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3462/5963462/docs_service_history-1774632802087.jpg?ixlib=js-3.8.0&auto=format&s=89bbd9f13fa5e26449d1daa1b493a866> (referer: None)
2026-03-29 20:17:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a68550>
2026-03-29 20:17:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f3972eb-b81b-57dd-bb4c-b112b97d7b48/3f3972eb-b81b-57dd-bb4c-b112b97d7b48_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3462%252F5963462%252Finterior_boot-1774635787913.jpg') HTTP/1.1" 204 0
2026-03-29 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3462/5963462/interior_boot-1774635787913.jpg saved to cache
2026-03-29 20:17:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3f3972eb-b81b-57dd-bb4c-b112b97d7b48
2026-03-29 20:17:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658b459d0>
2026-03-29 20:17:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f3972eb-b81b-57dd-bb4c-b112b97d7b48/3f3972eb-b81b-57dd-bb4c-b112b97d7b48_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:17:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3462%252F5963462%252Fdocs_service_history-1774632814864.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D240a2a286f6fa2e2c62c445ef5cc4961') HTTP/1.1" 204 0
2026-03-29 20:17:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3462/5963462/docs_service_history-1774632814864.jpg?ixlib=js-3.8.0&auto=format&s=240a2a286f6fa2e2c62c445ef5cc4961 saved to cache
2026-03-29 20:17:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3f3972eb-b81b-57dd-bb4c-b112b97d7b48
2026-03-29 20:17:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:17:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658718ad0>
2026-03-29 20:17:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:17:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:17:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:17:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f3972eb-b81b-57dd-bb4c-b112b97d7b48/3f3972eb-b81b-57dd-bb4c-b112b97d7b48_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3462%252F5963462%252Fdocs_service_history-1774632802087.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D89bbd9f13fa5e26449d1daa1b493a866') HTTP/1.1" 204 0
2026-03-29 20:17:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3462/5963462/docs_service_history-1774632802087.jpg?ixlib=js-3.8.0&auto=format&s=89bbd9f13fa5e26449d1daa1b493a866 saved to cache
2026-03-29 20:17:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3f3972eb-b81b-57dd-bb4c-b112b97d7b48
2026-03-29 20:17:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13687661.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:17:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:17:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8140033a-3dac-58b7-9efd-f81a17e42a6d with identifier: 13687661
2026-03-29 20:17:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8140033a-3dac-58b7-9efd-f81a17e42a6d with scrape type 1
2026-03-29 20:17:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8140033a-3dac-58b7-9efd-f81a17e42a6d
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7661%252F13687661%252Fexterior_front_driver-1774708801093.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7661/13687661/exterior_front_driver-1774708801093.jpg not downloaded yet
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7661%252F13687661%252Fexterior_rear_driver-1774708813534.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7661/13687661/exterior_rear_driver-1774708813534.jpg not downloaded yet
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7661%252F13687661%252Fexterior_front_passenger-1774708831769.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7661/13687661/exterior_front_passenger-1774708831769.jpg not downloaded yet
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7661%252F13687661%252Fexterior_rear_passenger-1774708821441.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7661/13687661/exterior_rear_passenger-1774708821441.jpg not downloaded yet
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7661%252F13687661%252Finterior_front_seats-1774709229423.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7661/13687661/interior_front_seats-1774709229423.jpg not downloaded yet
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7661%252F13687661%252Finterior_rear_seats-1774709238861.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7661/13687661/interior_rear_seats-1774709238861.jpg not downloaded yet
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7661%252F13687661%252Finterior_dashboard-1774774827361.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7661/13687661/interior_dashboard-1774774827361.jpg not downloaded yet
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7661%252F13687661%252Finstrument_cluster-1774709322770.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7661/13687661/instrument_cluster-1774709322770.jpg not downloaded yet
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7661%252F13687661%252Finterior_boot-1774709278080.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7661/13687661/interior_boot-1774709278080.jpg not downloaded yet
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:17:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7661%252F13687661%252Fdamage_scratches-1774708899825.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:17:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7661/13687661/damage_scratches-1774708899825.jpg not downloaded yet
2026-03-29 20:18:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18169442.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff628176-102d-5605-91dd-4d57e30101be with identifier: 18169442
2026-03-29 20:18:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff628176-102d-5605-91dd-4d57e30101be with scrape type 1
2026-03-29 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ff628176-102d-5605-91dd-4d57e30101be
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9442%252F18169442%252Fexterior_front_driver-1774700989215.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9442/18169442/exterior_front_driver-1774700989215.jpg not downloaded yet
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9442%252F18169442%252Fexterior_rear_driver-1774701029517.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9442/18169442/exterior_rear_driver-1774701029517.jpg not downloaded yet
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9442%252F18169442%252Fexterior_front_passenger-1774701075527.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9442/18169442/exterior_front_passenger-1774701075527.jpg not downloaded yet
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9442%252F18169442%252Fexterior_rear_passenger-1774701077599.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9442/18169442/exterior_rear_passenger-1774701077599.jpg not downloaded yet
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9442%252F18169442%252Finterior_front_seats-1774702664785.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9442/18169442/interior_front_seats-1774702664785.jpg not downloaded yet
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9442%252F18169442%252Finterior_rear_seats-1774702568438.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9442/18169442/interior_rear_seats-1774702568438.jpg not downloaded yet
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9442%252F18169442%252Finterior_dashboard-1774702633461.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9442/18169442/interior_dashboard-1774702633461.jpg not downloaded yet
2026-03-29 20:18:05 [scrapy.extensions.logstats] INFO: Crawled 291 pages (at 16 pages/min), scraped 151 items (at 8 items/min)
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9442%252F18169442%252Finstrument_cluster-1774702633719.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9442/18169442/instrument_cluster-1774702633719.jpg not downloaded yet
2026-03-29 20:18:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 304MiB
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9442%252F18169442%252Finterior_boot-1774702645520.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9442/18169442/interior_boot-1774702645520.jpg not downloaded yet
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9442%252F18169442%252Fdocs_service_history-1774706437671.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1ecd67f5edabe34e4c64b4514a4dfe49%27 HTTP/1.1" 200 None
2026-03-29 20:18:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9442/18169442/docs_service_history-1774706437671.jpg?ixlib=js-3.8.0&auto=format&s=1ecd67f5edabe34e4c64b4514a4dfe49 not downloaded yet
2026-03-29 20:18:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7661/13687661/damage_scratches-1774708899825.jpg> (referer: None)
2026-03-29 20:18:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589f1710>
2026-03-29 20:18:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8140033a-3dac-58b7-9efd-f81a17e42a6d/8140033a-3dac-58b7-9efd-f81a17e42a6d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7661%252F13687661%252Fdamage_scratches-1774708899825.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7661/13687661/damage_scratches-1774708899825.jpg saved to cache
2026-03-29 20:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8140033a-3dac-58b7-9efd-f81a17e42a6d
2026-03-29 20:18:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9442/18169442/docs_service_history-1774706437671.jpg?ixlib=js-3.8.0&auto=format&s=1ecd67f5edabe34e4c64b4514a4dfe49> (referer: None)
2026-03-29 20:18:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589f0d90>
2026-03-29 20:18:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff628176-102d-5605-91dd-4d57e30101be/ff628176-102d-5605-91dd-4d57e30101be_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9442%252F18169442%252Fdocs_service_history-1774706437671.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1ecd67f5edabe34e4c64b4514a4dfe49') HTTP/1.1" 204 0
2026-03-29 20:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9442/18169442/docs_service_history-1774706437671.jpg?ixlib=js-3.8.0&auto=format&s=1ecd67f5edabe34e4c64b4514a4dfe49 saved to cache
2026-03-29 20:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ff628176-102d-5605-91dd-4d57e30101be
2026-03-29 20:18:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9442/18169442/interior_boot-1774702645520.jpg> (referer: None)
2026-03-29 20:18:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658535e10>
2026-03-29 20:18:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff628176-102d-5605-91dd-4d57e30101be/ff628176-102d-5605-91dd-4d57e30101be_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9442%252F18169442%252Finterior_boot-1774702645520.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9442/18169442/interior_boot-1774702645520.jpg saved to cache
2026-03-29 20:18:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ff628176-102d-5605-91dd-4d57e30101be
2026-03-29 20:18:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9442/18169442/instrument_cluster-1774702633719.jpg> (referer: None)
2026-03-29 20:18:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6588470d0>
2026-03-29 20:18:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff628176-102d-5605-91dd-4d57e30101be/ff628176-102d-5605-91dd-4d57e30101be_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9442%252F18169442%252Finstrument_cluster-1774702633719.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9442/18169442/instrument_cluster-1774702633719.jpg saved to cache
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ff628176-102d-5605-91dd-4d57e30101be
2026-03-29 20:18:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9442/18169442/interior_dashboard-1774702633461.jpg> (referer: None)
2026-03-29 20:18:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65845f290>
2026-03-29 20:18:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff628176-102d-5605-91dd-4d57e30101be/ff628176-102d-5605-91dd-4d57e30101be_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9442%252F18169442%252Finterior_dashboard-1774702633461.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9442/18169442/interior_dashboard-1774702633461.jpg saved to cache
2026-03-29 20:18:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ff628176-102d-5605-91dd-4d57e30101be
2026-03-29 20:18:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18780849.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e85a4e6d-068f-5c2b-8007-262937ea160e with identifier: 18780849
2026-03-29 20:18:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e85a4e6d-068f-5c2b-8007-262937ea160e with scrape type 1
2026-03-29 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e85a4e6d-068f-5c2b-8007-262937ea160e
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0849%252F18780849%252Fexterior_front_driver-1774782426023.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0849/18780849/exterior_front_driver-1774782426023.jpg not downloaded yet
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0849%252F18780849%252Fexterior_rear_driver-1774782425363.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0849/18780849/exterior_rear_driver-1774782425363.jpg not downloaded yet
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0849%252F18780849%252Fexterior_front_passenger-1774782424533.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0849/18780849/exterior_front_passenger-1774782424533.jpg not downloaded yet
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0849%252F18780849%252Fexterior_rear_passenger-1774782427889.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0849/18780849/exterior_rear_passenger-1774782427889.jpg not downloaded yet
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0849%252F18780849%252Finterior_front_seats-1774783199223.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0849/18780849/interior_front_seats-1774783199223.jpg not downloaded yet
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0849%252F18780849%252Finterior_rear_seats-1774783194583.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0849/18780849/interior_rear_seats-1774783194583.jpg not downloaded yet
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0849%252F18780849%252Finterior_dashboard-1774783206599.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0849/18780849/interior_dashboard-1774783206599.jpg not downloaded yet
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0849%252F18780849%252Finstrument_cluster-1774784236024.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0849/18780849/instrument_cluster-1774784236024.jpg not downloaded yet
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0849%252F18780849%252Finterior_boot-1774783196964.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0849/18780849/interior_boot-1774783196964.jpg not downloaded yet
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0849%252F18780849%252Fdocs_service_history-1774783615377.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D058e30489f877a59e49392b039b32292%27 HTTP/1.1" 200 None
2026-03-29 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0849/18780849/docs_service_history-1774783615377.jpg?ixlib=js-3.8.0&auto=format&s=058e30489f877a59e49392b039b32292 not downloaded yet
2026-03-29 20:18:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9442/18169442/interior_rear_seats-1774702568438.jpg> (referer: None)
2026-03-29 20:18:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a14850>
2026-03-29 20:18:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff628176-102d-5605-91dd-4d57e30101be/ff628176-102d-5605-91dd-4d57e30101be_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9442%252F18169442%252Finterior_rear_seats-1774702568438.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9442/18169442/interior_rear_seats-1774702568438.jpg saved to cache
2026-03-29 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ff628176-102d-5605-91dd-4d57e30101be
2026-03-29 20:18:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0849/18780849/docs_service_history-1774783615377.jpg?ixlib=js-3.8.0&auto=format&s=058e30489f877a59e49392b039b32292> (referer: None)
2026-03-29 20:18:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9442/18169442/interior_front_seats-1774702664785.jpg> (referer: None)
2026-03-29 20:18:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587016d0>
2026-03-29 20:18:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e85a4e6d-068f-5c2b-8007-262937ea160e/e85a4e6d-068f-5c2b-8007-262937ea160e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0849%252F18780849%252Fdocs_service_history-1774783615377.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D058e30489f877a59e49392b039b32292') HTTP/1.1" 204 0
2026-03-29 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0849/18780849/docs_service_history-1774783615377.jpg?ixlib=js-3.8.0&auto=format&s=058e30489f877a59e49392b039b32292 saved to cache
2026-03-29 20:18:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e85a4e6d-068f-5c2b-8007-262937ea160e
2026-03-29 20:18:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584f2d90>
2026-03-29 20:18:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff628176-102d-5605-91dd-4d57e30101be/ff628176-102d-5605-91dd-4d57e30101be_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9442%252F18169442%252Finterior_front_seats-1774702664785.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9442/18169442/interior_front_seats-1774702664785.jpg saved to cache
2026-03-29 20:18:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff628176-102d-5605-91dd-4d57e30101be
2026-03-29 20:18:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0849/18780849/instrument_cluster-1774784236024.jpg> (referer: None)
2026-03-29 20:18:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0849/18780849/interior_boot-1774783196964.jpg> (referer: None)
2026-03-29 20:18:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cc6e50>
2026-03-29 20:18:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e85a4e6d-068f-5c2b-8007-262937ea160e/e85a4e6d-068f-5c2b-8007-262937ea160e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0849%252F18780849%252Finstrument_cluster-1774784236024.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0849/18780849/instrument_cluster-1774784236024.jpg saved to cache
2026-03-29 20:18:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e85a4e6d-068f-5c2b-8007-262937ea160e
2026-03-29 20:18:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f87a90>
2026-03-29 20:18:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e85a4e6d-068f-5c2b-8007-262937ea160e/e85a4e6d-068f-5c2b-8007-262937ea160e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0849%252F18780849%252Finterior_boot-1774783196964.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0849/18780849/interior_boot-1774783196964.jpg saved to cache
2026-03-29 20:18:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e85a4e6d-068f-5c2b-8007-262937ea160e
2026-03-29 20:18:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0849/18780849/interior_dashboard-1774783206599.jpg> (referer: None)
2026-03-29 20:18:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0849/18780849/interior_rear_seats-1774783194583.jpg> (referer: None)
2026-03-29 20:18:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f84c90>
2026-03-29 20:18:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e85a4e6d-068f-5c2b-8007-262937ea160e/e85a4e6d-068f-5c2b-8007-262937ea160e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0849%252F18780849%252Finterior_dashboard-1774783206599.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0849/18780849/interior_dashboard-1774783206599.jpg saved to cache
2026-03-29 20:18:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e85a4e6d-068f-5c2b-8007-262937ea160e
2026-03-29 20:18:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bd9cc90>
2026-03-29 20:18:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e85a4e6d-068f-5c2b-8007-262937ea160e/e85a4e6d-068f-5c2b-8007-262937ea160e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0849%252F18780849%252Finterior_rear_seats-1774783194583.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0849/18780849/interior_rear_seats-1774783194583.jpg saved to cache
2026-03-29 20:18:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e85a4e6d-068f-5c2b-8007-262937ea160e
2026-03-29 20:18:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0849/18780849/exterior_rear_passenger-1774782427889.jpg> (referer: None)
2026-03-29 20:18:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0849/18780849/interior_front_seats-1774783199223.jpg> (referer: None)
2026-03-29 20:18:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658aeab50>
2026-03-29 20:18:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e85a4e6d-068f-5c2b-8007-262937ea160e/e85a4e6d-068f-5c2b-8007-262937ea160e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0849%252F18780849%252Fexterior_rear_passenger-1774782427889.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0849/18780849/exterior_rear_passenger-1774782427889.jpg saved to cache
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e85a4e6d-068f-5c2b-8007-262937ea160e
2026-03-29 20:18:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658415710>
2026-03-29 20:18:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e85a4e6d-068f-5c2b-8007-262937ea160e/e85a4e6d-068f-5c2b-8007-262937ea160e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0849%252F18780849%252Finterior_front_seats-1774783199223.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0849/18780849/interior_front_seats-1774783199223.jpg saved to cache
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e85a4e6d-068f-5c2b-8007-262937ea160e
2026-03-29 20:18:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0849/18780849/exterior_rear_driver-1774782425363.jpg> (referer: None)
2026-03-29 20:18:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a17cd0>
2026-03-29 20:18:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e85a4e6d-068f-5c2b-8007-262937ea160e/e85a4e6d-068f-5c2b-8007-262937ea160e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0849%252F18780849%252Fexterior_rear_driver-1774782425363.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0849/18780849/exterior_rear_driver-1774782425363.jpg saved to cache
2026-03-29 20:18:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e85a4e6d-068f-5c2b-8007-262937ea160e
2026-03-29 20:18:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0849/18780849/exterior_front_driver-1774782426023.jpg> (referer: None)
2026-03-29 20:18:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bd9d890>
2026-03-29 20:18:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e85a4e6d-068f-5c2b-8007-262937ea160e/e85a4e6d-068f-5c2b-8007-262937ea160e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0849%252F18780849%252Fexterior_front_driver-1774782426023.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0849/18780849/exterior_front_driver-1774782426023.jpg saved to cache
2026-03-29 20:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e85a4e6d-068f-5c2b-8007-262937ea160e
2026-03-29 20:18:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9442/18169442/exterior_rear_passenger-1774701077599.jpg> (referer: None)
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b0c950>
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff628176-102d-5605-91dd-4d57e30101be/ff628176-102d-5605-91dd-4d57e30101be_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9442%252F18169442%252Fexterior_rear_passenger-1774701077599.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9442/18169442/exterior_rear_passenger-1774701077599.jpg saved to cache
2026-03-29 20:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ff628176-102d-5605-91dd-4d57e30101be
2026-03-29 20:18:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9442/18169442/exterior_front_passenger-1774701075527.jpg> (referer: None)
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658abb7d0>
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff628176-102d-5605-91dd-4d57e30101be/ff628176-102d-5605-91dd-4d57e30101be_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9442%252F18169442%252Fexterior_front_passenger-1774701075527.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9442/18169442/exterior_front_passenger-1774701075527.jpg saved to cache
2026-03-29 20:18:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ff628176-102d-5605-91dd-4d57e30101be
2026-03-29 20:18:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9442/18169442/exterior_rear_driver-1774701029517.jpg> (referer: None)
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b0d6d0>
2026-03-29 20:18:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff628176-102d-5605-91dd-4d57e30101be/ff628176-102d-5605-91dd-4d57e30101be_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9442%252F18169442%252Fexterior_rear_driver-1774701029517.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9442/18169442/exterior_rear_driver-1774701029517.jpg saved to cache
2026-03-29 20:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff628176-102d-5605-91dd-4d57e30101be
2026-03-29 20:18:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9442/18169442/exterior_front_driver-1774700989215.jpg> (referer: None)
2026-03-29 20:18:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b827d0>
2026-03-29 20:18:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff628176-102d-5605-91dd-4d57e30101be/ff628176-102d-5605-91dd-4d57e30101be_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9442%252F18169442%252Fexterior_front_driver-1774700989215.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9442/18169442/exterior_front_driver-1774700989215.jpg saved to cache
2026-03-29 20:18:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff628176-102d-5605-91dd-4d57e30101be
2026-03-29 20:18:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff628176-102d-5605-91dd-4d57e30101be, skipping ID generation
2026-03-29 20:18:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff628176-102d-5605-91dd-4d57e30101be with scrape type 1
2026-03-29 20:18:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff628176-102d-5605-91dd-4d57e30101be sending to next pipeline
2026-03-29 20:18:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ff628176-102d-5605-91dd-4d57e30101be, identifier: 18169442
2026-03-29 20:18:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ff628176-102d-5605-91dd-4d57e30101be with identifier: 18169442
2026-03-29 20:18:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ff628176-102d-5605-91dd-4d57e30101be with identifier: 18169442
2026-03-29 20:18:12 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ff628176-102d-5605-91dd-4d57e30101be with identifier: 18169442 to the API
2026-03-29 20:18:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9442/18169442/exterior_front_driver-1774700989215.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'ff628176-102d-5605-91dd-4d57e30101be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'MJ15 DCE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18169442',
'listing': 'auction',
'location': 'Hampshire Liphook',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 71000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff628176-102d-5605-91dd-4d57e30101be/ff628176-102d-5605-91dd-4d57e30101be_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1860386,
'Height': 2687,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9442/18169442/exterior_front_driver-1774700989215.jpg',
'Width': 3583},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff628176-102d-5605-91dd-4d57e30101be/ff628176-102d-5605-91dd-4d57e30101be_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1579709,
'Height': 2435,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9442/18169442/exterior_rear_driver-1774701029517.jpg',
'Width': 3246},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff628176-102d-5605-91dd-4d57e30101be/ff628176-102d-5605-91dd-4d57e30101be_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1553025,
'Height': 2408,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9442/18169442/exterior_front_passenger-1774701075527.jpg',
'Width': 3211},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff628176-102d-5605-91dd-4d57e30101be/ff628176-102d-5605-91dd-4d57e30101be_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2211668,
'Height': 2812,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9442/18169442/exterior_rear_passenger-1774701077599.jpg',
'Width': 3749},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff628176-102d-5605-91dd-4d57e30101be/ff628176-102d-5605-91dd-4d57e30101be_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3708226,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9442/18169442/interior_front_seats-1774702664785.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff628176-102d-5605-91dd-4d57e30101be/ff628176-102d-5605-91dd-4d57e30101be_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3027124,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9442/18169442/interior_rear_seats-1774702568438.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff628176-102d-5605-91dd-4d57e30101be/ff628176-102d-5605-91dd-4d57e30101be_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3988639,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9442/18169442/interior_dashboard-1774702633461.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff628176-102d-5605-91dd-4d57e30101be/ff628176-102d-5605-91dd-4d57e30101be_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2646153,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9442/18169442/instrument_cluster-1774702633719.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff628176-102d-5605-91dd-4d57e30101be/ff628176-102d-5605-91dd-4d57e30101be_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4203401,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9442/18169442/interior_boot-1774702645520.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff628176-102d-5605-91dd-4d57e30101be/ff628176-102d-5605-91dd-4d57e30101be_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1055629,
'Height': 2318,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9442/18169442/docs_service_history-1774706437671.jpg?ixlib=js-3.8.0&auto=format&s=1ecd67f5edabe34e4c64b4514a4dfe49',
'Width': 3447}],
'price': 2597,
'price_includes_vat': False,
'registration_date': '2015-04-30',
'seats_number': None,
'seller_name': None,
'title': 'Ford Fiesta Zetec Turbo',
'transmission': 'manual',
'trim': 'Zetec Turbo',
'vin': 'WF0DXXGAKDFK44946',
'year': 2015}
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718169442%27 HTTP/1.1" 200 None
2026-03-29 20:18:13 [motorway.uk] INFO: Saving data for 18169442: {'created_time': 1774815493.132902, 'last_price_update_time': 1774815493.132916, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18169442') HTTP/1.1" 204 0
2026-03-29 20:18:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0849/18780849/exterior_front_passenger-1774782424533.jpg> (referer: None)
2026-03-29 20:18:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7661/13687661/interior_boot-1774709278080.jpg> (referer: None)
2026-03-29 20:18:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658415550>
2026-03-29 20:18:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e85a4e6d-068f-5c2b-8007-262937ea160e/e85a4e6d-068f-5c2b-8007-262937ea160e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0849%252F18780849%252Fexterior_front_passenger-1774782424533.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0849/18780849/exterior_front_passenger-1774782424533.jpg saved to cache
2026-03-29 20:18:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e85a4e6d-068f-5c2b-8007-262937ea160e
2026-03-29 20:18:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e85a4e6d-068f-5c2b-8007-262937ea160e, skipping ID generation
2026-03-29 20:18:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e85a4e6d-068f-5c2b-8007-262937ea160e with scrape type 1
2026-03-29 20:18:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e85a4e6d-068f-5c2b-8007-262937ea160e sending to next pipeline
2026-03-29 20:18:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e85a4e6d-068f-5c2b-8007-262937ea160e, identifier: 18780849
2026-03-29 20:18:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e85a4e6d-068f-5c2b-8007-262937ea160e with identifier: 18780849
2026-03-29 20:18:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e85a4e6d-068f-5c2b-8007-262937ea160e with identifier: 18780849
2026-03-29 20:18:13 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e85a4e6d-068f-5c2b-8007-262937ea160e with identifier: 18780849 to the API
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0849/18780849/exterior_front_passenger-1774782424533.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'e85a4e6d-068f-5c2b-8007-262937ea160e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'AO24 VDL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18780849',
'listing': 'auction',
'location': 'Surrey Walton-on-Thames',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 7980,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e85a4e6d-068f-5c2b-8007-262937ea160e/e85a4e6d-068f-5c2b-8007-262937ea160e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1806230,
'Height': 2540,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0849/18780849/exterior_front_driver-1774782426023.jpg',
'Width': 3387},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e85a4e6d-068f-5c2b-8007-262937ea160e/e85a4e6d-068f-5c2b-8007-262937ea160e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1705925,
'Height': 2534,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0849/18780849/exterior_rear_driver-1774782425363.jpg',
'Width': 3379},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e85a4e6d-068f-5c2b-8007-262937ea160e/e85a4e6d-068f-5c2b-8007-262937ea160e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2187096,
'Height': 2761,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0849/18780849/exterior_front_passenger-1774782424533.jpg',
'Width': 3681},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e85a4e6d-068f-5c2b-8007-262937ea160e/e85a4e6d-068f-5c2b-8007-262937ea160e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1943213,
'Height': 2753,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0849/18780849/exterior_rear_passenger-1774782427889.jpg',
'Width': 3671},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e85a4e6d-068f-5c2b-8007-262937ea160e/e85a4e6d-068f-5c2b-8007-262937ea160e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2418061,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/0849/18780849/interior_front_seats-1774783199223.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e85a4e6d-068f-5c2b-8007-262937ea160e/e85a4e6d-068f-5c2b-8007-262937ea160e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2402008,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/0849/18780849/interior_rear_seats-1774783194583.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e85a4e6d-068f-5c2b-8007-262937ea160e/e85a4e6d-068f-5c2b-8007-262937ea160e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2025804,
'Height': 2891,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0849/18780849/interior_dashboard-1774783206599.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e85a4e6d-068f-5c2b-8007-262937ea160e/e85a4e6d-068f-5c2b-8007-262937ea160e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 703357,
'Height': 2183,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0849/18780849/instrument_cluster-1774784236024.jpg',
'Width': 2911},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e85a4e6d-068f-5c2b-8007-262937ea160e/e85a4e6d-068f-5c2b-8007-262937ea160e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2101594,
'Height': 2891,
'OriginUrl': 'https://motorway-photos.imgix.net/0849/18780849/interior_boot-1774783196964.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e85a4e6d-068f-5c2b-8007-262937ea160e/e85a4e6d-068f-5c2b-8007-262937ea160e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1247172,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0849/18780849/docs_service_history-1774783615377.jpg?ixlib=js-3.8.0&auto=format&s=058e30489f877a59e49392b039b32292',
'Width': 2891}],
'price': 24010,
'price_includes_vat': False,
'registration_date': '2024-04-05',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Tiguan R-LINE Edition TSI S-A',
'transmission': 'automatic',
'trim': 'R-LINE Edition TSI S-A',
'vin': 'WVGZZZ5N1RW043340',
'year': 2024}
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718780849%27 HTTP/1.1" 200 None
2026-03-29 20:18:13 [motorway.uk] INFO: Saving data for 18780849: {'created_time': 1774815493.931626, 'last_price_update_time': 1774815493.931641, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18780849') HTTP/1.1" 204 0
2026-03-29 20:18:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584f2710>
2026-03-29 20:18:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8140033a-3dac-58b7-9efd-f81a17e42a6d/8140033a-3dac-58b7-9efd-f81a17e42a6d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7661%252F13687661%252Finterior_boot-1774709278080.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7661/13687661/interior_boot-1774709278080.jpg saved to cache
2026-03-29 20:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8140033a-3dac-58b7-9efd-f81a17e42a6d
2026-03-29 20:18:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7661/13687661/instrument_cluster-1774709322770.jpg> (referer: None)
2026-03-29 20:18:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65885cc90>
2026-03-29 20:18:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8140033a-3dac-58b7-9efd-f81a17e42a6d/8140033a-3dac-58b7-9efd-f81a17e42a6d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7661%252F13687661%252Finstrument_cluster-1774709322770.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7661/13687661/instrument_cluster-1774709322770.jpg saved to cache
2026-03-29 20:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8140033a-3dac-58b7-9efd-f81a17e42a6d
2026-03-29 20:18:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7661/13687661/interior_rear_seats-1774709238861.jpg> (referer: None)
2026-03-29 20:18:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7661/13687661/interior_dashboard-1774774827361.jpg> (referer: None)
2026-03-29 20:18:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658378a10>
2026-03-29 20:18:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8140033a-3dac-58b7-9efd-f81a17e42a6d/8140033a-3dac-58b7-9efd-f81a17e42a6d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7661%252F13687661%252Finterior_rear_seats-1774709238861.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7661/13687661/interior_rear_seats-1774709238861.jpg saved to cache
2026-03-29 20:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8140033a-3dac-58b7-9efd-f81a17e42a6d
2026-03-29 20:18:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658702790>
2026-03-29 20:18:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8140033a-3dac-58b7-9efd-f81a17e42a6d/8140033a-3dac-58b7-9efd-f81a17e42a6d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7661%252F13687661%252Finterior_dashboard-1774774827361.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7661/13687661/interior_dashboard-1774774827361.jpg saved to cache
2026-03-29 20:18:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8140033a-3dac-58b7-9efd-f81a17e42a6d
2026-03-29 20:18:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7661/13687661/interior_front_seats-1774709229423.jpg> (referer: None)
2026-03-29 20:18:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584f3890>
2026-03-29 20:18:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8140033a-3dac-58b7-9efd-f81a17e42a6d/8140033a-3dac-58b7-9efd-f81a17e42a6d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7661%252F13687661%252Finterior_front_seats-1774709229423.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7661/13687661/interior_front_seats-1774709229423.jpg saved to cache
2026-03-29 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8140033a-3dac-58b7-9efd-f81a17e42a6d
2026-03-29 20:18:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7661/13687661/exterior_rear_passenger-1774708821441.jpg> (referer: None)
2026-03-29 20:18:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7661/13687661/exterior_front_passenger-1774708831769.jpg> (referer: None)
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f84690>
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8140033a-3dac-58b7-9efd-f81a17e42a6d/8140033a-3dac-58b7-9efd-f81a17e42a6d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7661%252F13687661%252Fexterior_rear_passenger-1774708821441.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7661/13687661/exterior_rear_passenger-1774708821441.jpg saved to cache
2026-03-29 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8140033a-3dac-58b7-9efd-f81a17e42a6d
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658701350>
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8140033a-3dac-58b7-9efd-f81a17e42a6d/8140033a-3dac-58b7-9efd-f81a17e42a6d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7661%252F13687661%252Fexterior_front_passenger-1774708831769.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7661/13687661/exterior_front_passenger-1774708831769.jpg saved to cache
2026-03-29 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8140033a-3dac-58b7-9efd-f81a17e42a6d
2026-03-29 20:18:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7661/13687661/exterior_front_driver-1774708801093.jpg> (referer: None)
2026-03-29 20:18:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7661/13687661/exterior_rear_driver-1774708813534.jpg> (referer: None)
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f84250>
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8140033a-3dac-58b7-9efd-f81a17e42a6d/8140033a-3dac-58b7-9efd-f81a17e42a6d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7661%252F13687661%252Fexterior_front_driver-1774708801093.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7661/13687661/exterior_front_driver-1774708801093.jpg saved to cache
2026-03-29 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8140033a-3dac-58b7-9efd-f81a17e42a6d
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65815ab10>
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8140033a-3dac-58b7-9efd-f81a17e42a6d/8140033a-3dac-58b7-9efd-f81a17e42a6d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7661%252F13687661%252Fexterior_rear_driver-1774708813534.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7661/13687661/exterior_rear_driver-1774708813534.jpg saved to cache
2026-03-29 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8140033a-3dac-58b7-9efd-f81a17e42a6d
2026-03-29 20:18:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8140033a-3dac-58b7-9efd-f81a17e42a6d, skipping ID generation
2026-03-29 20:18:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8140033a-3dac-58b7-9efd-f81a17e42a6d with scrape type 1
2026-03-29 20:18:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8140033a-3dac-58b7-9efd-f81a17e42a6d sending to next pipeline
2026-03-29 20:18:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8140033a-3dac-58b7-9efd-f81a17e42a6d, identifier: 13687661
2026-03-29 20:18:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8140033a-3dac-58b7-9efd-f81a17e42a6d with identifier: 13687661
2026-03-29 20:18:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8140033a-3dac-58b7-9efd-f81a17e42a6d with identifier: 13687661
2026-03-29 20:18:15 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8140033a-3dac-58b7-9efd-f81a17e42a6d with identifier: 13687661 to the API
2026-03-29 20:18:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7661/13687661/exterior_rear_driver-1774708813534.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '8140033a-3dac-58b7-9efd-f81a17e42a6d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RH19 WBA',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/13687661',
'listing': 'auction',
'location': 'West Midlands Dudley',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 24000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8140033a-3dac-58b7-9efd-f81a17e42a6d/8140033a-3dac-58b7-9efd-f81a17e42a6d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 766391,
'Height': 1657,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7661/13687661/exterior_front_driver-1774708801093.jpg',
'Width': 2209},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8140033a-3dac-58b7-9efd-f81a17e42a6d/8140033a-3dac-58b7-9efd-f81a17e42a6d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367031,
'Height': 1376,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7661/13687661/exterior_rear_driver-1774708813534.jpg',
'Width': 1834},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8140033a-3dac-58b7-9efd-f81a17e42a6d/8140033a-3dac-58b7-9efd-f81a17e42a6d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 661333,
'Height': 1610,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7661/13687661/exterior_front_passenger-1774708831769.jpg',
'Width': 2146},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8140033a-3dac-58b7-9efd-f81a17e42a6d/8140033a-3dac-58b7-9efd-f81a17e42a6d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 866892,
'Height': 1839,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7661/13687661/exterior_rear_passenger-1774708821441.jpg',
'Width': 2452},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8140033a-3dac-58b7-9efd-f81a17e42a6d/8140033a-3dac-58b7-9efd-f81a17e42a6d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3893222,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7661/13687661/interior_front_seats-1774709229423.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8140033a-3dac-58b7-9efd-f81a17e42a6d/8140033a-3dac-58b7-9efd-f81a17e42a6d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3677413,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7661/13687661/interior_rear_seats-1774709238861.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8140033a-3dac-58b7-9efd-f81a17e42a6d/8140033a-3dac-58b7-9efd-f81a17e42a6d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2084182,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7661/13687661/interior_dashboard-1774774827361.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8140033a-3dac-58b7-9efd-f81a17e42a6d/8140033a-3dac-58b7-9efd-f81a17e42a6d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2111670,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7661/13687661/instrument_cluster-1774709322770.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8140033a-3dac-58b7-9efd-f81a17e42a6d/8140033a-3dac-58b7-9efd-f81a17e42a6d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5697049,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7661/13687661/interior_boot-1774709278080.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8140033a-3dac-58b7-9efd-f81a17e42a6d/8140033a-3dac-58b7-9efd-f81a17e42a6d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2495714,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7661/13687661/damage_scratches-1774708899825.jpg',
'Width': 4032}],
'price': 8804,
'price_includes_vat': False,
'registration_date': '2020-09-16',
'seats_number': None,
'seller_name': None,
'title': 'Ford Fiesta ST-LINE Edition Turbo',
'transmission': 'manual',
'trim': 'ST-LINE Edition Turbo',
'vin': 'WF0FXXGAHFLR67882',
'year': 2020}
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713687661%27 HTTP/1.1" 200 None
2026-03-29 20:18:17 [motorway.uk] INFO: Saving data for 13687661: {'created_time': 1774815497.208204, 'last_price_update_time': 1774815497.208215, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='13687661') HTTP/1.1" 204 0
2026-03-29 20:18:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20492519.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32 with identifier: 20492519
2026-03-29 20:18:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32 with scrape type 1
2026-03-29 20:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2519%252F20492519%252Fexterior_front_driver-1774716652340.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2519/20492519/exterior_front_driver-1774716652340.jpg not downloaded yet
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2519%252F20492519%252Fexterior_rear_driver-1774716655292.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2519/20492519/exterior_rear_driver-1774716655292.jpg not downloaded yet
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2519%252F20492519%252Fexterior_front_passenger-1774716644137.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2519/20492519/exterior_front_passenger-1774716644137.jpg not downloaded yet
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2519%252F20492519%252Fexterior_rear_passenger-1774716648197.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2519/20492519/exterior_rear_passenger-1774716648197.jpg not downloaded yet
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2519%252F20492519%252Finterior_front_seats-1774717278622.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2519/20492519/interior_front_seats-1774717278622.jpg not downloaded yet
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2519%252F20492519%252Finterior_rear_seats-1774717275942.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2519/20492519/interior_rear_seats-1774717275942.jpg not downloaded yet
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2519%252F20492519%252Finterior_dashboard-1774717298839.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2519/20492519/interior_dashboard-1774717298839.jpg not downloaded yet
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2519%252F20492519%252Finstrument_cluster-1774717315935.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2519/20492519/instrument_cluster-1774717315935.jpg not downloaded yet
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2519%252F20492519%252Finterior_boot-1774717282196.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2519/20492519/interior_boot-1774717282196.jpg not downloaded yet
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2519%252F20492519%252Fdocs_service_history-1774719742585.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddae548383dfea88d5d733518cc5c3c37%27 HTTP/1.1" 200 None
2026-03-29 20:18:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2519/20492519/docs_service_history-1774719742585.jpg?ixlib=js-3.8.0&auto=format&s=dae548383dfea88d5d733518cc5c3c37 not downloaded yet
2026-03-29 20:18:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18947501.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13369d6a-ba59-525f-b51e-097f6891281b with identifier: 18947501
2026-03-29 20:18:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13369d6a-ba59-525f-b51e-097f6891281b with scrape type 1
2026-03-29 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 13369d6a-ba59-525f-b51e-097f6891281b
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7501%252F18947501%252Fexterior_front_driver-1771085381088.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7501/18947501/exterior_front_driver-1771085381088.jpg not downloaded yet
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7501%252F18947501%252Fexterior_rear_driver-1771085402857.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7501/18947501/exterior_rear_driver-1771085402857.jpg not downloaded yet
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7501%252F18947501%252Fexterior_front_passenger-1771085454790.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7501/18947501/exterior_front_passenger-1771085454790.jpg not downloaded yet
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7501%252F18947501%252Fexterior_rear_passenger-1771085424847.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7501/18947501/exterior_rear_passenger-1771085424847.jpg not downloaded yet
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7501%252F18947501%252Finterior_front_seats-1771171638656.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7501/18947501/interior_front_seats-1771171638656.jpg not downloaded yet
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7501%252F18947501%252Finterior_rear_seats-1771171659140.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7501/18947501/interior_rear_seats-1771171659140.jpg not downloaded yet
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7501%252F18947501%252Finterior_dashboard-1771171694580.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7501/18947501/interior_dashboard-1771171694580.jpg not downloaded yet
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7501%252F18947501%252Finstrument_cluster-1771171583769.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7501/18947501/instrument_cluster-1771171583769.jpg not downloaded yet
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7501%252F18947501%252Finterior_boot-1771171702617.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7501/18947501/interior_boot-1771171702617.jpg not downloaded yet
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F7501%252F18947501%252Fdocs_service_history-1771245543736.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3d1818702766761c93f6964397bf2090%27 HTTP/1.1" 200 None
2026-03-29 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/7501/18947501/docs_service_history-1771245543736.jpg?ixlib=js-3.8.0&auto=format&s=3d1818702766761c93f6964397bf2090 not downloaded yet
2026-03-29 20:18:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2519/20492519/docs_service_history-1774719742585.jpg?ixlib=js-3.8.0&auto=format&s=dae548383dfea88d5d733518cc5c3c37> (referer: None)
2026-03-29 20:18:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fee1d0>
2026-03-29 20:18:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32/7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2519%252F20492519%252Fdocs_service_history-1774719742585.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddae548383dfea88d5d733518cc5c3c37') HTTP/1.1" 204 0
2026-03-29 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2519/20492519/docs_service_history-1774719742585.jpg?ixlib=js-3.8.0&auto=format&s=dae548383dfea88d5d733518cc5c3c37 saved to cache
2026-03-29 20:18:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32
2026-03-29 20:18:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/7501/18947501/docs_service_history-1771245543736.jpg?ixlib=js-3.8.0&auto=format&s=3d1818702766761c93f6964397bf2090> (referer: None)
2026-03-29 20:18:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x08'
2026-03-29 20:18:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fed6d0>
2026-03-29 20:18:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13369d6a-ba59-525f-b51e-097f6891281b/13369d6a-ba59-525f-b51e-097f6891281b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F7501%252F18947501%252Fdocs_service_history-1771245543736.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3d1818702766761c93f6964397bf2090') HTTP/1.1" 204 0
2026-03-29 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/7501/18947501/docs_service_history-1771245543736.jpg?ixlib=js-3.8.0&auto=format&s=3d1818702766761c93f6964397bf2090 saved to cache
2026-03-29 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 13369d6a-ba59-525f-b51e-097f6891281b
2026-03-29 20:18:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7501/18947501/interior_boot-1771171702617.jpg> (referer: None)
2026-03-29 20:18:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ff6a50>
2026-03-29 20:18:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13369d6a-ba59-525f-b51e-097f6891281b/13369d6a-ba59-525f-b51e-097f6891281b_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7501%252F18947501%252Finterior_boot-1771171702617.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7501/18947501/interior_boot-1771171702617.jpg saved to cache
2026-03-29 20:18:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 13369d6a-ba59-525f-b51e-097f6891281b
2026-03-29 20:18:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7501/18947501/instrument_cluster-1771171583769.jpg> (referer: None)
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b34f90>
2026-03-29 20:18:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13369d6a-ba59-525f-b51e-097f6891281b/13369d6a-ba59-525f-b51e-097f6891281b_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7501%252F18947501%252Finstrument_cluster-1771171583769.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7501/18947501/instrument_cluster-1771171583769.jpg saved to cache
2026-03-29 20:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 13369d6a-ba59-525f-b51e-097f6891281b
2026-03-29 20:18:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7501/18947501/interior_dashboard-1771171694580.jpg> (referer: None)
2026-03-29 20:18:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658462a90>
2026-03-29 20:18:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13369d6a-ba59-525f-b51e-097f6891281b/13369d6a-ba59-525f-b51e-097f6891281b_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7501%252F18947501%252Finterior_dashboard-1771171694580.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7501/18947501/interior_dashboard-1771171694580.jpg saved to cache
2026-03-29 20:18:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 13369d6a-ba59-525f-b51e-097f6891281b
2026-03-29 20:18:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7501/18947501/interior_rear_seats-1771171659140.jpg> (referer: None)
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b35f90>
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13369d6a-ba59-525f-b51e-097f6891281b/13369d6a-ba59-525f-b51e-097f6891281b_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7501%252F18947501%252Finterior_rear_seats-1771171659140.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7501/18947501/interior_rear_seats-1771171659140.jpg saved to cache
2026-03-29 20:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 13369d6a-ba59-525f-b51e-097f6891281b
2026-03-29 20:18:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7501/18947501/interior_front_seats-1771171638656.jpg> (referer: None)
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658462cd0>
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13369d6a-ba59-525f-b51e-097f6891281b/13369d6a-ba59-525f-b51e-097f6891281b_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7501%252F18947501%252Finterior_front_seats-1771171638656.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7501/18947501/interior_front_seats-1771171638656.jpg saved to cache
2026-03-29 20:18:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 13369d6a-ba59-525f-b51e-097f6891281b
2026-03-29 20:18:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7501/18947501/exterior_rear_passenger-1771085424847.jpg> (referer: None)
2026-03-29 20:18:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b36290>
2026-03-29 20:18:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13369d6a-ba59-525f-b51e-097f6891281b/13369d6a-ba59-525f-b51e-097f6891281b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7501%252F18947501%252Fexterior_rear_passenger-1771085424847.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7501/18947501/exterior_rear_passenger-1771085424847.jpg saved to cache
2026-03-29 20:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 13369d6a-ba59-525f-b51e-097f6891281b
2026-03-29 20:18:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7501/18947501/exterior_front_passenger-1771085454790.jpg> (referer: None)
2026-03-29 20:18:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659dae0d0>
2026-03-29 20:18:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13369d6a-ba59-525f-b51e-097f6891281b/13369d6a-ba59-525f-b51e-097f6891281b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7501%252F18947501%252Fexterior_front_passenger-1771085454790.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7501/18947501/exterior_front_passenger-1771085454790.jpg saved to cache
2026-03-29 20:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 13369d6a-ba59-525f-b51e-097f6891281b
2026-03-29 20:18:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20500662.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7501/18947501/exterior_rear_driver-1771085402857.jpg> (referer: None)
2026-03-29 20:18:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28e7e1b2-51a1-5bee-96a0-570115f216b9 with identifier: 20500662
2026-03-29 20:18:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28e7e1b2-51a1-5bee-96a0-570115f216b9 with scrape type 1
2026-03-29 20:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 28e7e1b2-51a1-5bee-96a0-570115f216b9
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0662%252F20500662%252Fexterior_front_driver-1774778426954.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0662/20500662/exterior_front_driver-1774778426954.jpg not downloaded yet
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0662%252F20500662%252Fexterior_rear_driver-1774778443336.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0662/20500662/exterior_rear_driver-1774778443336.jpg not downloaded yet
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0662%252F20500662%252Fexterior_front_passenger-1774785097421.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0662/20500662/exterior_front_passenger-1774785097421.jpg not downloaded yet
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0662%252F20500662%252Fexterior_rear_passenger-1774785112778.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0662/20500662/exterior_rear_passenger-1774785112778.jpg not downloaded yet
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0662%252F20500662%252Finterior_front_seats-1774785124828.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0662/20500662/interior_front_seats-1774785124828.jpg not downloaded yet
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0662%252F20500662%252Finterior_rear_seats-1774785137593.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0662/20500662/interior_rear_seats-1774785137593.jpg not downloaded yet
2026-03-29 20:18:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cc6a50>
2026-03-29 20:18:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13369d6a-ba59-525f-b51e-097f6891281b/13369d6a-ba59-525f-b51e-097f6891281b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7501%252F18947501%252Fexterior_rear_driver-1771085402857.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7501/18947501/exterior_rear_driver-1771085402857.jpg saved to cache
2026-03-29 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 13369d6a-ba59-525f-b51e-097f6891281b
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0662%252F20500662%252Finterior_dashboard-1774785173448.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0662/20500662/interior_dashboard-1774785173448.jpg not downloaded yet
2026-03-29 20:18:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7501/18947501/exterior_front_driver-1771085381088.jpg> (referer: None)
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0662%252F20500662%252Finterior_boot-1774778808471.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0662/20500662/interior_boot-1774778808471.jpg not downloaded yet
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0662%252F20500662%252Fdamage_dents-1774778503593.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0662/20500662/damage_dents-1774778503593.jpg not downloaded yet
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0662%252F20500662%252Fdamage_missing_trims-1774783978205.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0662/20500662/damage_missing_trims-1774783978205.jpg not downloaded yet
2026-03-29 20:18:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be6abd0>
2026-03-29 20:18:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13369d6a-ba59-525f-b51e-097f6891281b/13369d6a-ba59-525f-b51e-097f6891281b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7501%252F18947501%252Fexterior_front_driver-1771085381088.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7501/18947501/exterior_front_driver-1771085381088.jpg saved to cache
2026-03-29 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13369d6a-ba59-525f-b51e-097f6891281b
2026-03-29 20:18:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13369d6a-ba59-525f-b51e-097f6891281b, skipping ID generation
2026-03-29 20:18:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13369d6a-ba59-525f-b51e-097f6891281b with scrape type 1
2026-03-29 20:18:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13369d6a-ba59-525f-b51e-097f6891281b sending to next pipeline
2026-03-29 20:18:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 13369d6a-ba59-525f-b51e-097f6891281b, identifier: 18947501
2026-03-29 20:18:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2519/20492519/interior_boot-1774717282196.jpg> (referer: None)
2026-03-29 20:18:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 13369d6a-ba59-525f-b51e-097f6891281b with identifier: 18947501
2026-03-29 20:18:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 13369d6a-ba59-525f-b51e-097f6891281b with identifier: 18947501
2026-03-29 20:18:28 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 13369d6a-ba59-525f-b51e-097f6891281b with identifier: 18947501 to the API
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7501/18947501/exterior_front_driver-1771085381088.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '13369d6a-ba59-525f-b51e-097f6891281b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'BU15 UAT',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18947501',
'listing': 'auction',
'location': 'West Midlands Kingswinford',
'make': 'Vauxhall',
'model': 'Zafira',
'odometer': 70389,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 35,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13369d6a-ba59-525f-b51e-097f6891281b/13369d6a-ba59-525f-b51e-097f6891281b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1732210,
'Height': 2545,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7501/18947501/exterior_front_driver-1771085381088.jpg',
'Width': 3393},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13369d6a-ba59-525f-b51e-097f6891281b/13369d6a-ba59-525f-b51e-097f6891281b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1852410,
'Height': 2556,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7501/18947501/exterior_rear_driver-1771085402857.jpg',
'Width': 3408},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13369d6a-ba59-525f-b51e-097f6891281b/13369d6a-ba59-525f-b51e-097f6891281b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2098001,
'Height': 2620,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7501/18947501/exterior_front_passenger-1771085454790.jpg',
'Width': 3493},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13369d6a-ba59-525f-b51e-097f6891281b/13369d6a-ba59-525f-b51e-097f6891281b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1926363,
'Height': 2587,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7501/18947501/exterior_rear_passenger-1771085424847.jpg',
'Width': 3449},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13369d6a-ba59-525f-b51e-097f6891281b/13369d6a-ba59-525f-b51e-097f6891281b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3923891,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7501/18947501/interior_front_seats-1771171638656.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13369d6a-ba59-525f-b51e-097f6891281b/13369d6a-ba59-525f-b51e-097f6891281b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3977147,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7501/18947501/interior_rear_seats-1771171659140.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13369d6a-ba59-525f-b51e-097f6891281b/13369d6a-ba59-525f-b51e-097f6891281b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1677724,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7501/18947501/interior_dashboard-1771171694580.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13369d6a-ba59-525f-b51e-097f6891281b/13369d6a-ba59-525f-b51e-097f6891281b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2349201,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7501/18947501/instrument_cluster-1771171583769.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13369d6a-ba59-525f-b51e-097f6891281b/13369d6a-ba59-525f-b51e-097f6891281b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3197096,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7501/18947501/interior_boot-1771171702617.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13369d6a-ba59-525f-b51e-097f6891281b/13369d6a-ba59-525f-b51e-097f6891281b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1829845,
'Height': 3741,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/7501/18947501/docs_service_history-1771245543736.jpg?ixlib=js-3.8.0&auto=format&s=3d1818702766761c93f6964397bf2090',
'Width': 1258}],
'price': 3489,
'price_includes_vat': False,
'registration_date': '2015-08-15',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Zafira Tourer SRI CDTI',
'transmission': 'manual',
'trim': 'Tourer SRI CDTI',
'vin': 'W0LPD9EM2F1100122',
'year': 2015}
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718947501%27 HTTP/1.1" 200 None
2026-03-29 20:18:28 [motorway.uk] INFO: Saving data for 18947501: {'created_time': 1774815508.946124, 'last_price_update_time': 1774815508.946139, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18947501') HTTP/1.1" 204 0
2026-03-29 20:18:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18975319.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be6ae90>
2026-03-29 20:18:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32/7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2519%252F20492519%252Finterior_boot-1774717282196.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2519/20492519/interior_boot-1774717282196.jpg saved to cache
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32
2026-03-29 20:18:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec943335-e1ab-52d9-891e-1e096028e790 with identifier: 18975319
2026-03-29 20:18:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec943335-e1ab-52d9-891e-1e096028e790 with scrape type 1
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ec943335-e1ab-52d9-891e-1e096028e790
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5319%252F18975319%252F18975319-exterior_front_driver-modified-1766841250609.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5319/18975319/18975319-exterior_front_driver-modified-1766841250609.jpeg not downloaded yet
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5319%252F18975319%252Fexterior_rear_driver-1766666576899.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5319/18975319/exterior_rear_driver-1766666576899.jpeg not downloaded yet
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5319%252F18975319%252Fexterior_front_passenger-1766666561612.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5319/18975319/exterior_front_passenger-1766666561612.jpeg not downloaded yet
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5319%252F18975319%252Fexterior_rear_passenger-1766666577178.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5319/18975319/exterior_rear_passenger-1766666577178.jpeg not downloaded yet
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5319%252F18975319%252Finterior_front_seats-1766666592168.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5319/18975319/interior_front_seats-1766666592168.jpeg not downloaded yet
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5319%252F18975319%252Finterior_rear_seats-1766665984684.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5319/18975319/interior_rear_seats-1766665984684.jpeg not downloaded yet
2026-03-29 20:18:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0662/20500662/damage_missing_trims-1774783978205.jpg> (referer: None)
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5319%252F18975319%252F18975319-interior_dashboard-modified-1766841237038.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5319/18975319/18975319-interior_dashboard-modified-1766841237038.jpeg not downloaded yet
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5319%252F18975319%252Finstrument_cluster-1766666901145.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5319/18975319/instrument_cluster-1766666901145.jpeg not downloaded yet
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5319%252F18975319%252Finterior_boot-1766666605701.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5319/18975319/interior_boot-1766666605701.jpeg not downloaded yet
2026-03-29 20:18:29 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (12142745) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/5319/18975319/interior_rear_seats-1766665984684.jpeg>.
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F5319%252F18975319%252F18975319-docs_service_history-modified-1766841535465.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6253a8760a9620632acd8ec46f4a4a68%27 HTTP/1.1" 200 None
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/5319/18975319/18975319-docs_service_history-modified-1766841535465.jpeg?ixlib=js-3.8.0&auto=format&s=6253a8760a9620632acd8ec46f4a4a68 not downloaded yet
2026-03-29 20:18:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0662/20500662/interior_dashboard-1774785173448.jpg> (referer: None)
2026-03-29 20:18:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65befdbd0>
2026-03-29 20:18:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28e7e1b2-51a1-5bee-96a0-570115f216b9/28e7e1b2-51a1-5bee-96a0-570115f216b9_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0662%252F20500662%252Fdamage_missing_trims-1774783978205.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0662/20500662/damage_missing_trims-1774783978205.jpg saved to cache
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 28e7e1b2-51a1-5bee-96a0-570115f216b9
2026-03-29 20:18:29 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (13355884) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/5319/18975319/interior_boot-1766666605701.jpeg>.
2026-03-29 20:18:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582d9b50>
2026-03-29 20:18:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28e7e1b2-51a1-5bee-96a0-570115f216b9/28e7e1b2-51a1-5bee-96a0-570115f216b9_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0662%252F20500662%252Finterior_dashboard-1774785173448.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0662/20500662/interior_dashboard-1774785173448.jpg saved to cache
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 28e7e1b2-51a1-5bee-96a0-570115f216b9
2026-03-29 20:18:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0662/20500662/damage_dents-1774778503593.jpg> (referer: None)
2026-03-29 20:18:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20482913.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf2fd10>
2026-03-29 20:18:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28e7e1b2-51a1-5bee-96a0-570115f216b9/28e7e1b2-51a1-5bee-96a0-570115f216b9_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0662%252F20500662%252Fdamage_dents-1774778503593.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0662/20500662/damage_dents-1774778503593.jpg saved to cache
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 28e7e1b2-51a1-5bee-96a0-570115f216b9
2026-03-29 20:18:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17eaf36e-8d20-5ec5-9698-9d9c9287651e with identifier: 20482913
2026-03-29 20:18:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17eaf36e-8d20-5ec5-9698-9d9c9287651e with scrape type 1
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 17eaf36e-8d20-5ec5-9698-9d9c9287651e
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2913%252F20482913%252Fexterior_front_driver-1774703246456.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2913/20482913/exterior_front_driver-1774703246456.jpg not downloaded yet
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2913%252F20482913%252Fexterior_rear_driver-1774703268495.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2913/20482913/exterior_rear_driver-1774703268495.jpg not downloaded yet
2026-03-29 20:18:29 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/5319/18975319/interior_rear_seats-1766665984684.jpeg>.
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2913%252F20482913%252Fexterior_front_passenger-1774703298876.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2913/20482913/exterior_front_passenger-1774703298876.jpg not downloaded yet
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2913%252F20482913%252Fexterior_rear_passenger-1774703292235.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2913/20482913/exterior_rear_passenger-1774703292235.jpg not downloaded yet
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2913%252F20482913%252Finterior_front_seats-1774703892147.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2913/20482913/interior_front_seats-1774703892147.jpg not downloaded yet
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2913%252F20482913%252Finterior_rear_seats-1774703897473.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2913/20482913/interior_rear_seats-1774703897473.jpg not downloaded yet
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2913%252F20482913%252Finterior_dashboard-1774703930174.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2913/20482913/interior_dashboard-1774703930174.jpg not downloaded yet
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2913%252F20482913%252F20482913-instrument_cluster-modified-1774775127625.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2913/20482913/20482913-instrument_cluster-modified-1774775127625.jpeg not downloaded yet
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2913%252F20482913%252Finterior_boot-1774703940922.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2913/20482913/interior_boot-1774703940922.jpg not downloaded yet
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2913%252F20482913%252F20482913-damage_missing_trims-modified-1774775188932.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2913/20482913/20482913-damage_missing_trims-modified-1774775188932.jpeg not downloaded yet
2026-03-29 20:18:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/5319/18975319/18975319-docs_service_history-modified-1766841535465.jpeg?ixlib=js-3.8.0&auto=format&s=6253a8760a9620632acd8ec46f4a4a68> (referer: None)
2026-03-29 20:18:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5319/18975319/interior_rear_seats-1766665984684.jpeg> (referer: None)
2026-03-29 20:18:30 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/5319/18975319/interior_boot-1766666605701.jpeg>.
2026-03-29 20:18:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5319/18975319/interior_boot-1766666605701.jpeg> (referer: None)
2026-03-29 20:18:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599ff750>
2026-03-29 20:18:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec943335-e1ab-52d9-891e-1e096028e790/ec943335-e1ab-52d9-891e-1e096028e790_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F5319%252F18975319%252F18975319-docs_service_history-modified-1766841535465.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D6253a8760a9620632acd8ec46f4a4a68') HTTP/1.1" 204 0
2026-03-29 20:18:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/5319/18975319/18975319-docs_service_history-modified-1766841535465.jpeg?ixlib=js-3.8.0&auto=format&s=6253a8760a9620632acd8ec46f4a4a68 saved to cache
2026-03-29 20:18:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ec943335-e1ab-52d9-891e-1e096028e790
2026-03-29 20:18:30 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:18:30 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:18:30 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xb2l\x1d\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x06\xdc|\x00\xb2b1\x00\x00\x00\x00'
2026-03-29 20:18:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65815b6d0>
2026-03-29 20:18:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec943335-e1ab-52d9-891e-1e096028e790/ec943335-e1ab-52d9-891e-1e096028e790_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5319%252F18975319%252Finterior_rear_seats-1766665984684.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5319/18975319/interior_rear_seats-1766665984684.jpeg saved to cache
2026-03-29 20:18:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ec943335-e1ab-52d9-891e-1e096028e790
2026-03-29 20:18:30 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:18:30 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:18:30 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xc3\xf4\xd5\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x07\xd6\x97\x00\xc3\xea\xe9\x00\x00\x00\x00'
2026-03-29 20:18:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658379b50>
2026-03-29 20:18:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec943335-e1ab-52d9-891e-1e096028e790/ec943335-e1ab-52d9-891e-1e096028e790_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5319%252F18975319%252Finterior_boot-1766666605701.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5319/18975319/interior_boot-1766666605701.jpeg saved to cache
2026-03-29 20:18:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ec943335-e1ab-52d9-891e-1e096028e790
2026-03-29 20:18:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1260&page=35&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:30 [motorway.uk] INFO: Found listing with ID: 20375931
2026-03-29 20:18:30 [motorway.uk] INFO: Found listing with ID: 20325750
2026-03-29 20:18:30 [motorway.uk] INFO: Found listing with ID: 16691958
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716691958%27 HTTP/1.1" 200 None
2026-03-29 20:18:30 [motorway.uk] INFO: Scrape type for 16691958: 1
2026-03-29 20:18:30 [motorway.uk] INFO: Found listing with ID: 20470450
2026-03-29 20:18:30 [motorway.uk] INFO: Found listing with ID: 20395403
2026-03-29 20:18:30 [motorway.uk] INFO: Found listing with ID: 20474722
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720474722%27 HTTP/1.1" 200 None
2026-03-29 20:18:30 [motorway.uk] INFO: Scrape type for 20474722: 1
2026-03-29 20:18:30 [motorway.uk] INFO: Found listing with ID: 20492344
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720492344%27 HTTP/1.1" 200 None
2026-03-29 20:18:30 [motorway.uk] INFO: Scrape type for 20492344: 1
2026-03-29 20:18:30 [motorway.uk] INFO: Found listing with ID: 20114932
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720114932%27 HTTP/1.1" 200 None
2026-03-29 20:18:31 [motorway.uk] INFO: Scrape type for 20114932: 1
2026-03-29 20:18:31 [motorway.uk] INFO: Found listing with ID: 20501015
2026-03-29 20:18:31 [motorway.uk] INFO: Found listing with ID: 20491170
2026-03-29 20:18:31 [motorway.uk] INFO: Found listing with ID: 20436771
2026-03-29 20:18:31 [motorway.uk] INFO: Found listing with ID: 19695598
2026-03-29 20:18:31 [motorway.uk] INFO: Found listing with ID: 16059595
2026-03-29 20:18:31 [motorway.uk] INFO: Found listing with ID: 13977118
2026-03-29 20:18:31 [motorway.uk] INFO: Found listing with ID: 20488360
2026-03-29 20:18:31 [motorway.uk] INFO: Found listing with ID: 19261388
2026-03-29 20:18:31 [motorway.uk] INFO: Found listing with ID: 20480811
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720480811%27 HTTP/1.1" 200 None
2026-03-29 20:18:31 [motorway.uk] INFO: Scrape type for 20480811: 1
2026-03-29 20:18:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2913/20482913/20482913-damage_missing_trims-modified-1774775188932.jpeg> (referer: None)
2026-03-29 20:18:31 [motorway.uk] INFO: Found listing with ID: 20315252
2026-03-29 20:18:31 [motorway.uk] INFO: Found listing with ID: 20021276
2026-03-29 20:18:31 [motorway.uk] INFO: Found listing with ID: 19370870
2026-03-29 20:18:31 [motorway.uk] INFO: Found listing with ID: 20363809
2026-03-29 20:18:31 [motorway.uk] INFO: Found listing with ID: 19748283
2026-03-29 20:18:31 [motorway.uk] INFO: Found listing with ID: 20492678
2026-03-29 20:18:31 [motorway.uk] INFO: Found listing with ID: 20327541
2026-03-29 20:18:31 [motorway.uk] INFO: Found listing with ID: 17627913
2026-03-29 20:18:31 [motorway.uk] INFO: Found listing with ID: 20405306
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720405306%27 HTTP/1.1" 200 None
2026-03-29 20:18:31 [motorway.uk] INFO: Scrape type for 20405306: 1
2026-03-29 20:18:31 [motorway.uk] INFO: Found listing with ID: 20485412
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720485412%27 HTTP/1.1" 200 None
2026-03-29 20:18:31 [motorway.uk] INFO: Scrape type for 20485412: 1
2026-03-29 20:18:31 [motorway.uk] INFO: Found listing with ID: 14166490
2026-03-29 20:18:31 [motorway.uk] INFO: Found listing with ID: 20405002
2026-03-29 20:18:31 [motorway.uk] INFO: Found listing with ID: 17362621
2026-03-29 20:18:31 [motorway.uk] INFO: Found listing with ID: 19486204
2026-03-29 20:18:31 [motorway.uk] INFO: Found listing with ID: 18339762
2026-03-29 20:18:31 [motorway.uk] INFO: Found listing with ID: 20441350
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720441350%27 HTTP/1.1" 200 None
2026-03-29 20:18:31 [motorway.uk] INFO: Scrape type for 20441350: 1
2026-03-29 20:18:31 [motorway.uk] INFO: Found listing with ID: 11446328
2026-03-29 20:18:31 [motorway.uk] INFO: Found listing with ID: 19699748
2026-03-29 20:18:31 [motorway.uk] INFO: Found listing with ID: 20357195
2026-03-29 20:18:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5319/18975319/instrument_cluster-1766666901145.jpeg> (referer: None)
2026-03-29 20:18:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2913/20482913/20482913-instrument_cluster-modified-1774775127625.jpeg> (referer: None)
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587c8a50>
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17eaf36e-8d20-5ec5-9698-9d9c9287651e/17eaf36e-8d20-5ec5-9698-9d9c9287651e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2913%252F20482913%252F20482913-damage_missing_trims-modified-1774775188932.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2913/20482913/20482913-damage_missing_trims-modified-1774775188932.jpeg saved to cache
2026-03-29 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 17eaf36e-8d20-5ec5-9698-9d9c9287651e
2026-03-29 20:18:31 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:18:31 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:18:31 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00~\xb8\x8f\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x05\x01\x83\x00~\xae\xa3\x00\x00\x00\x00'
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b12d50>
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec943335-e1ab-52d9-891e-1e096028e790/ec943335-e1ab-52d9-891e-1e096028e790_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5319%252F18975319%252Finstrument_cluster-1766666901145.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5319/18975319/instrument_cluster-1766666901145.jpeg saved to cache
2026-03-29 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ec943335-e1ab-52d9-891e-1e096028e790
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a1d410>
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17eaf36e-8d20-5ec5-9698-9d9c9287651e/17eaf36e-8d20-5ec5-9698-9d9c9287651e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2913%252F20482913%252F20482913-instrument_cluster-modified-1774775127625.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2913/20482913/20482913-instrument_cluster-modified-1774775127625.jpeg saved to cache
2026-03-29 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 17eaf36e-8d20-5ec5-9698-9d9c9287651e
2026-03-29 20:18:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2913/20482913/interior_boot-1774703940922.jpg> (referer: None)
2026-03-29 20:18:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2913/20482913/interior_dashboard-1774703930174.jpg> (referer: None)
2026-03-29 20:18:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658432090>
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17eaf36e-8d20-5ec5-9698-9d9c9287651e/17eaf36e-8d20-5ec5-9698-9d9c9287651e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2913%252F20482913%252Finterior_boot-1774703940922.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2913/20482913/interior_boot-1774703940922.jpg saved to cache
2026-03-29 20:18:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 17eaf36e-8d20-5ec5-9698-9d9c9287651e
2026-03-29 20:18:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584146d0>
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17eaf36e-8d20-5ec5-9698-9d9c9287651e/17eaf36e-8d20-5ec5-9698-9d9c9287651e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:18:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2913%252F20482913%252Finterior_dashboard-1774703930174.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2913/20482913/interior_dashboard-1774703930174.jpg saved to cache
2026-03-29 20:18:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 17eaf36e-8d20-5ec5-9698-9d9c9287651e
2026-03-29 20:18:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/11436867.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10717d18-f73a-5744-9de4-ddb3dd6c99d9 with identifier: 11436867
2026-03-29 20:18:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10717d18-f73a-5744-9de4-ddb3dd6c99d9 with scrape type 1
2026-03-29 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 10717d18-f73a-5744-9de4-ddb3dd6c99d9
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6867%252F11436867%252Fexterior_front_driver-1774507370922.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6867/11436867/exterior_front_driver-1774507370922.jpg not downloaded yet
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6867%252F11436867%252Fexterior_rear_driver-1774507767799.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6867/11436867/exterior_rear_driver-1774507767799.jpg not downloaded yet
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6867%252F11436867%252Fexterior_front_passenger-1774507391773.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6867/11436867/exterior_front_passenger-1774507391773.jpg not downloaded yet
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6867%252F11436867%252Fexterior_rear_passenger-1774507753807.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6867/11436867/exterior_rear_passenger-1774507753807.jpg not downloaded yet
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6867%252F11436867%252Finterior_front_seats-1774508167662.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6867/11436867/interior_front_seats-1774508167662.jpg not downloaded yet
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6867%252F11436867%252Finterior_rear_seats-1774508165307.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6867/11436867/interior_rear_seats-1774508165307.jpg not downloaded yet
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6867%252F11436867%252Finterior_dashboard-1774508236389.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6867/11436867/interior_dashboard-1774508236389.jpg not downloaded yet
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6867%252F11436867%252Finstrument_cluster-1774508154408.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6867/11436867/instrument_cluster-1774508154408.jpg not downloaded yet
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6867%252F11436867%252Finterior_boot-1774508169547.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6867/11436867/interior_boot-1774508169547.jpg not downloaded yet
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6867%252F11436867%252Fdocs_service_history-1774704689892.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D47ef3155d37a19358a3b4b997da5f9aa%27 HTTP/1.1" 200 None
2026-03-29 20:18:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6867/11436867/docs_service_history-1774704689892.jpg?ixlib=js-3.8.0&auto=format&s=47ef3155d37a19358a3b4b997da5f9aa not downloaded yet
2026-03-29 20:18:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20279875.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0f24da5-e093-5528-8392-708bc2204a9e with identifier: 20279875
2026-03-29 20:18:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0f24da5-e093-5528-8392-708bc2204a9e with scrape type 1
2026-03-29 20:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d0f24da5-e093-5528-8392-708bc2204a9e
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9875%252F20279875%252Fexterior_front_driver-1774701508366.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9875/20279875/exterior_front_driver-1774701508366.jpg not downloaded yet
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9875%252F20279875%252Fexterior_rear_driver-1774701491443.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9875/20279875/exterior_rear_driver-1774701491443.jpg not downloaded yet
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9875%252F20279875%252Fexterior_front_passenger-1774701522750.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9875/20279875/exterior_front_passenger-1774701522750.jpg not downloaded yet
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9875%252F20279875%252Fexterior_rear_passenger-1774701517905.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9875/20279875/exterior_rear_passenger-1774701517905.jpg not downloaded yet
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9875%252F20279875%252Finterior_front_seats-1774702490114.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9875/20279875/interior_front_seats-1774702490114.jpg not downloaded yet
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9875%252F20279875%252Finterior_rear_seats-1774702394459.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9875/20279875/interior_rear_seats-1774702394459.jpg not downloaded yet
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9875%252F20279875%252Finterior_dashboard-1774710566315.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9875/20279875/interior_dashboard-1774710566315.jpg not downloaded yet
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9875%252F20279875%252Finstrument_cluster-1774710547613.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9875/20279875/instrument_cluster-1774710547613.jpg not downloaded yet
2026-03-29 20:18:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6867/11436867/docs_service_history-1774704689892.jpg?ixlib=js-3.8.0&auto=format&s=47ef3155d37a19358a3b4b997da5f9aa> (referer: None)
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9875%252F20279875%252Finterior_boot-1774702387624.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9875/20279875/interior_boot-1774702387624.jpg not downloaded yet
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9875%252F20279875%252Fdocs_service_history-1774710714993.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D90d4b640ce009c677c030417497a2014%27 HTTP/1.1" 200 None
2026-03-29 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9875/20279875/docs_service_history-1774710714993.jpg?ixlib=js-3.8.0&auto=format&s=90d4b640ce009c677c030417497a2014 not downloaded yet
2026-03-29 20:18:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658702a90>
2026-03-29 20:18:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10717d18-f73a-5744-9de4-ddb3dd6c99d9/10717d18-f73a-5744-9de4-ddb3dd6c99d9_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6867%252F11436867%252Fdocs_service_history-1774704689892.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D47ef3155d37a19358a3b4b997da5f9aa') HTTP/1.1" 204 0
2026-03-29 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6867/11436867/docs_service_history-1774704689892.jpg?ixlib=js-3.8.0&auto=format&s=47ef3155d37a19358a3b4b997da5f9aa saved to cache
2026-03-29 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 10717d18-f73a-5744-9de4-ddb3dd6c99d9
2026-03-29 20:18:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9875/20279875/instrument_cluster-1774710547613.jpg> (referer: None)
2026-03-29 20:18:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a69350>
2026-03-29 20:18:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0f24da5-e093-5528-8392-708bc2204a9e/d0f24da5-e093-5528-8392-708bc2204a9e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9875%252F20279875%252Finstrument_cluster-1774710547613.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9875/20279875/instrument_cluster-1774710547613.jpg saved to cache
2026-03-29 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d0f24da5-e093-5528-8392-708bc2204a9e
2026-03-29 20:18:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/9875/20279875/docs_service_history-1774710714993.jpg?ixlib=js-3.8.0&auto=format&s=90d4b640ce009c677c030417497a2014> (referer: None)
2026-03-29 20:18:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6585361d0>
2026-03-29 20:18:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0f24da5-e093-5528-8392-708bc2204a9e/d0f24da5-e093-5528-8392-708bc2204a9e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9875%252F20279875%252Fdocs_service_history-1774710714993.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D90d4b640ce009c677c030417497a2014') HTTP/1.1" 204 0
2026-03-29 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9875/20279875/docs_service_history-1774710714993.jpg?ixlib=js-3.8.0&auto=format&s=90d4b640ce009c677c030417497a2014 saved to cache
2026-03-29 20:18:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d0f24da5-e093-5528-8392-708bc2204a9e
2026-03-29 20:18:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9875/20279875/interior_boot-1774702387624.jpg> (referer: None)
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599fc150>
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0f24da5-e093-5528-8392-708bc2204a9e/d0f24da5-e093-5528-8392-708bc2204a9e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9875%252F20279875%252Finterior_boot-1774702387624.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9875/20279875/interior_boot-1774702387624.jpg saved to cache
2026-03-29 20:18:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d0f24da5-e093-5528-8392-708bc2204a9e
2026-03-29 20:18:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9875/20279875/interior_dashboard-1774710566315.jpg> (referer: None)
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586dab50>
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0f24da5-e093-5528-8392-708bc2204a9e/d0f24da5-e093-5528-8392-708bc2204a9e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9875%252F20279875%252Finterior_dashboard-1774710566315.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9875/20279875/interior_dashboard-1774710566315.jpg saved to cache
2026-03-29 20:18:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d0f24da5-e093-5528-8392-708bc2204a9e
2026-03-29 20:18:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9875/20279875/interior_rear_seats-1774702394459.jpg> (referer: None)
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658535450>
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0f24da5-e093-5528-8392-708bc2204a9e/d0f24da5-e093-5528-8392-708bc2204a9e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9875%252F20279875%252Finterior_rear_seats-1774702394459.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9875/20279875/interior_rear_seats-1774702394459.jpg saved to cache
2026-03-29 20:18:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d0f24da5-e093-5528-8392-708bc2204a9e
2026-03-29 20:18:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9875/20279875/interior_front_seats-1774702490114.jpg> (referer: None)
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a69190>
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0f24da5-e093-5528-8392-708bc2204a9e/d0f24da5-e093-5528-8392-708bc2204a9e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9875%252F20279875%252Finterior_front_seats-1774702490114.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9875/20279875/interior_front_seats-1774702490114.jpg saved to cache
2026-03-29 20:18:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d0f24da5-e093-5528-8392-708bc2204a9e
2026-03-29 20:18:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9875/20279875/exterior_rear_passenger-1774701517905.jpg> (referer: None)
2026-03-29 20:18:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658432450>
2026-03-29 20:18:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0f24da5-e093-5528-8392-708bc2204a9e/d0f24da5-e093-5528-8392-708bc2204a9e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9875%252F20279875%252Fexterior_rear_passenger-1774701517905.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9875/20279875/exterior_rear_passenger-1774701517905.jpg saved to cache
2026-03-29 20:18:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d0f24da5-e093-5528-8392-708bc2204a9e
2026-03-29 20:18:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9875/20279875/exterior_front_passenger-1774701522750.jpg> (referer: None)
2026-03-29 20:18:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586dbb50>
2026-03-29 20:18:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0f24da5-e093-5528-8392-708bc2204a9e/d0f24da5-e093-5528-8392-708bc2204a9e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9875%252F20279875%252Fexterior_front_passenger-1774701522750.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9875/20279875/exterior_front_passenger-1774701522750.jpg saved to cache
2026-03-29 20:18:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d0f24da5-e093-5528-8392-708bc2204a9e
2026-03-29 20:18:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9875/20279875/exterior_rear_driver-1774701491443.jpg> (referer: None)
2026-03-29 20:18:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c97190>
2026-03-29 20:18:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0f24da5-e093-5528-8392-708bc2204a9e/d0f24da5-e093-5528-8392-708bc2204a9e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9875%252F20279875%252Fexterior_rear_driver-1774701491443.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9875/20279875/exterior_rear_driver-1774701491443.jpg saved to cache
2026-03-29 20:18:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d0f24da5-e093-5528-8392-708bc2204a9e
2026-03-29 20:18:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9875/20279875/exterior_front_driver-1774701508366.jpg> (referer: None)
2026-03-29 20:18:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658579510>
2026-03-29 20:18:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0f24da5-e093-5528-8392-708bc2204a9e/d0f24da5-e093-5528-8392-708bc2204a9e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9875%252F20279875%252Fexterior_front_driver-1774701508366.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9875/20279875/exterior_front_driver-1774701508366.jpg saved to cache
2026-03-29 20:18:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d0f24da5-e093-5528-8392-708bc2204a9e
2026-03-29 20:18:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d0f24da5-e093-5528-8392-708bc2204a9e, skipping ID generation
2026-03-29 20:18:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0f24da5-e093-5528-8392-708bc2204a9e with scrape type 1
2026-03-29 20:18:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d0f24da5-e093-5528-8392-708bc2204a9e sending to next pipeline
2026-03-29 20:18:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d0f24da5-e093-5528-8392-708bc2204a9e, identifier: 20279875
2026-03-29 20:18:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d0f24da5-e093-5528-8392-708bc2204a9e with identifier: 20279875
2026-03-29 20:18:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d0f24da5-e093-5528-8392-708bc2204a9e with identifier: 20279875
2026-03-29 20:18:42 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d0f24da5-e093-5528-8392-708bc2204a9e with identifier: 20279875 to the API
2026-03-29 20:18:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9875/20279875/exterior_front_driver-1774701508366.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'd0f24da5-e093-5528-8392-708bc2204a9e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'WO66 FFG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20279875',
'listing': 'auction',
'location': 'Greater Manchester Oldham',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 20762,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0f24da5-e093-5528-8392-708bc2204a9e/d0f24da5-e093-5528-8392-708bc2204a9e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 902492,
'Height': 2178,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9875/20279875/exterior_front_driver-1774701508366.jpg',
'Width': 2904},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0f24da5-e093-5528-8392-708bc2204a9e/d0f24da5-e093-5528-8392-708bc2204a9e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 850565,
'Height': 2045,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9875/20279875/exterior_rear_driver-1774701491443.jpg',
'Width': 2726},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0f24da5-e093-5528-8392-708bc2204a9e/d0f24da5-e093-5528-8392-708bc2204a9e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 656280,
'Height': 2008,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9875/20279875/exterior_front_passenger-1774701522750.jpg',
'Width': 2677},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0f24da5-e093-5528-8392-708bc2204a9e/d0f24da5-e093-5528-8392-708bc2204a9e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 911070,
'Height': 2201,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9875/20279875/exterior_rear_passenger-1774701517905.jpg',
'Width': 2935},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0f24da5-e093-5528-8392-708bc2204a9e/d0f24da5-e093-5528-8392-708bc2204a9e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1701038,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9875/20279875/interior_front_seats-1774702490114.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0f24da5-e093-5528-8392-708bc2204a9e/d0f24da5-e093-5528-8392-708bc2204a9e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1390328,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9875/20279875/interior_rear_seats-1774702394459.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0f24da5-e093-5528-8392-708bc2204a9e/d0f24da5-e093-5528-8392-708bc2204a9e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 585857,
'Height': 1677,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9875/20279875/interior_dashboard-1774710566315.jpg',
'Width': 2236},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0f24da5-e093-5528-8392-708bc2204a9e/d0f24da5-e093-5528-8392-708bc2204a9e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279804,
'Height': 1076,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9875/20279875/instrument_cluster-1774710547613.jpg',
'Width': 1434},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0f24da5-e093-5528-8392-708bc2204a9e/d0f24da5-e093-5528-8392-708bc2204a9e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1614333,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9875/20279875/interior_boot-1774702387624.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0f24da5-e093-5528-8392-708bc2204a9e/d0f24da5-e093-5528-8392-708bc2204a9e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1696606,
'Height': 2611,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/9875/20279875/docs_service_history-1774710714993.jpg?ixlib=js-3.8.0&auto=format&s=90d4b640ce009c677c030417497a2014',
'Width': 3482}],
'price': 6787,
'price_includes_vat': False,
'registration_date': '2016-12-30',
'seats_number': None,
'seller_name': None,
'title': 'Jeep Renegade Longitude',
'transmission': 'manual',
'trim': 'Longitude',
'vin': '1C4BU0000HPE95877',
'year': 2016}
2026-03-29 20:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720279875%27 HTTP/1.1" 200 None
2026-03-29 20:18:42 [motorway.uk] INFO: Saving data for 20279875: {'created_time': 1774815522.696392, 'last_price_update_time': 1774815522.696404, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20279875') HTTP/1.1" 204 0
2026-03-29 20:18:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6867/11436867/interior_boot-1774508169547.jpg> (referer: None)
2026-03-29 20:18:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65857b250>
2026-03-29 20:18:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10717d18-f73a-5744-9de4-ddb3dd6c99d9/10717d18-f73a-5744-9de4-ddb3dd6c99d9_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6867%252F11436867%252Finterior_boot-1774508169547.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6867/11436867/interior_boot-1774508169547.jpg saved to cache
2026-03-29 20:18:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 10717d18-f73a-5744-9de4-ddb3dd6c99d9
2026-03-29 20:18:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6867/11436867/instrument_cluster-1774508154408.jpg> (referer: None)
2026-03-29 20:18:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f10210>
2026-03-29 20:18:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10717d18-f73a-5744-9de4-ddb3dd6c99d9/10717d18-f73a-5744-9de4-ddb3dd6c99d9_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6867%252F11436867%252Finstrument_cluster-1774508154408.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6867/11436867/instrument_cluster-1774508154408.jpg saved to cache
2026-03-29 20:18:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 10717d18-f73a-5744-9de4-ddb3dd6c99d9
2026-03-29 20:18:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6867/11436867/interior_dashboard-1774508236389.jpg> (referer: None)
2026-03-29 20:18:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ff4c90>
2026-03-29 20:18:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10717d18-f73a-5744-9de4-ddb3dd6c99d9/10717d18-f73a-5744-9de4-ddb3dd6c99d9_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6867%252F11436867%252Finterior_dashboard-1774508236389.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6867/11436867/interior_dashboard-1774508236389.jpg saved to cache
2026-03-29 20:18:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 10717d18-f73a-5744-9de4-ddb3dd6c99d9
2026-03-29 20:18:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6867/11436867/interior_rear_seats-1774508165307.jpg> (referer: None)
2026-03-29 20:18:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6867/11436867/interior_front_seats-1774508167662.jpg> (referer: None)
2026-03-29 20:18:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6585343d0>
2026-03-29 20:18:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10717d18-f73a-5744-9de4-ddb3dd6c99d9/10717d18-f73a-5744-9de4-ddb3dd6c99d9_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6867%252F11436867%252Finterior_rear_seats-1774508165307.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6867/11436867/interior_rear_seats-1774508165307.jpg saved to cache
2026-03-29 20:18:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 10717d18-f73a-5744-9de4-ddb3dd6c99d9
2026-03-29 20:18:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599fca50>
2026-03-29 20:18:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10717d18-f73a-5744-9de4-ddb3dd6c99d9/10717d18-f73a-5744-9de4-ddb3dd6c99d9_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6867%252F11436867%252Finterior_front_seats-1774508167662.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6867/11436867/interior_front_seats-1774508167662.jpg saved to cache
2026-03-29 20:18:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 10717d18-f73a-5744-9de4-ddb3dd6c99d9
2026-03-29 20:18:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6867/11436867/exterior_rear_passenger-1774507753807.jpg> (referer: None)
2026-03-29 20:18:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b65a90>
2026-03-29 20:18:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10717d18-f73a-5744-9de4-ddb3dd6c99d9/10717d18-f73a-5744-9de4-ddb3dd6c99d9_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6867%252F11436867%252Fexterior_rear_passenger-1774507753807.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6867/11436867/exterior_rear_passenger-1774507753807.jpg saved to cache
2026-03-29 20:18:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 10717d18-f73a-5744-9de4-ddb3dd6c99d9
2026-03-29 20:18:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6867/11436867/exterior_front_passenger-1774507391773.jpg> (referer: None)
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65857a9d0>
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10717d18-f73a-5744-9de4-ddb3dd6c99d9/10717d18-f73a-5744-9de4-ddb3dd6c99d9_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6867%252F11436867%252Fexterior_front_passenger-1774507391773.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6867/11436867/exterior_front_passenger-1774507391773.jpg saved to cache
2026-03-29 20:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 10717d18-f73a-5744-9de4-ddb3dd6c99d9
2026-03-29 20:18:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6867/11436867/exterior_rear_driver-1774507767799.jpg> (referer: None)
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a41d10>
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10717d18-f73a-5744-9de4-ddb3dd6c99d9/10717d18-f73a-5744-9de4-ddb3dd6c99d9_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6867%252F11436867%252Fexterior_rear_driver-1774507767799.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6867/11436867/exterior_rear_driver-1774507767799.jpg saved to cache
2026-03-29 20:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 10717d18-f73a-5744-9de4-ddb3dd6c99d9
2026-03-29 20:18:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6867/11436867/exterior_front_driver-1774507370922.jpg> (referer: None)
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b64c90>
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10717d18-f73a-5744-9de4-ddb3dd6c99d9/10717d18-f73a-5744-9de4-ddb3dd6c99d9_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6867%252F11436867%252Fexterior_front_driver-1774507370922.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6867/11436867/exterior_front_driver-1774507370922.jpg saved to cache
2026-03-29 20:18:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 10717d18-f73a-5744-9de4-ddb3dd6c99d9
2026-03-29 20:18:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10717d18-f73a-5744-9de4-ddb3dd6c99d9, skipping ID generation
2026-03-29 20:18:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10717d18-f73a-5744-9de4-ddb3dd6c99d9 with scrape type 1
2026-03-29 20:18:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 10717d18-f73a-5744-9de4-ddb3dd6c99d9 sending to next pipeline
2026-03-29 20:18:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 10717d18-f73a-5744-9de4-ddb3dd6c99d9, identifier: 11436867
2026-03-29 20:18:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 10717d18-f73a-5744-9de4-ddb3dd6c99d9 with identifier: 11436867
2026-03-29 20:18:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 10717d18-f73a-5744-9de4-ddb3dd6c99d9 with identifier: 11436867
2026-03-29 20:18:44 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 10717d18-f73a-5744-9de4-ddb3dd6c99d9 with identifier: 11436867 to the API
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6867/11436867/exterior_front_driver-1774507370922.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '10717d18-f73a-5744-9de4-ddb3dd6c99d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DL20 UTZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/11436867',
'listing': 'auction',
'location': 'Peterborough Peterborough',
'make': 'Vauxhall',
'model': 'Crossland',
'odometer': 70300,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10717d18-f73a-5744-9de4-ddb3dd6c99d9/10717d18-f73a-5744-9de4-ddb3dd6c99d9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1115434,
'Height': 2468,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6867/11436867/exterior_front_driver-1774507370922.jpg',
'Width': 3290},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10717d18-f73a-5744-9de4-ddb3dd6c99d9/10717d18-f73a-5744-9de4-ddb3dd6c99d9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 837719,
'Height': 2746,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6867/11436867/exterior_rear_driver-1774507767799.jpg',
'Width': 3661},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10717d18-f73a-5744-9de4-ddb3dd6c99d9/10717d18-f73a-5744-9de4-ddb3dd6c99d9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1640597,
'Height': 2649,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6867/11436867/exterior_front_passenger-1774507391773.jpg',
'Width': 3532},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10717d18-f73a-5744-9de4-ddb3dd6c99d9/10717d18-f73a-5744-9de4-ddb3dd6c99d9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1711059,
'Height': 2801,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6867/11436867/exterior_rear_passenger-1774507753807.jpg',
'Width': 3735},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10717d18-f73a-5744-9de4-ddb3dd6c99d9/10717d18-f73a-5744-9de4-ddb3dd6c99d9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1234501,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6867/11436867/interior_front_seats-1774508167662.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10717d18-f73a-5744-9de4-ddb3dd6c99d9/10717d18-f73a-5744-9de4-ddb3dd6c99d9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1639829,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6867/11436867/interior_rear_seats-1774508165307.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10717d18-f73a-5744-9de4-ddb3dd6c99d9/10717d18-f73a-5744-9de4-ddb3dd6c99d9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1018980,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6867/11436867/interior_dashboard-1774508236389.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10717d18-f73a-5744-9de4-ddb3dd6c99d9/10717d18-f73a-5744-9de4-ddb3dd6c99d9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1014449,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6867/11436867/instrument_cluster-1774508154408.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10717d18-f73a-5744-9de4-ddb3dd6c99d9/10717d18-f73a-5744-9de4-ddb3dd6c99d9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 903914,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/6867/11436867/interior_boot-1774508169547.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10717d18-f73a-5744-9de4-ddb3dd6c99d9/10717d18-f73a-5744-9de4-ddb3dd6c99d9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 18000,
'Height': 646,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6867/11436867/docs_service_history-1774704689892.jpg?ixlib=js-3.8.0&auto=format&s=47ef3155d37a19358a3b4b997da5f9aa',
'Width': 738}],
'price': 4434,
'price_includes_vat': False,
'registration_date': '2020-08-31',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Crossland X Business ED NAV',
'transmission': 'manual',
'trim': 'X Business ED NAV',
'vin': 'W0V7H9EE2L4290633',
'year': 2020}
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711436867%27 HTTP/1.1" 200 None
2026-03-29 20:18:45 [motorway.uk] INFO: Saving data for 11436867: {'created_time': 1774815525.094731, 'last_price_update_time': 1774815525.094756, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='11436867') HTTP/1.1" 204 0
2026-03-29 20:18:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16034385.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d77a75bd-e97f-55ca-8b54-62055524640d with identifier: 16034385
2026-03-29 20:18:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d77a75bd-e97f-55ca-8b54-62055524640d with scrape type 1
2026-03-29 20:18:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d77a75bd-e97f-55ca-8b54-62055524640d
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4385%252F16034385%252Fexterior_front_driver-1773854638031.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4385/16034385/exterior_front_driver-1773854638031.jpeg not downloaded yet
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4385%252F16034385%252Fexterior_rear_driver-1773854689441.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4385/16034385/exterior_rear_driver-1773854689441.jpeg not downloaded yet
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4385%252F16034385%252Fexterior_front_passenger-1773854646771.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4385/16034385/exterior_front_passenger-1773854646771.jpeg not downloaded yet
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4385%252F16034385%252Fexterior_rear_passenger-1773854678534.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4385/16034385/exterior_rear_passenger-1773854678534.jpeg not downloaded yet
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4385%252F16034385%252Finterior_front_seats-1773850590078.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4385/16034385/interior_front_seats-1773850590078.jpeg not downloaded yet
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4385%252F16034385%252Finterior_rear_seats-1773850830708.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4385/16034385/interior_rear_seats-1773850830708.jpeg not downloaded yet
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4385%252F16034385%252Finterior_dashboard-1773850444279.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4385/16034385/interior_dashboard-1773850444279.jpeg not downloaded yet
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4385%252F16034385%252Finstrument_cluster-1773850472149.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4385/16034385/instrument_cluster-1773850472149.jpeg not downloaded yet
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4385%252F16034385%252Finterior_boot-1773850726141.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:18:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4385/16034385/interior_boot-1773850726141.jpeg not downloaded yet
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4385%252F16034385%252F16034385-docs_service_history-modified-1774535432155.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D47215bf51e6975bcf461486e2cafb897%27 HTTP/1.1" 200 None
2026-03-29 20:18:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4385/16034385/16034385-docs_service_history-modified-1774535432155.jpeg?ixlib=js-3.8.0&auto=format&s=47215bf51e6975bcf461486e2cafb897 not downloaded yet
2026-03-29 20:18:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20451319.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/4385/16034385/16034385-docs_service_history-modified-1774535432155.jpeg?ixlib=js-3.8.0&auto=format&s=47215bf51e6975bcf461486e2cafb897> (referer: None)
2026-03-29 20:18:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 742cef07-e40e-55fa-b438-1e4dbd1317ad with identifier: 20451319
2026-03-29 20:18:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 742cef07-e40e-55fa-b438-1e4dbd1317ad with scrape type 1
2026-03-29 20:18:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 742cef07-e40e-55fa-b438-1e4dbd1317ad
2026-03-29 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1319%252F20451319%252Fexterior_front_driver-1774721384484.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1319/20451319/exterior_front_driver-1774721384484.jpg not downloaded yet
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1319%252F20451319%252Fexterior_rear_driver-1774721414779.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1319/20451319/exterior_rear_driver-1774721414779.jpg not downloaded yet
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1319%252F20451319%252Fexterior_front_passenger-1774721449180.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1319/20451319/exterior_front_passenger-1774721449180.jpg not downloaded yet
2026-03-29 20:18:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f11910>
2026-03-29 20:18:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d77a75bd-e97f-55ca-8b54-62055524640d/d77a75bd-e97f-55ca-8b54-62055524640d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4385%252F16034385%252F16034385-docs_service_history-modified-1774535432155.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D47215bf51e6975bcf461486e2cafb897') HTTP/1.1" 204 0
2026-03-29 20:18:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4385/16034385/16034385-docs_service_history-modified-1774535432155.jpeg?ixlib=js-3.8.0&auto=format&s=47215bf51e6975bcf461486e2cafb897 saved to cache
2026-03-29 20:18:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d77a75bd-e97f-55ca-8b54-62055524640d
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1319%252F20451319%252Fexterior_rear_passenger-1774721432126.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1319/20451319/exterior_rear_passenger-1774721432126.jpg not downloaded yet
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1319%252F20451319%252Finterior_front_seats-1774722229043.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1319/20451319/interior_front_seats-1774722229043.jpg not downloaded yet
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1319%252F20451319%252Finterior_rear_seats-1774722253113.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1319/20451319/interior_rear_seats-1774722253113.jpg not downloaded yet
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1319%252F20451319%252Finterior_dashboard-1774779862492.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1319/20451319/interior_dashboard-1774779862492.jpg not downloaded yet
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1319%252F20451319%252Finterior_boot-1774780024923.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1319/20451319/interior_boot-1774780024923.jpg not downloaded yet
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1319%252F20451319%252Fdocs_service_history-1774722595519.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc2a8fb9d0cbd153352b8a9a1fd8fe25f%27 HTTP/1.1" 200 None
2026-03-29 20:18:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1319/20451319/docs_service_history-1774722595519.jpg?ixlib=js-3.8.0&auto=format&s=c2a8fb9d0cbd153352b8a9a1fd8fe25f not downloaded yet
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1319%252F20451319%252Fdocs_service_history-1774779782996.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcca093883ddd7dcbee6efffdee2a2b5d%27 HTTP/1.1" 200 None
2026-03-29 20:18:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1319/20451319/docs_service_history-1774779782996.jpg?ixlib=js-3.8.0&auto=format&s=cca093883ddd7dcbee6efffdee2a2b5d not downloaded yet
2026-03-29 20:18:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4385/16034385/interior_boot-1773850726141.jpeg> (referer: None)
2026-03-29 20:18:47 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:18:47 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:18:47 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00;.\x9d\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xcas\x00;$\x0b\x00\x00\x00\x00'
2026-03-29 20:18:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587045d0>
2026-03-29 20:18:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d77a75bd-e97f-55ca-8b54-62055524640d/d77a75bd-e97f-55ca-8b54-62055524640d_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4385%252F16034385%252Finterior_boot-1773850726141.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4385/16034385/interior_boot-1773850726141.jpeg saved to cache
2026-03-29 20:18:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d77a75bd-e97f-55ca-8b54-62055524640d
2026-03-29 20:18:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/1319/20451319/docs_service_history-1774779782996.jpg?ixlib=js-3.8.0&auto=format&s=cca093883ddd7dcbee6efffdee2a2b5d> (referer: None)
2026-03-29 20:18:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a11bd0>
2026-03-29 20:18:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742cef07-e40e-55fa-b438-1e4dbd1317ad/742cef07-e40e-55fa-b438-1e4dbd1317ad_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F1319%252F20451319%252Fdocs_service_history-1774779782996.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dcca093883ddd7dcbee6efffdee2a2b5d') HTTP/1.1" 204 0
2026-03-29 20:18:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/1319/20451319/docs_service_history-1774779782996.jpg?ixlib=js-3.8.0&auto=format&s=cca093883ddd7dcbee6efffdee2a2b5d saved to cache
2026-03-29 20:18:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 742cef07-e40e-55fa-b438-1e4dbd1317ad
2026-03-29 20:18:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1319/20451319/docs_service_history-1774722595519.jpg?ixlib=js-3.8.0&auto=format&s=c2a8fb9d0cbd153352b8a9a1fd8fe25f> (referer: None)
2026-03-29 20:18:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587056d0>
2026-03-29 20:18:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742cef07-e40e-55fa-b438-1e4dbd1317ad/742cef07-e40e-55fa-b438-1e4dbd1317ad_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1319%252F20451319%252Fdocs_service_history-1774722595519.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc2a8fb9d0cbd153352b8a9a1fd8fe25f') HTTP/1.1" 204 0
2026-03-29 20:18:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1319/20451319/docs_service_history-1774722595519.jpg?ixlib=js-3.8.0&auto=format&s=c2a8fb9d0cbd153352b8a9a1fd8fe25f saved to cache
2026-03-29 20:18:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 742cef07-e40e-55fa-b438-1e4dbd1317ad
2026-03-29 20:18:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1319/20451319/interior_boot-1774780024923.jpg> (referer: None)
2026-03-29 20:18:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658467f90>
2026-03-29 20:18:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742cef07-e40e-55fa-b438-1e4dbd1317ad/742cef07-e40e-55fa-b438-1e4dbd1317ad_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1319%252F20451319%252Finterior_boot-1774780024923.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1319/20451319/interior_boot-1774780024923.jpg saved to cache
2026-03-29 20:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 742cef07-e40e-55fa-b438-1e4dbd1317ad
2026-03-29 20:18:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1319/20451319/interior_dashboard-1774779862492.jpg> (referer: None)
2026-03-29 20:18:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a11310>
2026-03-29 20:18:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742cef07-e40e-55fa-b438-1e4dbd1317ad/742cef07-e40e-55fa-b438-1e4dbd1317ad_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1319%252F20451319%252Finterior_dashboard-1774779862492.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1319/20451319/interior_dashboard-1774779862492.jpg saved to cache
2026-03-29 20:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 742cef07-e40e-55fa-b438-1e4dbd1317ad
2026-03-29 20:18:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1319/20451319/interior_rear_seats-1774722253113.jpg> (referer: None)
2026-03-29 20:18:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a1e190>
2026-03-29 20:18:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742cef07-e40e-55fa-b438-1e4dbd1317ad/742cef07-e40e-55fa-b438-1e4dbd1317ad_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1319%252F20451319%252Finterior_rear_seats-1774722253113.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1319/20451319/interior_rear_seats-1774722253113.jpg saved to cache
2026-03-29 20:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 742cef07-e40e-55fa-b438-1e4dbd1317ad
2026-03-29 20:18:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20480811.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e710bac-88d1-5f6b-a911-734467e9c30a with identifier: 20480811
2026-03-29 20:18:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e710bac-88d1-5f6b-a911-734467e9c30a with scrape type 1
2026-03-29 20:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3e710bac-88d1-5f6b-a911-734467e9c30a
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0811%252F20480811%252Fexterior_front_driver-1774696065392.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0811/20480811/exterior_front_driver-1774696065392.jpg not downloaded yet
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0811%252F20480811%252Fexterior_rear_driver-1774696097513.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0811/20480811/exterior_rear_driver-1774696097513.jpg not downloaded yet
2026-03-29 20:18:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0811%252F20480811%252Fexterior_front_passenger-1774696141719.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0811/20480811/exterior_front_passenger-1774696141719.jpg not downloaded yet
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0811%252F20480811%252Fexterior_rear_passenger-1774696114070.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0811/20480811/exterior_rear_passenger-1774696114070.jpg not downloaded yet
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0811%252F20480811%252Finterior_front_seats-1774696389395.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0811/20480811/interior_front_seats-1774696389395.jpg not downloaded yet
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0811%252F20480811%252Finterior_rear_seats-1774696968230.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0811/20480811/interior_rear_seats-1774696968230.jpg not downloaded yet
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0811%252F20480811%252Finterior_dashboard-1774699817243.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0811/20480811/interior_dashboard-1774699817243.jpg not downloaded yet
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0811%252F20480811%252Finstrument_cluster-1774696483239.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0811/20480811/instrument_cluster-1774696483239.jpg not downloaded yet
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0811%252F20480811%252Finterior_boot-1774696519034.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0811/20480811/interior_boot-1774696519034.jpg not downloaded yet
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F0811%252F20480811%252Fdocs_service_history-1774699803228.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D35ea6c6318978f2c7a117bfb1fc30441%27 HTTP/1.1" 200 None
2026-03-29 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/0811/20480811/docs_service_history-1774699803228.jpg?ixlib=js-3.8.0&auto=format&s=35ea6c6318978f2c7a117bfb1fc30441 not downloaded yet
2026-03-29 20:18:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1319/20451319/exterior_rear_passenger-1774721432126.jpg> (referer: None)
2026-03-29 20:18:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1319/20451319/interior_front_seats-1774722229043.jpg> (referer: None)
2026-03-29 20:18:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ff4c90>
2026-03-29 20:18:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742cef07-e40e-55fa-b438-1e4dbd1317ad/742cef07-e40e-55fa-b438-1e4dbd1317ad_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1319%252F20451319%252Fexterior_rear_passenger-1774721432126.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1319/20451319/exterior_rear_passenger-1774721432126.jpg saved to cache
2026-03-29 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 742cef07-e40e-55fa-b438-1e4dbd1317ad
2026-03-29 20:18:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be6a550>
2026-03-29 20:18:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742cef07-e40e-55fa-b438-1e4dbd1317ad/742cef07-e40e-55fa-b438-1e4dbd1317ad_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1319%252F20451319%252Finterior_front_seats-1774722229043.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1319/20451319/interior_front_seats-1774722229043.jpg saved to cache
2026-03-29 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 742cef07-e40e-55fa-b438-1e4dbd1317ad
2026-03-29 20:18:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17587362.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/0811/20480811/docs_service_history-1774699803228.jpg?ixlib=js-3.8.0&auto=format&s=35ea6c6318978f2c7a117bfb1fc30441> (referer: None)
2026-03-29 20:18:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e12ea777-4e18-5265-85a2-df6b1fa1d81c with identifier: 17587362
2026-03-29 20:18:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e12ea777-4e18-5265-85a2-df6b1fa1d81c with scrape type 1
2026-03-29 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e12ea777-4e18-5265-85a2-df6b1fa1d81c
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7362%252F17587362%252F17587362-exterior_front_driver-default-1774712842568.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7362/17587362/17587362-exterior_front_driver-default-1774712842568.jpg not downloaded yet
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7362%252F17587362%252F17587362-exterior_rear_driver-default-1774712842635.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7362/17587362/17587362-exterior_rear_driver-default-1774712842635.jpg not downloaded yet
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7362%252F17587362%252F17587362-exterior_front_passenger-default-1774712841069.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7362/17587362/17587362-exterior_front_passenger-default-1774712841069.jpg not downloaded yet
2026-03-29 20:18:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fabc90>
2026-03-29 20:18:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e710bac-88d1-5f6b-a911-734467e9c30a/3e710bac-88d1-5f6b-a911-734467e9c30a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F0811%252F20480811%252Fdocs_service_history-1774699803228.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D35ea6c6318978f2c7a117bfb1fc30441') HTTP/1.1" 204 0
2026-03-29 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/0811/20480811/docs_service_history-1774699803228.jpg?ixlib=js-3.8.0&auto=format&s=35ea6c6318978f2c7a117bfb1fc30441 saved to cache
2026-03-29 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3e710bac-88d1-5f6b-a911-734467e9c30a
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7362%252F17587362%252F17587362-exterior_rear_passenger-default-1774712837262.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7362/17587362/17587362-exterior_rear_passenger-default-1774712837262.jpg not downloaded yet
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7362%252F17587362%252F17587362-interior_front_seats-default-1774712822943.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7362/17587362/17587362-interior_front_seats-default-1774712822943.jpg not downloaded yet
2026-03-29 20:18:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7362%252F17587362%252F17587362-interior_rear_seats-default-1774712821692.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7362/17587362/17587362-interior_rear_seats-default-1774712821692.jpg not downloaded yet
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7362%252F17587362%252F17587362-interior_dashboard-default-1774712832416.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7362/17587362/17587362-interior_dashboard-default-1774712832416.jpg not downloaded yet
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7362%252F17587362%252F17587362-instrument_cluster-default-1774712948173.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7362/17587362/17587362-instrument_cluster-default-1774712948173.jpg not downloaded yet
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7362%252F17587362%252F17587362-interior_boot-default-1774712818460.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7362/17587362/17587362-interior_boot-default-1774712818460.jpg not downloaded yet
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7362%252F17587362%252F17587362-docs_service_history-modified-1774713742797.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbb495a8a7defcd67cc8a1aedaa7f6cb8%27 HTTP/1.1" 200 None
2026-03-29 20:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7362/17587362/17587362-docs_service_history-modified-1774713742797.jpeg?ixlib=js-3.8.0&auto=format&s=bb495a8a7defcd67cc8a1aedaa7f6cb8 not downloaded yet
2026-03-29 20:18:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0811/20480811/interior_dashboard-1774699817243.jpg> (referer: None)
2026-03-29 20:18:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0811/20480811/interior_boot-1774696519034.jpg> (referer: None)
2026-03-29 20:18:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0811/20480811/instrument_cluster-1774696483239.jpg> (referer: None)
2026-03-29 20:18:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/7362/17587362/17587362-docs_service_history-modified-1774713742797.jpeg?ixlib=js-3.8.0&auto=format&s=bb495a8a7defcd67cc8a1aedaa7f6cb8> (referer: None)
2026-03-29 20:18:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658aa1bd0>
2026-03-29 20:18:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e710bac-88d1-5f6b-a911-734467e9c30a/3e710bac-88d1-5f6b-a911-734467e9c30a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0811%252F20480811%252Finterior_dashboard-1774699817243.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0811/20480811/interior_dashboard-1774699817243.jpg saved to cache
2026-03-29 20:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3e710bac-88d1-5f6b-a911-734467e9c30a
2026-03-29 20:18:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658aa2ed0>
2026-03-29 20:18:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e710bac-88d1-5f6b-a911-734467e9c30a/3e710bac-88d1-5f6b-a911-734467e9c30a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0811%252F20480811%252Finterior_boot-1774696519034.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0811/20480811/interior_boot-1774696519034.jpg saved to cache
2026-03-29 20:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3e710bac-88d1-5f6b-a911-734467e9c30a
2026-03-29 20:18:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be512d0>
2026-03-29 20:18:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e710bac-88d1-5f6b-a911-734467e9c30a/3e710bac-88d1-5f6b-a911-734467e9c30a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0811%252F20480811%252Finstrument_cluster-1774696483239.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0811/20480811/instrument_cluster-1774696483239.jpg saved to cache
2026-03-29 20:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3e710bac-88d1-5f6b-a911-734467e9c30a
2026-03-29 20:18:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be5ff90>
2026-03-29 20:18:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e12ea777-4e18-5265-85a2-df6b1fa1d81c/e12ea777-4e18-5265-85a2-df6b1fa1d81c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7362%252F17587362%252F17587362-docs_service_history-modified-1774713742797.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbb495a8a7defcd67cc8a1aedaa7f6cb8') HTTP/1.1" 204 0
2026-03-29 20:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7362/17587362/17587362-docs_service_history-modified-1774713742797.jpeg?ixlib=js-3.8.0&auto=format&s=bb495a8a7defcd67cc8a1aedaa7f6cb8 saved to cache
2026-03-29 20:18:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e12ea777-4e18-5265-85a2-df6b1fa1d81c
2026-03-29 20:18:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7362/17587362/17587362-instrument_cluster-default-1774712948173.jpg> (referer: None)
2026-03-29 20:18:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7362/17587362/17587362-interior_boot-default-1774712818460.jpg> (referer: None)
2026-03-29 20:18:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c15190>
2026-03-29 20:18:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e12ea777-4e18-5265-85a2-df6b1fa1d81c/e12ea777-4e18-5265-85a2-df6b1fa1d81c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7362%252F17587362%252F17587362-instrument_cluster-default-1774712948173.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7362/17587362/17587362-instrument_cluster-default-1774712948173.jpg saved to cache
2026-03-29 20:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e12ea777-4e18-5265-85a2-df6b1fa1d81c
2026-03-29 20:18:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598d13d0>
2026-03-29 20:18:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e12ea777-4e18-5265-85a2-df6b1fa1d81c/e12ea777-4e18-5265-85a2-df6b1fa1d81c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7362%252F17587362%252F17587362-interior_boot-default-1774712818460.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7362/17587362/17587362-interior_boot-default-1774712818460.jpg saved to cache
2026-03-29 20:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e12ea777-4e18-5265-85a2-df6b1fa1d81c
2026-03-29 20:18:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7362/17587362/17587362-interior_dashboard-default-1774712832416.jpg> (referer: None)
2026-03-29 20:18:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7362/17587362/17587362-interior_front_seats-default-1774712822943.jpg> (referer: None)
2026-03-29 20:18:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c81b50>
2026-03-29 20:18:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e12ea777-4e18-5265-85a2-df6b1fa1d81c/e12ea777-4e18-5265-85a2-df6b1fa1d81c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7362%252F17587362%252F17587362-interior_dashboard-default-1774712832416.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7362/17587362/17587362-interior_dashboard-default-1774712832416.jpg saved to cache
2026-03-29 20:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e12ea777-4e18-5265-85a2-df6b1fa1d81c
2026-03-29 20:18:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d59150>
2026-03-29 20:18:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e12ea777-4e18-5265-85a2-df6b1fa1d81c/e12ea777-4e18-5265-85a2-df6b1fa1d81c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7362%252F17587362%252F17587362-interior_front_seats-default-1774712822943.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7362/17587362/17587362-interior_front_seats-default-1774712822943.jpg saved to cache
2026-03-29 20:18:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e12ea777-4e18-5265-85a2-df6b1fa1d81c
2026-03-29 20:18:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7362/17587362/17587362-interior_rear_seats-default-1774712821692.jpg> (referer: None)
2026-03-29 20:18:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7362/17587362/17587362-exterior_rear_passenger-default-1774712837262.jpg> (referer: None)
2026-03-29 20:18:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7362/17587362/17587362-exterior_front_passenger-default-1774712841069.jpg> (referer: None)
2026-03-29 20:18:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c83850>
2026-03-29 20:18:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e12ea777-4e18-5265-85a2-df6b1fa1d81c/e12ea777-4e18-5265-85a2-df6b1fa1d81c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7362%252F17587362%252F17587362-interior_rear_seats-default-1774712821692.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7362/17587362/17587362-interior_rear_seats-default-1774712821692.jpg saved to cache
2026-03-29 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e12ea777-4e18-5265-85a2-df6b1fa1d81c
2026-03-29 20:18:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a1de10>
2026-03-29 20:18:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e12ea777-4e18-5265-85a2-df6b1fa1d81c/e12ea777-4e18-5265-85a2-df6b1fa1d81c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7362%252F17587362%252F17587362-exterior_rear_passenger-default-1774712837262.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7362/17587362/17587362-exterior_rear_passenger-default-1774712837262.jpg saved to cache
2026-03-29 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e12ea777-4e18-5265-85a2-df6b1fa1d81c
2026-03-29 20:18:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f6bf10>
2026-03-29 20:18:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e12ea777-4e18-5265-85a2-df6b1fa1d81c/e12ea777-4e18-5265-85a2-df6b1fa1d81c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7362%252F17587362%252F17587362-exterior_front_passenger-default-1774712841069.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7362/17587362/17587362-exterior_front_passenger-default-1774712841069.jpg saved to cache
2026-03-29 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e12ea777-4e18-5265-85a2-df6b1fa1d81c
2026-03-29 20:18:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7362/17587362/17587362-exterior_front_driver-default-1774712842568.jpg> (referer: None)
2026-03-29 20:18:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be535d0>
2026-03-29 20:18:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e12ea777-4e18-5265-85a2-df6b1fa1d81c/e12ea777-4e18-5265-85a2-df6b1fa1d81c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7362%252F17587362%252F17587362-exterior_front_driver-default-1774712842568.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7362/17587362/17587362-exterior_front_driver-default-1774712842568.jpg saved to cache
2026-03-29 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e12ea777-4e18-5265-85a2-df6b1fa1d81c
2026-03-29 20:18:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7362/17587362/17587362-exterior_rear_driver-default-1774712842635.jpg> (referer: None)
2026-03-29 20:18:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0811/20480811/interior_rear_seats-1774696968230.jpg> (referer: None)
2026-03-29 20:18:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ac71d0>
2026-03-29 20:18:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e12ea777-4e18-5265-85a2-df6b1fa1d81c/e12ea777-4e18-5265-85a2-df6b1fa1d81c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7362%252F17587362%252F17587362-exterior_rear_driver-default-1774712842635.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7362/17587362/17587362-exterior_rear_driver-default-1774712842635.jpg saved to cache
2026-03-29 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e12ea777-4e18-5265-85a2-df6b1fa1d81c
2026-03-29 20:18:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e12ea777-4e18-5265-85a2-df6b1fa1d81c, skipping ID generation
2026-03-29 20:18:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e12ea777-4e18-5265-85a2-df6b1fa1d81c with scrape type 1
2026-03-29 20:18:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e12ea777-4e18-5265-85a2-df6b1fa1d81c sending to next pipeline
2026-03-29 20:18:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e12ea777-4e18-5265-85a2-df6b1fa1d81c, identifier: 17587362
2026-03-29 20:18:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e12ea777-4e18-5265-85a2-df6b1fa1d81c with identifier: 17587362
2026-03-29 20:18:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e12ea777-4e18-5265-85a2-df6b1fa1d81c with identifier: 17587362
2026-03-29 20:18:54 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e12ea777-4e18-5265-85a2-df6b1fa1d81c with identifier: 17587362 to the API
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7362/17587362/17587362-exterior_rear_driver-default-1774712842635.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'e12ea777-4e18-5265-85a2-df6b1fa1d81c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'K4 RXH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17587362',
'listing': 'auction',
'location': 'Greater London Upminster',
'make': 'MINI',
'model': 'Cooper',
'odometer': 66371,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12ea777-4e18-5265-85a2-df6b1fa1d81c/e12ea777-4e18-5265-85a2-df6b1fa1d81c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1388208,
'Height': 2434,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7362/17587362/17587362-exterior_front_driver-default-1774712842568.jpg',
'Width': 3245},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12ea777-4e18-5265-85a2-df6b1fa1d81c/e12ea777-4e18-5265-85a2-df6b1fa1d81c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1612465,
'Height': 2809,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7362/17587362/17587362-exterior_rear_driver-default-1774712842635.jpg',
'Width': 3745},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12ea777-4e18-5265-85a2-df6b1fa1d81c/e12ea777-4e18-5265-85a2-df6b1fa1d81c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1470587,
'Height': 2586,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7362/17587362/17587362-exterior_front_passenger-default-1774712841069.jpg',
'Width': 3448},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12ea777-4e18-5265-85a2-df6b1fa1d81c/e12ea777-4e18-5265-85a2-df6b1fa1d81c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1254767,
'Height': 2492,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7362/17587362/17587362-exterior_rear_passenger-default-1774712837262.jpg',
'Width': 3322},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12ea777-4e18-5265-85a2-df6b1fa1d81c/e12ea777-4e18-5265-85a2-df6b1fa1d81c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2155510,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7362/17587362/17587362-interior_front_seats-default-1774712822943.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12ea777-4e18-5265-85a2-df6b1fa1d81c/e12ea777-4e18-5265-85a2-df6b1fa1d81c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2575383,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7362/17587362/17587362-interior_rear_seats-default-1774712821692.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12ea777-4e18-5265-85a2-df6b1fa1d81c/e12ea777-4e18-5265-85a2-df6b1fa1d81c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2712271,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7362/17587362/17587362-interior_dashboard-default-1774712832416.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12ea777-4e18-5265-85a2-df6b1fa1d81c/e12ea777-4e18-5265-85a2-df6b1fa1d81c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1658217,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7362/17587362/17587362-instrument_cluster-default-1774712948173.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12ea777-4e18-5265-85a2-df6b1fa1d81c/e12ea777-4e18-5265-85a2-df6b1fa1d81c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2157979,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7362/17587362/17587362-interior_boot-default-1774712818460.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12ea777-4e18-5265-85a2-df6b1fa1d81c/e12ea777-4e18-5265-85a2-df6b1fa1d81c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 637559,
'Height': 1783,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/7362/17587362/17587362-docs_service_history-modified-1774713742797.jpeg?ixlib=js-3.8.0&auto=format&s=bb495a8a7defcd67cc8a1aedaa7f6cb8',
'Width': 2377}],
'price': 6061,
'price_includes_vat': False,
'registration_date': '2015-09-01',
'seats_number': None,
'seller_name': None,
'title': 'MINI Cooper S',
'transmission': 'manual',
'trim': 'S',
'vin': 'WMWXM72020T961154',
'year': 2015}
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717587362%27 HTTP/1.1" 200 None
2026-03-29 20:18:54 [motorway.uk] INFO: Saving data for 17587362: {'created_time': 1774815534.541411, 'last_price_update_time': 1774815534.541422, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17587362') HTTP/1.1" 204 0
2026-03-29 20:18:54 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.360(s), this was the 1st time calling it.
2026-03-29 20:18:54 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.0806492588676155 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:18:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658466f10>
2026-03-29 20:18:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e710bac-88d1-5f6b-a911-734467e9c30a/3e710bac-88d1-5f6b-a911-734467e9c30a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0811%252F20480811%252Finterior_rear_seats-1774696968230.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0811/20480811/interior_rear_seats-1774696968230.jpg saved to cache
2026-03-29 20:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3e710bac-88d1-5f6b-a911-734467e9c30a
2026-03-29 20:18:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0811/20480811/exterior_rear_passenger-1774696114070.jpg> (referer: None)
2026-03-29 20:18:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0811/20480811/exterior_front_passenger-1774696141719.jpg> (referer: None)
2026-03-29 20:18:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0811/20480811/interior_front_seats-1774696389395.jpg> (referer: None)
2026-03-29 20:18:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586f4c90>
2026-03-29 20:18:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e710bac-88d1-5f6b-a911-734467e9c30a/3e710bac-88d1-5f6b-a911-734467e9c30a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0811%252F20480811%252Fexterior_rear_passenger-1774696114070.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0811/20480811/exterior_rear_passenger-1774696114070.jpg saved to cache
2026-03-29 20:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3e710bac-88d1-5f6b-a911-734467e9c30a
2026-03-29 20:18:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ac40d0>
2026-03-29 20:18:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e710bac-88d1-5f6b-a911-734467e9c30a/3e710bac-88d1-5f6b-a911-734467e9c30a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0811%252F20480811%252Fexterior_front_passenger-1774696141719.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0811/20480811/exterior_front_passenger-1774696141719.jpg saved to cache
2026-03-29 20:18:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3e710bac-88d1-5f6b-a911-734467e9c30a
2026-03-29 20:18:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598db950>
2026-03-29 20:18:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e710bac-88d1-5f6b-a911-734467e9c30a/3e710bac-88d1-5f6b-a911-734467e9c30a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0811%252F20480811%252Finterior_front_seats-1774696389395.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0811/20480811/interior_front_seats-1774696389395.jpg saved to cache
2026-03-29 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3e710bac-88d1-5f6b-a911-734467e9c30a
2026-03-29 20:18:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0811/20480811/exterior_front_driver-1774696065392.jpg> (referer: None)
2026-03-29 20:18:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0811/20480811/exterior_rear_driver-1774696097513.jpg> (referer: None)
2026-03-29 20:18:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f6ab50>
2026-03-29 20:18:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e710bac-88d1-5f6b-a911-734467e9c30a/3e710bac-88d1-5f6b-a911-734467e9c30a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0811%252F20480811%252Fexterior_front_driver-1774696065392.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0811/20480811/exterior_front_driver-1774696065392.jpg saved to cache
2026-03-29 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e710bac-88d1-5f6b-a911-734467e9c30a
2026-03-29 20:18:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586f7010>
2026-03-29 20:18:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e710bac-88d1-5f6b-a911-734467e9c30a/3e710bac-88d1-5f6b-a911-734467e9c30a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0811%252F20480811%252Fexterior_rear_driver-1774696097513.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0811/20480811/exterior_rear_driver-1774696097513.jpg saved to cache
2026-03-29 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3e710bac-88d1-5f6b-a911-734467e9c30a
2026-03-29 20:18:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e710bac-88d1-5f6b-a911-734467e9c30a, skipping ID generation
2026-03-29 20:18:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e710bac-88d1-5f6b-a911-734467e9c30a with scrape type 1
2026-03-29 20:18:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e710bac-88d1-5f6b-a911-734467e9c30a sending to next pipeline
2026-03-29 20:18:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 3e710bac-88d1-5f6b-a911-734467e9c30a, identifier: 20480811
2026-03-29 20:18:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 3e710bac-88d1-5f6b-a911-734467e9c30a with identifier: 20480811
2026-03-29 20:18:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 3e710bac-88d1-5f6b-a911-734467e9c30a with identifier: 20480811
2026-03-29 20:18:55 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 3e710bac-88d1-5f6b-a911-734467e9c30a with identifier: 20480811 to the API
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0811/20480811/exterior_rear_driver-1774696097513.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '3e710bac-88d1-5f6b-a911-734467e9c30a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'WR16 JDJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20480811',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Mitsubishi',
'model': 'Outlander',
'odometer': 105455,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e710bac-88d1-5f6b-a911-734467e9c30a/3e710bac-88d1-5f6b-a911-734467e9c30a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1650031,
'Height': 2969,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0811/20480811/exterior_front_driver-1774696065392.jpg',
'Width': 3959},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e710bac-88d1-5f6b-a911-734467e9c30a/3e710bac-88d1-5f6b-a911-734467e9c30a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1506775,
'Height': 2784,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0811/20480811/exterior_rear_driver-1774696097513.jpg',
'Width': 3712},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e710bac-88d1-5f6b-a911-734467e9c30a/3e710bac-88d1-5f6b-a911-734467e9c30a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1577266,
'Height': 2720,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0811/20480811/exterior_front_passenger-1774696141719.jpg',
'Width': 3627},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e710bac-88d1-5f6b-a911-734467e9c30a/3e710bac-88d1-5f6b-a911-734467e9c30a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1510442,
'Height': 2761,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0811/20480811/exterior_rear_passenger-1774696114070.jpg',
'Width': 3681},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e710bac-88d1-5f6b-a911-734467e9c30a/3e710bac-88d1-5f6b-a911-734467e9c30a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2620069,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0811/20480811/interior_front_seats-1774696389395.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e710bac-88d1-5f6b-a911-734467e9c30a/3e710bac-88d1-5f6b-a911-734467e9c30a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1993453,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0811/20480811/interior_rear_seats-1774696968230.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e710bac-88d1-5f6b-a911-734467e9c30a/3e710bac-88d1-5f6b-a911-734467e9c30a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2191238,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0811/20480811/interior_dashboard-1774699817243.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e710bac-88d1-5f6b-a911-734467e9c30a/3e710bac-88d1-5f6b-a911-734467e9c30a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2601625,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0811/20480811/instrument_cluster-1774696483239.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e710bac-88d1-5f6b-a911-734467e9c30a/3e710bac-88d1-5f6b-a911-734467e9c30a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3425350,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0811/20480811/interior_boot-1774696519034.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e710bac-88d1-5f6b-a911-734467e9c30a/3e710bac-88d1-5f6b-a911-734467e9c30a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1104182,
'Height': 2954,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/0811/20480811/docs_service_history-1774699803228.jpg?ixlib=js-3.8.0&auto=format&s=35ea6c6318978f2c7a117bfb1fc30441',
'Width': 3939}],
'price': 5741,
'price_includes_vat': False,
'registration_date': '2016-03-31',
'seats_number': None,
'seller_name': None,
'title': 'Mitsubishi Outlander GX 4H PHEV S-A',
'transmission': 'automatic',
'trim': 'GX 4H PHEV S-A',
'vin': 'JMAXDGG2WGZ007832',
'year': 2016}
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720480811%27 HTTP/1.1" 200 None
2026-03-29 20:18:55 [motorway.uk] INFO: Saving data for 20480811: {'created_time': 1774815535.972948, 'last_price_update_time': 1774815535.973, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20480811') HTTP/1.1" 204 0
2026-03-29 20:18:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1319/20451319/exterior_front_passenger-1774721449180.jpg> (referer: None)
2026-03-29 20:18:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1319/20451319/exterior_front_driver-1774721384484.jpg> (referer: None)
2026-03-29 20:18:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1319/20451319/exterior_rear_driver-1774721414779.jpg> (referer: None)
2026-03-29 20:18:56 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.935(s), this was the 1st time calling it.
2026-03-29 20:18:56 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.317545831490091 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:18:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be519d0>
2026-03-29 20:18:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742cef07-e40e-55fa-b438-1e4dbd1317ad/742cef07-e40e-55fa-b438-1e4dbd1317ad_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1319%252F20451319%252Fexterior_front_passenger-1774721449180.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1319/20451319/exterior_front_passenger-1774721449180.jpg saved to cache
2026-03-29 20:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 742cef07-e40e-55fa-b438-1e4dbd1317ad
2026-03-29 20:18:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659afa510>
2026-03-29 20:18:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742cef07-e40e-55fa-b438-1e4dbd1317ad/742cef07-e40e-55fa-b438-1e4dbd1317ad_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1319%252F20451319%252Fexterior_front_driver-1774721384484.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1319/20451319/exterior_front_driver-1774721384484.jpg saved to cache
2026-03-29 20:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 742cef07-e40e-55fa-b438-1e4dbd1317ad
2026-03-29 20:18:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659af0a90>
2026-03-29 20:18:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_742cef07-e40e-55fa-b438-1e4dbd1317ad/742cef07-e40e-55fa-b438-1e4dbd1317ad_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1319%252F20451319%252Fexterior_rear_driver-1774721414779.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1319/20451319/exterior_rear_driver-1774721414779.jpg saved to cache
2026-03-29 20:18:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 742cef07-e40e-55fa-b438-1e4dbd1317ad
2026-03-29 20:18:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 742cef07-e40e-55fa-b438-1e4dbd1317ad, skipping ID generation
2026-03-29 20:18:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 742cef07-e40e-55fa-b438-1e4dbd1317ad with scrape type 1
2026-03-29 20:18:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 742cef07-e40e-55fa-b438-1e4dbd1317ad sending to next pipeline
2026-03-29 20:18:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 742cef07-e40e-55fa-b438-1e4dbd1317ad, identifier: 20451319
2026-03-29 20:18:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 742cef07-e40e-55fa-b438-1e4dbd1317ad with identifier: 20451319
2026-03-29 20:18:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 742cef07-e40e-55fa-b438-1e4dbd1317ad with identifier: 20451319
2026-03-29 20:18:56 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 742cef07-e40e-55fa-b438-1e4dbd1317ad with identifier: 20451319 to the API
2026-03-29 20:18:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:18:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:18:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1319/20451319/exterior_rear_driver-1774721414779.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '742cef07-e40e-55fa-b438-1e4dbd1317ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YJ20 UTK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20451319',
'listing': 'auction',
'location': 'West Yorkshire Keighley',
'make': 'Fiat',
'model': '500',
'odometer': 27000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742cef07-e40e-55fa-b438-1e4dbd1317ad/742cef07-e40e-55fa-b438-1e4dbd1317ad_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1637522,
'Height': 2377,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1319/20451319/exterior_front_driver-1774721384484.jpg',
'Width': 3169},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742cef07-e40e-55fa-b438-1e4dbd1317ad/742cef07-e40e-55fa-b438-1e4dbd1317ad_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1852324,
'Height': 2433,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1319/20451319/exterior_rear_driver-1774721414779.jpg',
'Width': 3244},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742cef07-e40e-55fa-b438-1e4dbd1317ad/742cef07-e40e-55fa-b438-1e4dbd1317ad_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1096062,
'Height': 2028,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1319/20451319/exterior_front_passenger-1774721449180.jpg',
'Width': 2704},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742cef07-e40e-55fa-b438-1e4dbd1317ad/742cef07-e40e-55fa-b438-1e4dbd1317ad_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1734884,
'Height': 2427,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1319/20451319/exterior_rear_passenger-1774721432126.jpg',
'Width': 3236},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742cef07-e40e-55fa-b438-1e4dbd1317ad/742cef07-e40e-55fa-b438-1e4dbd1317ad_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3439881,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1319/20451319/interior_front_seats-1774722229043.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742cef07-e40e-55fa-b438-1e4dbd1317ad/742cef07-e40e-55fa-b438-1e4dbd1317ad_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3682429,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1319/20451319/interior_rear_seats-1774722253113.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742cef07-e40e-55fa-b438-1e4dbd1317ad/742cef07-e40e-55fa-b438-1e4dbd1317ad_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2718042,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1319/20451319/interior_dashboard-1774779862492.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742cef07-e40e-55fa-b438-1e4dbd1317ad/742cef07-e40e-55fa-b438-1e4dbd1317ad_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1554396,
'Height': 2407,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1319/20451319/interior_boot-1774780024923.jpg',
'Width': 3209},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742cef07-e40e-55fa-b438-1e4dbd1317ad/742cef07-e40e-55fa-b438-1e4dbd1317ad_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1026263,
'Height': 2455,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1319/20451319/docs_service_history-1774722595519.jpg?ixlib=js-3.8.0&auto=format&s=c2a8fb9d0cbd153352b8a9a1fd8fe25f',
'Width': 3312},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_742cef07-e40e-55fa-b438-1e4dbd1317ad/742cef07-e40e-55fa-b438-1e4dbd1317ad_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1491464,
'Height': 2470,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/1319/20451319/docs_service_history-1774779782996.jpg?ixlib=js-3.8.0&auto=format&s=cca093883ddd7dcbee6efffdee2a2b5d',
'Width': 3294}],
'price': 6242,
'price_includes_vat': False,
'registration_date': '2020-03-14',
'seats_number': None,
'seller_name': None,
'title': 'Fiat 500 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'vin': 'ZFA3120000JC20001',
'year': 2020}
2026-03-29 20:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720451319%27 HTTP/1.1" 200 None
2026-03-29 20:18:56 [motorway.uk] INFO: Saving data for 20451319: {'created_time': 1774815536.969133, 'last_price_update_time': 1774815536.969144, 'auction_closing_time': 1774884600.0}
2026-03-29 20:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20451319') HTTP/1.1" 204 0
2026-03-29 20:18:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4385/16034385/instrument_cluster-1773850472149.jpeg> (referer: None)
2026-03-29 20:18:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4385/16034385/interior_dashboard-1773850444279.jpeg> (referer: None)
2026-03-29 20:18:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4385/16034385/interior_rear_seats-1773850830708.jpeg> (referer: None)
2026-03-29 20:18:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659cf4610>
2026-03-29 20:18:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d77a75bd-e97f-55ca-8b54-62055524640d/d77a75bd-e97f-55ca-8b54-62055524640d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4385%252F16034385%252Finstrument_cluster-1773850472149.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4385/16034385/instrument_cluster-1773850472149.jpeg saved to cache
2026-03-29 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d77a75bd-e97f-55ca-8b54-62055524640d
2026-03-29 20:18:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20441350.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659af2b50>
2026-03-29 20:18:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d77a75bd-e97f-55ca-8b54-62055524640d/d77a75bd-e97f-55ca-8b54-62055524640d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4385%252F16034385%252Finterior_dashboard-1773850444279.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4385/16034385/interior_dashboard-1773850444279.jpeg saved to cache
2026-03-29 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d77a75bd-e97f-55ca-8b54-62055524640d
2026-03-29 20:18:57 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:18:57 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:18:57 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x008\xd3\x90\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x033:\x008\xc8\xfe\x00\x00\x00\x00'
2026-03-29 20:18:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c82490>
2026-03-29 20:18:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d77a75bd-e97f-55ca-8b54-62055524640d/d77a75bd-e97f-55ca-8b54-62055524640d_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4385%252F16034385%252Finterior_rear_seats-1773850830708.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4385/16034385/interior_rear_seats-1773850830708.jpeg saved to cache
2026-03-29 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d77a75bd-e97f-55ca-8b54-62055524640d
2026-03-29 20:18:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 152069bd-a3e6-5883-a516-a9dbc4d50fe9 with identifier: 20441350
2026-03-29 20:18:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 152069bd-a3e6-5883-a516-a9dbc4d50fe9 with scrape type 1
2026-03-29 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 152069bd-a3e6-5883-a516-a9dbc4d50fe9
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1350%252F20441350%252Fexterior_front_driver-1774713173245.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1350/20441350/exterior_front_driver-1774713173245.jpg not downloaded yet
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1350%252F20441350%252Fexterior_rear_driver-1774713202669.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1350/20441350/exterior_rear_driver-1774713202669.jpg not downloaded yet
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1350%252F20441350%252Fexterior_front_passenger-1774713428513.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1350/20441350/exterior_front_passenger-1774713428513.jpg not downloaded yet
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1350%252F20441350%252Fexterior_rear_passenger-1774713233552.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1350/20441350/exterior_rear_passenger-1774713233552.jpg not downloaded yet
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1350%252F20441350%252Finterior_front_seats-1774714032622.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1350/20441350/interior_front_seats-1774714032622.jpg not downloaded yet
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1350%252F20441350%252Finterior_rear_seats-1774714555204.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1350/20441350/interior_rear_seats-1774714555204.jpg not downloaded yet
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1350%252F20441350%252Finterior_dashboard-1774714143400.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1350/20441350/interior_dashboard-1774714143400.jpg not downloaded yet
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1350%252F20441350%252Finstrument_cluster-1774714165436.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1350/20441350/instrument_cluster-1774714165436.jpg not downloaded yet
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1350%252F20441350%252Finterior_boot-1774714559528.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1350/20441350/interior_boot-1774714559528.jpg not downloaded yet
2026-03-29 20:18:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4385/16034385/exterior_rear_passenger-1773854678534.jpeg> (referer: None)
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1350%252F20441350%252Fdocs_service_history-1774715112146.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D475ae978abb466f7aafec5a3863cde07%27 HTTP/1.1" 200 None
2026-03-29 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1350/20441350/docs_service_history-1774715112146.jpg?ixlib=js-3.8.0&auto=format&s=475ae978abb466f7aafec5a3863cde07 not downloaded yet
2026-03-29 20:18:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4385/16034385/interior_front_seats-1773850590078.jpeg> (referer: None)
2026-03-29 20:18:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584d71d0>
2026-03-29 20:18:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d77a75bd-e97f-55ca-8b54-62055524640d/d77a75bd-e97f-55ca-8b54-62055524640d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4385%252F16034385%252Fexterior_rear_passenger-1773854678534.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4385/16034385/exterior_rear_passenger-1773854678534.jpeg saved to cache
2026-03-29 20:18:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d77a75bd-e97f-55ca-8b54-62055524640d
2026-03-29 20:18:57 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:18:57 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:18:57 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x009$\xc6\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x037\xbb\x009\x1a4\x00\x00\x00\x00'
2026-03-29 20:18:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658706390>
2026-03-29 20:18:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d77a75bd-e97f-55ca-8b54-62055524640d/d77a75bd-e97f-55ca-8b54-62055524640d_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4385%252F16034385%252Finterior_front_seats-1773850590078.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4385/16034385/interior_front_seats-1773850590078.jpeg saved to cache
2026-03-29 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d77a75bd-e97f-55ca-8b54-62055524640d
2026-03-29 20:18:58 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.072(s), this was the 1st time calling it.
2026-03-29 20:18:58 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.078512934519559 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:18:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4385/16034385/exterior_rear_driver-1773854689441.jpeg> (referer: None)
2026-03-29 20:18:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4385/16034385/exterior_front_passenger-1773854646771.jpeg> (referer: None)
2026-03-29 20:18:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1350/20441350/instrument_cluster-1774714165436.jpg> (referer: None)
2026-03-29 20:18:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589f11d0>
2026-03-29 20:18:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d77a75bd-e97f-55ca-8b54-62055524640d/d77a75bd-e97f-55ca-8b54-62055524640d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4385%252F16034385%252Fexterior_rear_driver-1773854689441.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4385/16034385/exterior_rear_driver-1773854689441.jpeg saved to cache
2026-03-29 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d77a75bd-e97f-55ca-8b54-62055524640d
2026-03-29 20:18:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584d6590>
2026-03-29 20:18:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d77a75bd-e97f-55ca-8b54-62055524640d/d77a75bd-e97f-55ca-8b54-62055524640d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4385%252F16034385%252Fexterior_front_passenger-1773854646771.jpeg') HTTP/1.1" 204 0
2026-03-29 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4385/16034385/exterior_front_passenger-1773854646771.jpeg saved to cache
2026-03-29 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d77a75bd-e97f-55ca-8b54-62055524640d
2026-03-29 20:18:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be6a490>
2026-03-29 20:18:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_152069bd-a3e6-5883-a516-a9dbc4d50fe9/152069bd-a3e6-5883-a516-a9dbc4d50fe9_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1350%252F20441350%252Finstrument_cluster-1774714165436.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1350/20441350/instrument_cluster-1774714165436.jpg saved to cache
2026-03-29 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 152069bd-a3e6-5883-a516-a9dbc4d50fe9
2026-03-29 20:18:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19449183.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1296&page=36&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:18:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:18:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1350/20441350/docs_service_history-1774715112146.jpg?ixlib=js-3.8.0&auto=format&s=475ae978abb466f7aafec5a3863cde07> (referer: None)
2026-03-29 20:18:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1350/20441350/interior_dashboard-1774714143400.jpg> (referer: None)
2026-03-29 20:18:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 165fab30-47b2-5c74-ad11-21e7d0eabbd4 with identifier: 19449183
2026-03-29 20:18:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 165fab30-47b2-5c74-ad11-21e7d0eabbd4 with scrape type 1
2026-03-29 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 165fab30-47b2-5c74-ad11-21e7d0eabbd4
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9183%252F19449183%252Fexterior_front_driver-1774626161980.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9183/19449183/exterior_front_driver-1774626161980.jpg not downloaded yet
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9183%252F19449183%252Fexterior_rear_driver-1774370167472.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9183/19449183/exterior_rear_driver-1774370167472.jpg not downloaded yet
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9183%252F19449183%252Fexterior_front_passenger-1774370169891.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9183/19449183/exterior_front_passenger-1774370169891.jpg not downloaded yet
2026-03-29 20:18:58 [motorway.uk] INFO: Found listing with ID: 20488003
2026-03-29 20:18:58 [motorway.uk] INFO: Found listing with ID: 17841081
2026-03-29 20:18:58 [motorway.uk] INFO: Found listing with ID: 19220462
2026-03-29 20:18:58 [motorway.uk] INFO: Found listing with ID: 17874420
2026-03-29 20:18:58 [motorway.uk] INFO: Found listing with ID: 12473126
2026-03-29 20:18:58 [motorway.uk] INFO: Found listing with ID: 20404112
2026-03-29 20:18:58 [motorway.uk] INFO: Found listing with ID: 20463012
2026-03-29 20:18:58 [motorway.uk] INFO: Found listing with ID: 20141197
2026-03-29 20:18:58 [motorway.uk] INFO: Found listing with ID: 20384563
2026-03-29 20:18:58 [motorway.uk] INFO: Found listing with ID: 20411686
2026-03-29 20:18:58 [motorway.uk] INFO: Found listing with ID: 20130547
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720130547%27 HTTP/1.1" 200 None
2026-03-29 20:18:58 [motorway.uk] INFO: Scrape type for 20130547: 1
2026-03-29 20:18:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658daadd0>
2026-03-29 20:18:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_152069bd-a3e6-5883-a516-a9dbc4d50fe9/152069bd-a3e6-5883-a516-a9dbc4d50fe9_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1350%252F20441350%252Fdocs_service_history-1774715112146.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D475ae978abb466f7aafec5a3863cde07') HTTP/1.1" 204 0
2026-03-29 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1350/20441350/docs_service_history-1774715112146.jpg?ixlib=js-3.8.0&auto=format&s=475ae978abb466f7aafec5a3863cde07 saved to cache
2026-03-29 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 152069bd-a3e6-5883-a516-a9dbc4d50fe9
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9183%252F19449183%252Fexterior_rear_passenger-1774370165314.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9183/19449183/exterior_rear_passenger-1774370165314.jpg not downloaded yet
2026-03-29 20:18:58 [motorway.uk] INFO: Found listing with ID: 20484943
2026-03-29 20:18:58 [motorway.uk] INFO: Found listing with ID: 19189698
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719189698%27 HTTP/1.1" 200 None
2026-03-29 20:18:58 [motorway.uk] INFO: Scrape type for 19189698: 1
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9183%252F19449183%252Finterior_front_seats-1774626022018.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9183/19449183/interior_front_seats-1774626022018.jpg not downloaded yet
2026-03-29 20:18:58 [motorway.uk] INFO: Found listing with ID: 20485884
2026-03-29 20:18:58 [motorway.uk] INFO: Found listing with ID: 7586308
2026-03-29 20:18:58 [motorway.uk] INFO: Found listing with ID: 19750029
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719750029%27 HTTP/1.1" 200 None
2026-03-29 20:18:58 [motorway.uk] INFO: Scrape type for 19750029: 1
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9183%252F19449183%252Finterior_rear_seats-1774697024243.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9183/19449183/interior_rear_seats-1774697024243.jpg not downloaded yet
2026-03-29 20:18:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f04a50>
2026-03-29 20:18:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_152069bd-a3e6-5883-a516-a9dbc4d50fe9/152069bd-a3e6-5883-a516-a9dbc4d50fe9_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1350%252F20441350%252Finterior_dashboard-1774714143400.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1350/20441350/interior_dashboard-1774714143400.jpg saved to cache
2026-03-29 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 152069bd-a3e6-5883-a516-a9dbc4d50fe9
2026-03-29 20:18:59 [motorway.uk] INFO: Found listing with ID: 20454873
2026-03-29 20:18:59 [motorway.uk] INFO: Found listing with ID: 19243367
2026-03-29 20:18:59 [motorway.uk] INFO: Found listing with ID: 13628545
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713628545%27 HTTP/1.1" 200 None
2026-03-29 20:18:59 [motorway.uk] INFO: Scrape type for 13628545: 1
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9183%252F19449183%252Finterior_dashboard-1774626078427.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9183/19449183/interior_dashboard-1774626078427.jpg not downloaded yet
2026-03-29 20:18:59 [motorway.uk] INFO: Found listing with ID: 17857909
2026-03-29 20:18:59 [motorway.uk] INFO: Found listing with ID: 19991969
2026-03-29 20:18:59 [motorway.uk] INFO: Found listing with ID: 20483258
2026-03-29 20:18:59 [motorway.uk] INFO: Found listing with ID: 7888251
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277888251%27 HTTP/1.1" 200 None
2026-03-29 20:18:59 [motorway.uk] INFO: Scrape type for 7888251: 1
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9183%252F19449183%252Finstrument_cluster-1774626061193.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9183/19449183/instrument_cluster-1774626061193.jpg not downloaded yet
2026-03-29 20:18:59 [motorway.uk] INFO: Found listing with ID: 20436941
2026-03-29 20:18:59 [motorway.uk] INFO: Found listing with ID: 20471387
2026-03-29 20:18:59 [motorway.uk] INFO: Found listing with ID: 16024734
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716024734%27 HTTP/1.1" 200 None
2026-03-29 20:18:59 [motorway.uk] INFO: Scrape type for 16024734: 1
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9183%252F19449183%252Finterior_boot-1774626027216.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9183/19449183/interior_boot-1774626027216.jpg not downloaded yet
2026-03-29 20:18:59 [motorway.uk] INFO: Found listing with ID: 20492752
2026-03-29 20:18:59 [motorway.uk] INFO: Found listing with ID: 20492217
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720492217%27 HTTP/1.1" 200 None
2026-03-29 20:18:59 [motorway.uk] INFO: Scrape type for 20492217: 1
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9183%252F19449183%252Fdocs_service_history-1774627773936.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbd57c4b1c366e0f21493e6bf7172e4c8%27 HTTP/1.1" 200 None
2026-03-29 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9183/19449183/docs_service_history-1774627773936.png?ixlib=js-3.8.0&auto=format&s=bd57c4b1c366e0f21493e6bf7172e4c8 not downloaded yet
2026-03-29 20:18:59 [motorway.uk] INFO: Found listing with ID: 20435214
2026-03-29 20:18:59 [motorway.uk] INFO: Found listing with ID: 20461651
2026-03-29 20:18:59 [motorway.uk] INFO: Found listing with ID: 3723283
2026-03-29 20:18:59 [motorway.uk] INFO: Found listing with ID: 19401615
2026-03-29 20:18:59 [motorway.uk] INFO: Found listing with ID: 15388383
2026-03-29 20:18:59 [motorway.uk] INFO: Found listing with ID: 19433460
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719433460%27 HTTP/1.1" 200 None
2026-03-29 20:18:59 [motorway.uk] INFO: Scrape type for 19433460: 1
2026-03-29 20:18:59 [motorway.uk] INFO: Found listing with ID: 19935539
2026-03-29 20:18:59 [motorway.uk] INFO: Found listing with ID: 20490910
2026-03-29 20:18:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1350/20441350/interior_boot-1774714559528.jpg> (referer: None)
2026-03-29 20:18:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1350/20441350/exterior_rear_passenger-1774713233552.jpg> (referer: None)
2026-03-29 20:18:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1350/20441350/exterior_rear_driver-1774713202669.jpg> (referer: None)
2026-03-29 20:18:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1350/20441350/exterior_front_passenger-1774713428513.jpg> (referer: None)
2026-03-29 20:18:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1350/20441350/interior_front_seats-1774714032622.jpg> (referer: None)
2026-03-29 20:18:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1350/20441350/interior_rear_seats-1774714555204.jpg> (referer: None)
2026-03-29 20:18:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587f73d0>
2026-03-29 20:18:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_152069bd-a3e6-5883-a516-a9dbc4d50fe9/152069bd-a3e6-5883-a516-a9dbc4d50fe9_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1350%252F20441350%252Finterior_boot-1774714559528.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1350/20441350/interior_boot-1774714559528.jpg saved to cache
2026-03-29 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 152069bd-a3e6-5883-a516-a9dbc4d50fe9
2026-03-29 20:18:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598de810>
2026-03-29 20:18:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_152069bd-a3e6-5883-a516-a9dbc4d50fe9/152069bd-a3e6-5883-a516-a9dbc4d50fe9_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1350%252F20441350%252Fexterior_rear_passenger-1774713233552.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1350/20441350/exterior_rear_passenger-1774713233552.jpg saved to cache
2026-03-29 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 152069bd-a3e6-5883-a516-a9dbc4d50fe9
2026-03-29 20:18:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658aa2050>
2026-03-29 20:18:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_152069bd-a3e6-5883-a516-a9dbc4d50fe9/152069bd-a3e6-5883-a516-a9dbc4d50fe9_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1350%252F20441350%252Fexterior_rear_driver-1774713202669.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1350/20441350/exterior_rear_driver-1774713202669.jpg saved to cache
2026-03-29 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 152069bd-a3e6-5883-a516-a9dbc4d50fe9
2026-03-29 20:18:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a914d0>
2026-03-29 20:18:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_152069bd-a3e6-5883-a516-a9dbc4d50fe9/152069bd-a3e6-5883-a516-a9dbc4d50fe9_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1350%252F20441350%252Fexterior_front_passenger-1774713428513.jpg') HTTP/1.1" 204 0
2026-03-29 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1350/20441350/exterior_front_passenger-1774713428513.jpg saved to cache
2026-03-29 20:18:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 152069bd-a3e6-5883-a516-a9dbc4d50fe9
2026-03-29 20:18:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:18:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:18:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:18:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:18:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:18:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c72210>
2026-03-29 20:18:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:18:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_152069bd-a3e6-5883-a516-a9dbc4d50fe9/152069bd-a3e6-5883-a516-a9dbc4d50fe9_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:18:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1350%252F20441350%252Finterior_front_seats-1774714032622.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1350/20441350/interior_front_seats-1774714032622.jpg saved to cache
2026-03-29 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 152069bd-a3e6-5883-a516-a9dbc4d50fe9
2026-03-29 20:19:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d6a950>
2026-03-29 20:19:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_152069bd-a3e6-5883-a516-a9dbc4d50fe9/152069bd-a3e6-5883-a516-a9dbc4d50fe9_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1350%252F20441350%252Finterior_rear_seats-1774714555204.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1350/20441350/interior_rear_seats-1774714555204.jpg saved to cache
2026-03-29 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 152069bd-a3e6-5883-a516-a9dbc4d50fe9
2026-03-29 20:19:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9183/19449183/interior_boot-1774626027216.jpg> (referer: None)
2026-03-29 20:19:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9183/19449183/docs_service_history-1774627773936.png?ixlib=js-3.8.0&auto=format&s=bd57c4b1c366e0f21493e6bf7172e4c8> (referer: None)
2026-03-29 20:19:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:19:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c83a90>
2026-03-29 20:19:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165fab30-47b2-5c74-ad11-21e7d0eabbd4/165fab30-47b2-5c74-ad11-21e7d0eabbd4_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9183%252F19449183%252Finterior_boot-1774626027216.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9183/19449183/interior_boot-1774626027216.jpg saved to cache
2026-03-29 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 165fab30-47b2-5c74-ad11-21e7d0eabbd4
2026-03-29 20:19:00 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-29 20:19:00 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-29 20:19:00 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-29 20:19:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f695d0>
2026-03-29 20:19:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165fab30-47b2-5c74-ad11-21e7d0eabbd4/165fab30-47b2-5c74-ad11-21e7d0eabbd4_image_9.png HTTP/1.1" 201 0
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9183%252F19449183%252Fdocs_service_history-1774627773936.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbd57c4b1c366e0f21493e6bf7172e4c8') HTTP/1.1" 204 0
2026-03-29 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9183/19449183/docs_service_history-1774627773936.png?ixlib=js-3.8.0&auto=format&s=bd57c4b1c366e0f21493e6bf7172e4c8 saved to cache
2026-03-29 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 165fab30-47b2-5c74-ad11-21e7d0eabbd4
2026-03-29 20:19:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:19:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9183/19449183/instrument_cluster-1774626061193.jpg> (referer: None)
2026-03-29 20:19:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c83e50>
2026-03-29 20:19:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165fab30-47b2-5c74-ad11-21e7d0eabbd4/165fab30-47b2-5c74-ad11-21e7d0eabbd4_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9183%252F19449183%252Finstrument_cluster-1774626061193.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9183/19449183/instrument_cluster-1774626061193.jpg saved to cache
2026-03-29 20:19:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 165fab30-47b2-5c74-ad11-21e7d0eabbd4
2026-03-29 20:19:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9183/19449183/interior_dashboard-1774626078427.jpg> (referer: None)
2026-03-29 20:19:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658519590>
2026-03-29 20:19:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165fab30-47b2-5c74-ad11-21e7d0eabbd4/165fab30-47b2-5c74-ad11-21e7d0eabbd4_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9183%252F19449183%252Finterior_dashboard-1774626078427.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9183/19449183/interior_dashboard-1774626078427.jpg saved to cache
2026-03-29 20:19:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 165fab30-47b2-5c74-ad11-21e7d0eabbd4
2026-03-29 20:19:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20156998.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22b94fa2-3f97-5b55-9f2c-402e1843c343 with identifier: 20156998
2026-03-29 20:19:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22b94fa2-3f97-5b55-9f2c-402e1843c343 with scrape type 1
2026-03-29 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 22b94fa2-3f97-5b55-9f2c-402e1843c343
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6998%252F20156998%252Fexterior_front_driver-1774620137320.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6998/20156998/exterior_front_driver-1774620137320.jpg not downloaded yet
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6998%252F20156998%252Fexterior_rear_driver-1774620148121.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6998/20156998/exterior_rear_driver-1774620148121.jpg not downloaded yet
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6998%252F20156998%252Fexterior_front_passenger-1774620247501.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6998/20156998/exterior_front_passenger-1774620247501.jpg not downloaded yet
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6998%252F20156998%252Fexterior_rear_passenger-1774620233088.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6998/20156998/exterior_rear_passenger-1774620233088.jpg not downloaded yet
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6998%252F20156998%252Finterior_front_seats-1774621126189.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6998/20156998/interior_front_seats-1774621126189.jpg not downloaded yet
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6998%252F20156998%252Finterior_rear_seats-1774621150160.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6998/20156998/interior_rear_seats-1774621150160.jpg not downloaded yet
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6998%252F20156998%252Finterior_dashboard-1774621162276.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6998/20156998/interior_dashboard-1774621162276.jpg not downloaded yet
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6998%252F20156998%252Finstrument_cluster-1774621220566.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6998/20156998/instrument_cluster-1774621220566.jpg not downloaded yet
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6998%252F20156998%252Finterior_boot-1774621193536.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6998/20156998/interior_boot-1774621193536.jpg not downloaded yet
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6998%252F20156998%252Fdocs_service_history-1774621487853.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7d3453d6b9fba7e500b3d618b5f08a2b%27 HTTP/1.1" 200 None
2026-03-29 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6998/20156998/docs_service_history-1774621487853.jpg?ixlib=js-3.8.0&auto=format&s=7d3453d6b9fba7e500b3d618b5f08a2b not downloaded yet
2026-03-29 20:19:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9183/19449183/interior_rear_seats-1774697024243.jpg> (referer: None)
2026-03-29 20:19:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599fdad0>
2026-03-29 20:19:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165fab30-47b2-5c74-ad11-21e7d0eabbd4/165fab30-47b2-5c74-ad11-21e7d0eabbd4_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9183%252F19449183%252Finterior_rear_seats-1774697024243.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9183/19449183/interior_rear_seats-1774697024243.jpg saved to cache
2026-03-29 20:19:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 165fab30-47b2-5c74-ad11-21e7d0eabbd4
2026-03-29 20:19:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6998/20156998/docs_service_history-1774621487853.jpg?ixlib=js-3.8.0&auto=format&s=7d3453d6b9fba7e500b3d618b5f08a2b> (referer: None)
2026-03-29 20:19:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658b456d0>
2026-03-29 20:19:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b94fa2-3f97-5b55-9f2c-402e1843c343/22b94fa2-3f97-5b55-9f2c-402e1843c343_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6998%252F20156998%252Fdocs_service_history-1774621487853.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7d3453d6b9fba7e500b3d618b5f08a2b') HTTP/1.1" 204 0
2026-03-29 20:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6998/20156998/docs_service_history-1774621487853.jpg?ixlib=js-3.8.0&auto=format&s=7d3453d6b9fba7e500b3d618b5f08a2b saved to cache
2026-03-29 20:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 22b94fa2-3f97-5b55-9f2c-402e1843c343
2026-03-29 20:19:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6998/20156998/interior_boot-1774621193536.jpg> (referer: None)
2026-03-29 20:19:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:19:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a12b90>
2026-03-29 20:19:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b94fa2-3f97-5b55-9f2c-402e1843c343/22b94fa2-3f97-5b55-9f2c-402e1843c343_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6998%252F20156998%252Finterior_boot-1774621193536.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6998/20156998/interior_boot-1774621193536.jpg saved to cache
2026-03-29 20:19:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 22b94fa2-3f97-5b55-9f2c-402e1843c343
2026-03-29 20:19:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6998/20156998/instrument_cluster-1774621220566.jpg> (referer: None)
2026-03-29 20:19:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:19:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599fe4d0>
2026-03-29 20:19:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b94fa2-3f97-5b55-9f2c-402e1843c343/22b94fa2-3f97-5b55-9f2c-402e1843c343_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6998%252F20156998%252Finstrument_cluster-1774621220566.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6998/20156998/instrument_cluster-1774621220566.jpg saved to cache
2026-03-29 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 22b94fa2-3f97-5b55-9f2c-402e1843c343
2026-03-29 20:19:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:19:05 [scrapy.extensions.logstats] INFO: Crawled 308 pages (at 17 pages/min), scraped 160 items (at 9 items/min)
2026-03-29 20:19:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 304MiB
2026-03-29 20:19:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6998/20156998/interior_dashboard-1774621162276.jpg> (referer: None)
2026-03-29 20:19:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:19:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b67850>
2026-03-29 20:19:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b94fa2-3f97-5b55-9f2c-402e1843c343/22b94fa2-3f97-5b55-9f2c-402e1843c343_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6998%252F20156998%252Finterior_dashboard-1774621162276.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6998/20156998/interior_dashboard-1774621162276.jpg saved to cache
2026-03-29 20:19:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 22b94fa2-3f97-5b55-9f2c-402e1843c343
2026-03-29 20:19:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6998/20156998/interior_rear_seats-1774621150160.jpg> (referer: None)
2026-03-29 20:19:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:19:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfb6d10>
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b94fa2-3f97-5b55-9f2c-402e1843c343/22b94fa2-3f97-5b55-9f2c-402e1843c343_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6998%252F20156998%252Finterior_rear_seats-1774621150160.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6998/20156998/interior_rear_seats-1774621150160.jpg saved to cache
2026-03-29 20:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 22b94fa2-3f97-5b55-9f2c-402e1843c343
2026-03-29 20:19:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6998/20156998/interior_front_seats-1774621126189.jpg> (referer: None)
2026-03-29 20:19:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:19:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584d6550>
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b94fa2-3f97-5b55-9f2c-402e1843c343/22b94fa2-3f97-5b55-9f2c-402e1843c343_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6998%252F20156998%252Finterior_front_seats-1774621126189.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6998/20156998/interior_front_seats-1774621126189.jpg saved to cache
2026-03-29 20:19:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 22b94fa2-3f97-5b55-9f2c-402e1843c343
2026-03-29 20:19:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6998/20156998/exterior_rear_passenger-1774620233088.jpg> (referer: None)
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65bf15210>
2026-03-29 20:19:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b94fa2-3f97-5b55-9f2c-402e1843c343/22b94fa2-3f97-5b55-9f2c-402e1843c343_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6998%252F20156998%252Fexterior_rear_passenger-1774620233088.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6998/20156998/exterior_rear_passenger-1774620233088.jpg saved to cache
2026-03-29 20:19:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 22b94fa2-3f97-5b55-9f2c-402e1843c343
2026-03-29 20:19:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6998/20156998/exterior_front_passenger-1774620247501.jpg> (referer: None)
2026-03-29 20:19:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a10d50>
2026-03-29 20:19:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b94fa2-3f97-5b55-9f2c-402e1843c343/22b94fa2-3f97-5b55-9f2c-402e1843c343_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6998%252F20156998%252Fexterior_front_passenger-1774620247501.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6998/20156998/exterior_front_passenger-1774620247501.jpg saved to cache
2026-03-29 20:19:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 22b94fa2-3f97-5b55-9f2c-402e1843c343
2026-03-29 20:19:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6998/20156998/exterior_rear_driver-1774620148121.jpg> (referer: None)
2026-03-29 20:19:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582d4c90>
2026-03-29 20:19:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b94fa2-3f97-5b55-9f2c-402e1843c343/22b94fa2-3f97-5b55-9f2c-402e1843c343_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6998%252F20156998%252Fexterior_rear_driver-1774620148121.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6998/20156998/exterior_rear_driver-1774620148121.jpg saved to cache
2026-03-29 20:19:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 22b94fa2-3f97-5b55-9f2c-402e1843c343
2026-03-29 20:19:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6998/20156998/exterior_front_driver-1774620137320.jpg> (referer: None)
2026-03-29 20:19:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582d4dd0>
2026-03-29 20:19:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b94fa2-3f97-5b55-9f2c-402e1843c343/22b94fa2-3f97-5b55-9f2c-402e1843c343_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6998%252F20156998%252Fexterior_front_driver-1774620137320.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6998/20156998/exterior_front_driver-1774620137320.jpg saved to cache
2026-03-29 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 22b94fa2-3f97-5b55-9f2c-402e1843c343
2026-03-29 20:19:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 22b94fa2-3f97-5b55-9f2c-402e1843c343, skipping ID generation
2026-03-29 20:19:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22b94fa2-3f97-5b55-9f2c-402e1843c343 with scrape type 1
2026-03-29 20:19:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 22b94fa2-3f97-5b55-9f2c-402e1843c343 sending to next pipeline
2026-03-29 20:19:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 22b94fa2-3f97-5b55-9f2c-402e1843c343, identifier: 20156998
2026-03-29 20:19:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 22b94fa2-3f97-5b55-9f2c-402e1843c343 with identifier: 20156998
2026-03-29 20:19:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 22b94fa2-3f97-5b55-9f2c-402e1843c343 with identifier: 20156998
2026-03-29 20:19:08 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 22b94fa2-3f97-5b55-9f2c-402e1843c343 with identifier: 20156998 to the API
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6998/20156998/exterior_front_driver-1774620137320.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '22b94fa2-3f97-5b55-9f2c-402e1843c343',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'HN16 DZY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20156998',
'listing': 'auction',
'location': 'West Sussex Haywards Heath',
'make': 'BMW',
'model': 'X1',
'odometer': 79400,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b94fa2-3f97-5b55-9f2c-402e1843c343/22b94fa2-3f97-5b55-9f2c-402e1843c343_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2036200,
'Height': 2465,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6998/20156998/exterior_front_driver-1774620137320.jpg',
'Width': 3286},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b94fa2-3f97-5b55-9f2c-402e1843c343/22b94fa2-3f97-5b55-9f2c-402e1843c343_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2173905,
'Height': 2569,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6998/20156998/exterior_rear_driver-1774620148121.jpg',
'Width': 3425},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b94fa2-3f97-5b55-9f2c-402e1843c343/22b94fa2-3f97-5b55-9f2c-402e1843c343_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1679406,
'Height': 2366,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6998/20156998/exterior_front_passenger-1774620247501.jpg',
'Width': 3155},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b94fa2-3f97-5b55-9f2c-402e1843c343/22b94fa2-3f97-5b55-9f2c-402e1843c343_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1964341,
'Height': 2609,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6998/20156998/exterior_rear_passenger-1774620233088.jpg',
'Width': 3479},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b94fa2-3f97-5b55-9f2c-402e1843c343/22b94fa2-3f97-5b55-9f2c-402e1843c343_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4204337,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6998/20156998/interior_front_seats-1774621126189.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b94fa2-3f97-5b55-9f2c-402e1843c343/22b94fa2-3f97-5b55-9f2c-402e1843c343_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3656221,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6998/20156998/interior_rear_seats-1774621150160.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b94fa2-3f97-5b55-9f2c-402e1843c343/22b94fa2-3f97-5b55-9f2c-402e1843c343_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3786834,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6998/20156998/interior_dashboard-1774621162276.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b94fa2-3f97-5b55-9f2c-402e1843c343/22b94fa2-3f97-5b55-9f2c-402e1843c343_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2676097,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6998/20156998/instrument_cluster-1774621220566.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b94fa2-3f97-5b55-9f2c-402e1843c343/22b94fa2-3f97-5b55-9f2c-402e1843c343_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4561292,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6998/20156998/interior_boot-1774621193536.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b94fa2-3f97-5b55-9f2c-402e1843c343/22b94fa2-3f97-5b55-9f2c-402e1843c343_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 442448,
'Height': 1233,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6998/20156998/docs_service_history-1774621487853.jpg?ixlib=js-3.8.0&auto=format&s=7d3453d6b9fba7e500b3d618b5f08a2b',
'Width': 1529}],
'price': 8900,
'price_includes_vat': False,
'registration_date': '2016-03-31',
'seats_number': None,
'seller_name': None,
'title': 'BMW X1 xDrive 20d xLine Auto',
'transmission': 'automatic',
'trim': 'xDrive 20d xLine Auto',
'vin': 'WBAHU320805D19414',
'year': 2016}
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720156998%27 HTTP/1.1" 200 None
2026-03-29 20:19:08 [motorway.uk] INFO: Saving data for 20156998: {'created_time': 1774815548.903366, 'last_price_update_time': 1774815548.903378, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20156998') HTTP/1.1" 204 0
2026-03-29 20:19:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20325290.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea7d94ad-59b9-5b01-872a-79d1938325a0 with identifier: 20325290
2026-03-29 20:19:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea7d94ad-59b9-5b01-872a-79d1938325a0 with scrape type 1
2026-03-29 20:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ea7d94ad-59b9-5b01-872a-79d1938325a0
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5290%252F20325290%252Fexterior_front_driver-1774699202254.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5290/20325290/exterior_front_driver-1774699202254.jpg not downloaded yet
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5290%252F20325290%252Fexterior_rear_driver-1774699235534.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5290/20325290/exterior_rear_driver-1774699235534.jpg not downloaded yet
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5290%252F20325290%252Fexterior_front_passenger-1774699282707.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5290/20325290/exterior_front_passenger-1774699282707.jpg not downloaded yet
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5290%252F20325290%252Fexterior_rear_passenger-1774699260983.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5290/20325290/exterior_rear_passenger-1774699260983.jpg not downloaded yet
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5290%252F20325290%252Finterior_front_seats-1774705066264.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5290/20325290/interior_front_seats-1774705066264.jpg not downloaded yet
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5290%252F20325290%252Finterior_rear_seats-1774705086769.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5290/20325290/interior_rear_seats-1774705086769.jpg not downloaded yet
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5290%252F20325290%252Finterior_dashboard-1774705147988.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5290/20325290/interior_dashboard-1774705147988.jpg not downloaded yet
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5290%252F20325290%252Finstrument_cluster-1774705158990.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5290/20325290/instrument_cluster-1774705158990.jpg not downloaded yet
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5290%252F20325290%252Finterior_boot-1774705165031.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5290/20325290/interior_boot-1774705165031.jpg not downloaded yet
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5290%252F20325290%252Fdocs_service_history-1774719258303.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Debc9b81ab0e0a94e5cf3b4d9342e203c%27 HTTP/1.1" 200 None
2026-03-29 20:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5290/20325290/docs_service_history-1774719258303.jpg?ixlib=js-3.8.0&auto=format&s=ebc9b81ab0e0a94e5cf3b4d9342e203c not downloaded yet
2026-03-29 20:19:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9183/19449183/interior_front_seats-1774626022018.jpg> (referer: None)
2026-03-29 20:19:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658b2c210>
2026-03-29 20:19:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165fab30-47b2-5c74-ad11-21e7d0eabbd4/165fab30-47b2-5c74-ad11-21e7d0eabbd4_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9183%252F19449183%252Finterior_front_seats-1774626022018.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9183/19449183/interior_front_seats-1774626022018.jpg saved to cache
2026-03-29 20:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 165fab30-47b2-5c74-ad11-21e7d0eabbd4
2026-03-29 20:19:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5290/20325290/docs_service_history-1774719258303.jpg?ixlib=js-3.8.0&auto=format&s=ebc9b81ab0e0a94e5cf3b4d9342e203c> (referer: None)
2026-03-29 20:19:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c156d0>
2026-03-29 20:19:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea7d94ad-59b9-5b01-872a-79d1938325a0/ea7d94ad-59b9-5b01-872a-79d1938325a0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5290%252F20325290%252Fdocs_service_history-1774719258303.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Debc9b81ab0e0a94e5cf3b4d9342e203c') HTTP/1.1" 204 0
2026-03-29 20:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5290/20325290/docs_service_history-1774719258303.jpg?ixlib=js-3.8.0&auto=format&s=ebc9b81ab0e0a94e5cf3b4d9342e203c saved to cache
2026-03-29 20:19:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ea7d94ad-59b9-5b01-872a-79d1938325a0
2026-03-29 20:19:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5290/20325290/interior_boot-1774705165031.jpg> (referer: None)
2026-03-29 20:19:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658455650>
2026-03-29 20:19:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea7d94ad-59b9-5b01-872a-79d1938325a0/ea7d94ad-59b9-5b01-872a-79d1938325a0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5290%252F20325290%252Finterior_boot-1774705165031.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5290/20325290/interior_boot-1774705165031.jpg saved to cache
2026-03-29 20:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ea7d94ad-59b9-5b01-872a-79d1938325a0
2026-03-29 20:19:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5290/20325290/instrument_cluster-1774705158990.jpg> (referer: None)
2026-03-29 20:19:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658b2fc50>
2026-03-29 20:19:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea7d94ad-59b9-5b01-872a-79d1938325a0/ea7d94ad-59b9-5b01-872a-79d1938325a0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5290%252F20325290%252Finstrument_cluster-1774705158990.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5290/20325290/instrument_cluster-1774705158990.jpg saved to cache
2026-03-29 20:19:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ea7d94ad-59b9-5b01-872a-79d1938325a0
2026-03-29 20:19:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5290/20325290/interior_dashboard-1774705147988.jpg> (referer: None)
2026-03-29 20:19:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fecc90>
2026-03-29 20:19:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea7d94ad-59b9-5b01-872a-79d1938325a0/ea7d94ad-59b9-5b01-872a-79d1938325a0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:19:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5290%252F20325290%252Finterior_dashboard-1774705147988.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5290/20325290/interior_dashboard-1774705147988.jpg saved to cache
2026-03-29 20:19:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ea7d94ad-59b9-5b01-872a-79d1938325a0
2026-03-29 20:19:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5290/20325290/interior_rear_seats-1774705086769.jpg> (referer: None)
2026-03-29 20:19:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6580f9950>
2026-03-29 20:19:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea7d94ad-59b9-5b01-872a-79d1938325a0/ea7d94ad-59b9-5b01-872a-79d1938325a0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5290%252F20325290%252Finterior_rear_seats-1774705086769.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5290/20325290/interior_rear_seats-1774705086769.jpg saved to cache
2026-03-29 20:19:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ea7d94ad-59b9-5b01-872a-79d1938325a0
2026-03-29 20:19:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5290/20325290/interior_front_seats-1774705066264.jpg> (referer: None)
2026-03-29 20:19:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658456690>
2026-03-29 20:19:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea7d94ad-59b9-5b01-872a-79d1938325a0/ea7d94ad-59b9-5b01-872a-79d1938325a0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5290%252F20325290%252Finterior_front_seats-1774705066264.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5290/20325290/interior_front_seats-1774705066264.jpg saved to cache
2026-03-29 20:19:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ea7d94ad-59b9-5b01-872a-79d1938325a0
2026-03-29 20:19:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5290/20325290/exterior_rear_passenger-1774699260983.jpg> (referer: None)
2026-03-29 20:19:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c15ed0>
2026-03-29 20:19:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea7d94ad-59b9-5b01-872a-79d1938325a0/ea7d94ad-59b9-5b01-872a-79d1938325a0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5290%252F20325290%252Fexterior_rear_passenger-1774699260983.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5290/20325290/exterior_rear_passenger-1774699260983.jpg saved to cache
2026-03-29 20:19:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ea7d94ad-59b9-5b01-872a-79d1938325a0
2026-03-29 20:19:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5290/20325290/exterior_front_passenger-1774699282707.jpg> (referer: None)
2026-03-29 20:19:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658457f50>
2026-03-29 20:19:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea7d94ad-59b9-5b01-872a-79d1938325a0/ea7d94ad-59b9-5b01-872a-79d1938325a0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5290%252F20325290%252Fexterior_front_passenger-1774699282707.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5290/20325290/exterior_front_passenger-1774699282707.jpg saved to cache
2026-03-29 20:19:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ea7d94ad-59b9-5b01-872a-79d1938325a0
2026-03-29 20:19:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5290/20325290/exterior_rear_driver-1774699235534.jpg> (referer: None)
2026-03-29 20:19:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6580fa390>
2026-03-29 20:19:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea7d94ad-59b9-5b01-872a-79d1938325a0/ea7d94ad-59b9-5b01-872a-79d1938325a0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5290%252F20325290%252Fexterior_rear_driver-1774699235534.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5290/20325290/exterior_rear_driver-1774699235534.jpg saved to cache
2026-03-29 20:19:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ea7d94ad-59b9-5b01-872a-79d1938325a0
2026-03-29 20:19:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5290/20325290/exterior_front_driver-1774699202254.jpg> (referer: None)
2026-03-29 20:19:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658455e10>
2026-03-29 20:19:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea7d94ad-59b9-5b01-872a-79d1938325a0/ea7d94ad-59b9-5b01-872a-79d1938325a0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5290%252F20325290%252Fexterior_front_driver-1774699202254.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5290/20325290/exterior_front_driver-1774699202254.jpg saved to cache
2026-03-29 20:19:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea7d94ad-59b9-5b01-872a-79d1938325a0
2026-03-29 20:19:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea7d94ad-59b9-5b01-872a-79d1938325a0, skipping ID generation
2026-03-29 20:19:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea7d94ad-59b9-5b01-872a-79d1938325a0 with scrape type 1
2026-03-29 20:19:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea7d94ad-59b9-5b01-872a-79d1938325a0 sending to next pipeline
2026-03-29 20:19:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ea7d94ad-59b9-5b01-872a-79d1938325a0, identifier: 20325290
2026-03-29 20:19:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ea7d94ad-59b9-5b01-872a-79d1938325a0 with identifier: 20325290
2026-03-29 20:19:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ea7d94ad-59b9-5b01-872a-79d1938325a0 with identifier: 20325290
2026-03-29 20:19:14 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ea7d94ad-59b9-5b01-872a-79d1938325a0 with identifier: 20325290 to the API
2026-03-29 20:19:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5290/20325290/exterior_front_driver-1774699202254.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'ea7d94ad-59b9-5b01-872a-79d1938325a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SP22 TZU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20325290',
'listing': 'auction',
'location': 'Perth and Kinross Perth',
'make': 'Audi',
'model': 'A3',
'odometer': 63773,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea7d94ad-59b9-5b01-872a-79d1938325a0/ea7d94ad-59b9-5b01-872a-79d1938325a0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1495817,
'Height': 2606,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5290/20325290/exterior_front_driver-1774699202254.jpg',
'Width': 3475},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea7d94ad-59b9-5b01-872a-79d1938325a0/ea7d94ad-59b9-5b01-872a-79d1938325a0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1225861,
'Height': 2387,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5290/20325290/exterior_rear_driver-1774699235534.jpg',
'Width': 3182},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea7d94ad-59b9-5b01-872a-79d1938325a0/ea7d94ad-59b9-5b01-872a-79d1938325a0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1396825,
'Height': 2483,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5290/20325290/exterior_front_passenger-1774699282707.jpg',
'Width': 3311},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea7d94ad-59b9-5b01-872a-79d1938325a0/ea7d94ad-59b9-5b01-872a-79d1938325a0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1205771,
'Height': 2363,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5290/20325290/exterior_rear_passenger-1774699260983.jpg',
'Width': 3151},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea7d94ad-59b9-5b01-872a-79d1938325a0/ea7d94ad-59b9-5b01-872a-79d1938325a0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2720055,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5290/20325290/interior_front_seats-1774705066264.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea7d94ad-59b9-5b01-872a-79d1938325a0/ea7d94ad-59b9-5b01-872a-79d1938325a0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3772986,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5290/20325290/interior_rear_seats-1774705086769.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea7d94ad-59b9-5b01-872a-79d1938325a0/ea7d94ad-59b9-5b01-872a-79d1938325a0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1398463,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5290/20325290/interior_dashboard-1774705147988.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea7d94ad-59b9-5b01-872a-79d1938325a0/ea7d94ad-59b9-5b01-872a-79d1938325a0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2547041,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5290/20325290/instrument_cluster-1774705158990.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea7d94ad-59b9-5b01-872a-79d1938325a0/ea7d94ad-59b9-5b01-872a-79d1938325a0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4720194,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5290/20325290/interior_boot-1774705165031.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea7d94ad-59b9-5b01-872a-79d1938325a0/ea7d94ad-59b9-5b01-872a-79d1938325a0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 144605,
'Height': 2048,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5290/20325290/docs_service_history-1774719258303.jpg?ixlib=js-3.8.0&auto=format&s=ebc9b81ab0e0a94e5cf3b4d9342e203c',
'Width': 942}],
'price': 18414,
'price_includes_vat': False,
'registration_date': '2022-03-01',
'seats_number': None,
'seller_name': None,
'title': 'Audi A3 S Line ED 1 35 TFSI MHEV SA',
'transmission': 'automatic',
'trim': 'S Line ED 1 35 TFSI MHEV SA',
'vin': 'WAUZZZGY0NA049159',
'year': 2022}
2026-03-29 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720325290%27 HTTP/1.1" 200 None
2026-03-29 20:19:14 [motorway.uk] INFO: Saving data for 20325290: {'created_time': 1774815554.628912, 'last_price_update_time': 1774815554.628923, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20325290') HTTP/1.1" 204 0
2026-03-29 20:19:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20492344.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53c09e6d-30ad-5aae-a0e5-51a9cb2daee0 with identifier: 20492344
2026-03-29 20:19:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53c09e6d-30ad-5aae-a0e5-51a9cb2daee0 with scrape type 1
2026-03-29 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 53c09e6d-30ad-5aae-a0e5-51a9cb2daee0
2026-03-29 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2344%252F20492344%252Fexterior_front_driver-1774715922776.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2344/20492344/exterior_front_driver-1774715922776.jpg not downloaded yet
2026-03-29 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2344%252F20492344%252Fexterior_rear_driver-1774715927523.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2344/20492344/exterior_rear_driver-1774715927523.jpg not downloaded yet
2026-03-29 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2344%252F20492344%252Fexterior_front_passenger-1774715924912.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2344/20492344/exterior_front_passenger-1774715924912.jpg not downloaded yet
2026-03-29 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2344%252F20492344%252Fexterior_rear_passenger-1774715926478.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2344/20492344/exterior_rear_passenger-1774715926478.jpg not downloaded yet
2026-03-29 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2344%252F20492344%252Finterior_front_seats-1774716576104.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2344/20492344/interior_front_seats-1774716576104.jpg not downloaded yet
2026-03-29 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2344%252F20492344%252Finterior_rear_seats-1774716571730.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2344/20492344/interior_rear_seats-1774716571730.jpg not downloaded yet
2026-03-29 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2344%252F20492344%252Finterior_dashboard-1774716584498.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2344/20492344/interior_dashboard-1774716584498.jpg not downloaded yet
2026-03-29 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2344%252F20492344%252Finstrument_cluster-1774716554884.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2344/20492344/instrument_cluster-1774716554884.jpg not downloaded yet
2026-03-29 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2344%252F20492344%252Finterior_boot-1774775535786.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2344/20492344/interior_boot-1774775535786.jpg not downloaded yet
2026-03-29 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2344%252F20492344%252Fdocs_service_history-1774716817465.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D586f69be3d9178b3b262ec9397645268%27 HTTP/1.1" 200 None
2026-03-29 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2344/20492344/docs_service_history-1774716817465.jpg?ixlib=js-3.8.0&auto=format&s=586f69be3d9178b3b262ec9397645268 not downloaded yet
2026-03-29 20:19:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9183/19449183/exterior_rear_passenger-1774370165314.jpg> (referer: None)
2026-03-29 20:19:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589f1010>
2026-03-29 20:19:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165fab30-47b2-5c74-ad11-21e7d0eabbd4/165fab30-47b2-5c74-ad11-21e7d0eabbd4_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9183%252F19449183%252Fexterior_rear_passenger-1774370165314.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9183/19449183/exterior_rear_passenger-1774370165314.jpg saved to cache
2026-03-29 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 165fab30-47b2-5c74-ad11-21e7d0eabbd4
2026-03-29 20:19:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2344/20492344/docs_service_history-1774716817465.jpg?ixlib=js-3.8.0&auto=format&s=586f69be3d9178b3b262ec9397645268> (referer: None)
2026-03-29 20:19:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658465cd0>
2026-03-29 20:19:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c09e6d-30ad-5aae-a0e5-51a9cb2daee0/53c09e6d-30ad-5aae-a0e5-51a9cb2daee0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2344%252F20492344%252Fdocs_service_history-1774716817465.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D586f69be3d9178b3b262ec9397645268') HTTP/1.1" 204 0
2026-03-29 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2344/20492344/docs_service_history-1774716817465.jpg?ixlib=js-3.8.0&auto=format&s=586f69be3d9178b3b262ec9397645268 saved to cache
2026-03-29 20:19:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 53c09e6d-30ad-5aae-a0e5-51a9cb2daee0
2026-03-29 20:19:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2344/20492344/interior_boot-1774775535786.jpg> (referer: None)
2026-03-29 20:19:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c17590>
2026-03-29 20:19:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c09e6d-30ad-5aae-a0e5-51a9cb2daee0/53c09e6d-30ad-5aae-a0e5-51a9cb2daee0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2344%252F20492344%252Finterior_boot-1774775535786.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2344/20492344/interior_boot-1774775535786.jpg saved to cache
2026-03-29 20:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 53c09e6d-30ad-5aae-a0e5-51a9cb2daee0
2026-03-29 20:19:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2344/20492344/instrument_cluster-1774716554884.jpg> (referer: None)
2026-03-29 20:19:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589f3750>
2026-03-29 20:19:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c09e6d-30ad-5aae-a0e5-51a9cb2daee0/53c09e6d-30ad-5aae-a0e5-51a9cb2daee0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2344%252F20492344%252Finstrument_cluster-1774716554884.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2344/20492344/instrument_cluster-1774716554884.jpg saved to cache
2026-03-29 20:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 53c09e6d-30ad-5aae-a0e5-51a9cb2daee0
2026-03-29 20:19:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2344/20492344/interior_dashboard-1774716584498.jpg> (referer: None)
2026-03-29 20:19:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf2fa90>
2026-03-29 20:19:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c09e6d-30ad-5aae-a0e5-51a9cb2daee0/53c09e6d-30ad-5aae-a0e5-51a9cb2daee0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2344%252F20492344%252Finterior_dashboard-1774716584498.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2344/20492344/interior_dashboard-1774716584498.jpg saved to cache
2026-03-29 20:19:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 53c09e6d-30ad-5aae-a0e5-51a9cb2daee0
2026-03-29 20:19:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20405306.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df648eb3-1a94-5daf-8e95-6de952213613 with identifier: 20405306
2026-03-29 20:19:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df648eb3-1a94-5daf-8e95-6de952213613 with scrape type 1
2026-03-29 20:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item df648eb3-1a94-5daf-8e95-6de952213613
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5306%252F20405306%252Fexterior_front_driver-1774438241899.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5306/20405306/exterior_front_driver-1774438241899.jpg not downloaded yet
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5306%252F20405306%252Fexterior_rear_driver-1774691150573.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5306/20405306/exterior_rear_driver-1774691150573.jpg not downloaded yet
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5306%252F20405306%252Fexterior_front_passenger-1774438291612.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5306/20405306/exterior_front_passenger-1774438291612.jpg not downloaded yet
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5306%252F20405306%252Fexterior_rear_passenger-1774691162560.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5306/20405306/exterior_rear_passenger-1774691162560.jpg not downloaded yet
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5306%252F20405306%252Finterior_front_seats-1774691180313.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5306/20405306/interior_front_seats-1774691180313.jpg not downloaded yet
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5306%252F20405306%252Finterior_rear_seats-1774691183903.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5306/20405306/interior_rear_seats-1774691183903.jpg not downloaded yet
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5306%252F20405306%252Finterior_dashboard-1774691198351.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5306/20405306/interior_dashboard-1774691198351.jpg not downloaded yet
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5306%252F20405306%252Finstrument_cluster-1774459258481.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5306/20405306/instrument_cluster-1774459258481.jpg not downloaded yet
2026-03-29 20:19:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2344/20492344/interior_rear_seats-1774716571730.jpg> (referer: None)
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5306%252F20405306%252Finterior_boot-1774460653872.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5306/20405306/interior_boot-1774460653872.jpg not downloaded yet
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5306%252F20405306%252Fdocs_service_history-1774464380828.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd37502a20f7962b3e850c31305fc17b5%27 HTTP/1.1" 200 None
2026-03-29 20:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5306/20405306/docs_service_history-1774464380828.jpg?ixlib=js-3.8.0&auto=format&s=d37502a20f7962b3e850c31305fc17b5 not downloaded yet
2026-03-29 20:19:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2344/20492344/interior_front_seats-1774716576104.jpg> (referer: None)
2026-03-29 20:19:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ff4e50>
2026-03-29 20:19:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c09e6d-30ad-5aae-a0e5-51a9cb2daee0/53c09e6d-30ad-5aae-a0e5-51a9cb2daee0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2344%252F20492344%252Finterior_rear_seats-1774716571730.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2344/20492344/interior_rear_seats-1774716571730.jpg saved to cache
2026-03-29 20:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 53c09e6d-30ad-5aae-a0e5-51a9cb2daee0
2026-03-29 20:19:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ff6b90>
2026-03-29 20:19:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c09e6d-30ad-5aae-a0e5-51a9cb2daee0/53c09e6d-30ad-5aae-a0e5-51a9cb2daee0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2344%252F20492344%252Finterior_front_seats-1774716576104.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2344/20492344/interior_front_seats-1774716576104.jpg saved to cache
2026-03-29 20:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 53c09e6d-30ad-5aae-a0e5-51a9cb2daee0
2026-03-29 20:19:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5306/20405306/instrument_cluster-1774459258481.jpg> (referer: None)
2026-03-29 20:19:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658158110>
2026-03-29 20:19:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df648eb3-1a94-5daf-8e95-6de952213613/df648eb3-1a94-5daf-8e95-6de952213613_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5306%252F20405306%252Finstrument_cluster-1774459258481.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5306/20405306/instrument_cluster-1774459258481.jpg saved to cache
2026-03-29 20:19:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item df648eb3-1a94-5daf-8e95-6de952213613
2026-03-29 20:19:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5306/20405306/docs_service_history-1774464380828.jpg?ixlib=js-3.8.0&auto=format&s=d37502a20f7962b3e850c31305fc17b5> (referer: None)
2026-03-29 20:19:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ff6250>
2026-03-29 20:19:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df648eb3-1a94-5daf-8e95-6de952213613/df648eb3-1a94-5daf-8e95-6de952213613_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5306%252F20405306%252Fdocs_service_history-1774464380828.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd37502a20f7962b3e850c31305fc17b5') HTTP/1.1" 204 0
2026-03-29 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5306/20405306/docs_service_history-1774464380828.jpg?ixlib=js-3.8.0&auto=format&s=d37502a20f7962b3e850c31305fc17b5 saved to cache
2026-03-29 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item df648eb3-1a94-5daf-8e95-6de952213613
2026-03-29 20:19:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5306/20405306/interior_dashboard-1774691198351.jpg> (referer: None)
2026-03-29 20:19:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5306/20405306/interior_boot-1774460653872.jpg> (referer: None)
2026-03-29 20:19:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ac5d10>
2026-03-29 20:19:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df648eb3-1a94-5daf-8e95-6de952213613/df648eb3-1a94-5daf-8e95-6de952213613_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5306%252F20405306%252Finterior_dashboard-1774691198351.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5306/20405306/interior_dashboard-1774691198351.jpg saved to cache
2026-03-29 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item df648eb3-1a94-5daf-8e95-6de952213613
2026-03-29 20:19:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5306/20405306/interior_rear_seats-1774691183903.jpg> (referer: None)
2026-03-29 20:19:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ff6f90>
2026-03-29 20:19:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df648eb3-1a94-5daf-8e95-6de952213613/df648eb3-1a94-5daf-8e95-6de952213613_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5306%252F20405306%252Finterior_boot-1774460653872.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5306/20405306/interior_boot-1774460653872.jpg saved to cache
2026-03-29 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item df648eb3-1a94-5daf-8e95-6de952213613
2026-03-29 20:19:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587f6ad0>
2026-03-29 20:19:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df648eb3-1a94-5daf-8e95-6de952213613/df648eb3-1a94-5daf-8e95-6de952213613_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5306%252F20405306%252Finterior_rear_seats-1774691183903.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5306/20405306/interior_rear_seats-1774691183903.jpg saved to cache
2026-03-29 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item df648eb3-1a94-5daf-8e95-6de952213613
2026-03-29 20:19:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5306/20405306/exterior_rear_passenger-1774691162560.jpg> (referer: None)
2026-03-29 20:19:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5306/20405306/interior_front_seats-1774691180313.jpg> (referer: None)
2026-03-29 20:19:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d58190>
2026-03-29 20:19:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df648eb3-1a94-5daf-8e95-6de952213613/df648eb3-1a94-5daf-8e95-6de952213613_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5306%252F20405306%252Fexterior_rear_passenger-1774691162560.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5306/20405306/exterior_rear_passenger-1774691162560.jpg saved to cache
2026-03-29 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item df648eb3-1a94-5daf-8e95-6de952213613
2026-03-29 20:19:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d5be50>
2026-03-29 20:19:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df648eb3-1a94-5daf-8e95-6de952213613/df648eb3-1a94-5daf-8e95-6de952213613_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5306%252F20405306%252Finterior_front_seats-1774691180313.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5306/20405306/interior_front_seats-1774691180313.jpg saved to cache
2026-03-29 20:19:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item df648eb3-1a94-5daf-8e95-6de952213613
2026-03-29 20:19:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5306/20405306/exterior_rear_driver-1774691150573.jpg> (referer: None)
2026-03-29 20:19:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5306/20405306/exterior_front_passenger-1774438291612.jpg> (referer: None)
2026-03-29 20:19:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5306/20405306/exterior_front_driver-1774438241899.jpg> (referer: None)
2026-03-29 20:19:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586ea390>
2026-03-29 20:19:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df648eb3-1a94-5daf-8e95-6de952213613/df648eb3-1a94-5daf-8e95-6de952213613_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5306%252F20405306%252Fexterior_rear_driver-1774691150573.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5306/20405306/exterior_rear_driver-1774691150573.jpg saved to cache
2026-03-29 20:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df648eb3-1a94-5daf-8e95-6de952213613
2026-03-29 20:19:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fa9050>
2026-03-29 20:19:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df648eb3-1a94-5daf-8e95-6de952213613/df648eb3-1a94-5daf-8e95-6de952213613_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5306%252F20405306%252Fexterior_front_passenger-1774438291612.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5306/20405306/exterior_front_passenger-1774438291612.jpg saved to cache
2026-03-29 20:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df648eb3-1a94-5daf-8e95-6de952213613
2026-03-29 20:19:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586eab50>
2026-03-29 20:19:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df648eb3-1a94-5daf-8e95-6de952213613/df648eb3-1a94-5daf-8e95-6de952213613_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5306%252F20405306%252Fexterior_front_driver-1774438241899.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5306/20405306/exterior_front_driver-1774438241899.jpg saved to cache
2026-03-29 20:19:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df648eb3-1a94-5daf-8e95-6de952213613
2026-03-29 20:19:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df648eb3-1a94-5daf-8e95-6de952213613, skipping ID generation
2026-03-29 20:19:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df648eb3-1a94-5daf-8e95-6de952213613 with scrape type 1
2026-03-29 20:19:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df648eb3-1a94-5daf-8e95-6de952213613 sending to next pipeline
2026-03-29 20:19:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: df648eb3-1a94-5daf-8e95-6de952213613, identifier: 20405306
2026-03-29 20:19:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: df648eb3-1a94-5daf-8e95-6de952213613 with identifier: 20405306
2026-03-29 20:19:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: df648eb3-1a94-5daf-8e95-6de952213613 with identifier: 20405306
2026-03-29 20:19:19 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: df648eb3-1a94-5daf-8e95-6de952213613 with identifier: 20405306 to the API
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5306/20405306/exterior_front_driver-1774438241899.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'df648eb3-1a94-5daf-8e95-6de952213613',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'YK67 CHW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20405306',
'listing': 'auction',
'location': 'Hampshire Eastleigh',
'make': 'BMW',
'model': '1 Series',
'odometer': 76000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df648eb3-1a94-5daf-8e95-6de952213613/df648eb3-1a94-5daf-8e95-6de952213613_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 975838,
'Height': 2504,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5306/20405306/exterior_front_driver-1774438241899.jpg',
'Width': 3339},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df648eb3-1a94-5daf-8e95-6de952213613/df648eb3-1a94-5daf-8e95-6de952213613_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1268993,
'Height': 2561,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5306/20405306/exterior_rear_driver-1774691150573.jpg',
'Width': 3415},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df648eb3-1a94-5daf-8e95-6de952213613/df648eb3-1a94-5daf-8e95-6de952213613_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 903540,
'Height': 2467,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5306/20405306/exterior_front_passenger-1774438291612.jpg',
'Width': 3289},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df648eb3-1a94-5daf-8e95-6de952213613/df648eb3-1a94-5daf-8e95-6de952213613_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1088960,
'Height': 2522,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5306/20405306/exterior_rear_passenger-1774691162560.jpg',
'Width': 3363},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df648eb3-1a94-5daf-8e95-6de952213613/df648eb3-1a94-5daf-8e95-6de952213613_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2011833,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5306/20405306/interior_front_seats-1774691180313.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df648eb3-1a94-5daf-8e95-6de952213613/df648eb3-1a94-5daf-8e95-6de952213613_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1760797,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5306/20405306/interior_rear_seats-1774691183903.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df648eb3-1a94-5daf-8e95-6de952213613/df648eb3-1a94-5daf-8e95-6de952213613_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1887050,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5306/20405306/interior_dashboard-1774691198351.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df648eb3-1a94-5daf-8e95-6de952213613/df648eb3-1a94-5daf-8e95-6de952213613_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1933515,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5306/20405306/instrument_cluster-1774459258481.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df648eb3-1a94-5daf-8e95-6de952213613/df648eb3-1a94-5daf-8e95-6de952213613_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2102617,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5306/20405306/interior_boot-1774460653872.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df648eb3-1a94-5daf-8e95-6de952213613/df648eb3-1a94-5daf-8e95-6de952213613_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 392868,
'Height': 2859,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5306/20405306/docs_service_history-1774464380828.jpg?ixlib=js-3.8.0&auto=format&s=d37502a20f7962b3e850c31305fc17b5',
'Width': 2030}],
'price': 6789,
'price_includes_vat': False,
'registration_date': '2018-02-26',
'seats_number': None,
'seller_name': None,
'title': 'BMW 118D Sport',
'transmission': 'manual',
'trim': '118D Sport',
'vin': 'WBA1S52080V875366',
'year': 2018}
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720405306%27 HTTP/1.1" 200 None
2026-03-29 20:19:19 [motorway.uk] INFO: Saving data for 20405306: {'created_time': 1774815559.889749, 'last_price_update_time': 1774815559.88976, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20405306') HTTP/1.1" 204 0
2026-03-29 20:19:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2344/20492344/exterior_rear_passenger-1774715926478.jpg> (referer: None)
2026-03-29 20:19:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2344/20492344/exterior_front_passenger-1774715924912.jpg> (referer: None)
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a6a450>
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c09e6d-30ad-5aae-a0e5-51a9cb2daee0/53c09e6d-30ad-5aae-a0e5-51a9cb2daee0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2344%252F20492344%252Fexterior_rear_passenger-1774715926478.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2344/20492344/exterior_rear_passenger-1774715926478.jpg saved to cache
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 53c09e6d-30ad-5aae-a0e5-51a9cb2daee0
2026-03-29 20:19:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20485412.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fabe90>
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c09e6d-30ad-5aae-a0e5-51a9cb2daee0/53c09e6d-30ad-5aae-a0e5-51a9cb2daee0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2344%252F20492344%252Fexterior_front_passenger-1774715924912.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2344/20492344/exterior_front_passenger-1774715924912.jpg saved to cache
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 53c09e6d-30ad-5aae-a0e5-51a9cb2daee0
2026-03-29 20:19:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2344/20492344/exterior_front_driver-1774715922776.jpg> (referer: None)
2026-03-29 20:19:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f72adb02-1a63-5603-8014-b93d7ada819f with identifier: 20485412
2026-03-29 20:19:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f72adb02-1a63-5603-8014-b93d7ada819f with scrape type 1
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f72adb02-1a63-5603-8014-b93d7ada819f
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5412%252F20485412%252Fexterior_front_driver-1774695015244.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5412/20485412/exterior_front_driver-1774695015244.jpg not downloaded yet
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5412%252F20485412%252Fexterior_rear_driver-1774695017464.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5412/20485412/exterior_rear_driver-1774695017464.jpg not downloaded yet
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5412%252F20485412%252Fexterior_front_passenger-1774697101182.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5412/20485412/exterior_front_passenger-1774697101182.jpg not downloaded yet
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5412%252F20485412%252Fexterior_rear_passenger-1774695013428.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5412/20485412/exterior_rear_passenger-1774695013428.jpg not downloaded yet
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5412%252F20485412%252Finterior_front_seats-1774695789280.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5412/20485412/interior_front_seats-1774695789280.jpg not downloaded yet
2026-03-29 20:19:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2344/20492344/exterior_rear_driver-1774715927523.jpg> (referer: None)
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658751b50>
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c09e6d-30ad-5aae-a0e5-51a9cb2daee0/53c09e6d-30ad-5aae-a0e5-51a9cb2daee0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2344%252F20492344%252Fexterior_front_driver-1774715922776.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2344/20492344/exterior_front_driver-1774715922776.jpg saved to cache
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53c09e6d-30ad-5aae-a0e5-51a9cb2daee0
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5412%252F20485412%252Finterior_rear_seats-1774696126285.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5412/20485412/interior_rear_seats-1774696126285.jpg not downloaded yet
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5412%252F20485412%252Finterior_dashboard-1774697090002.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5412/20485412/interior_dashboard-1774697090002.jpg not downloaded yet
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5412%252F20485412%252Finstrument_cluster-1774695804531.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5412/20485412/instrument_cluster-1774695804531.jpg not downloaded yet
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5412%252F20485412%252Finterior_boot-1774695785898.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5412/20485412/interior_boot-1774695785898.jpg not downloaded yet
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be52d50>
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53c09e6d-30ad-5aae-a0e5-51a9cb2daee0/53c09e6d-30ad-5aae-a0e5-51a9cb2daee0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2344%252F20492344%252Fexterior_rear_driver-1774715927523.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2344/20492344/exterior_rear_driver-1774715927523.jpg saved to cache
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 53c09e6d-30ad-5aae-a0e5-51a9cb2daee0
2026-03-29 20:19:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53c09e6d-30ad-5aae-a0e5-51a9cb2daee0, skipping ID generation
2026-03-29 20:19:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53c09e6d-30ad-5aae-a0e5-51a9cb2daee0 with scrape type 1
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53c09e6d-30ad-5aae-a0e5-51a9cb2daee0 sending to next pipeline
2026-03-29 20:19:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 53c09e6d-30ad-5aae-a0e5-51a9cb2daee0, identifier: 20492344
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5412%252F20485412%252Fdocs_service_history-1774696444073.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D71d07c9da95aa95b22984c97ae5abdd1%27 HTTP/1.1" 200 None
2026-03-29 20:19:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5412/20485412/docs_service_history-1774696444073.jpg?ixlib=js-3.8.0&auto=format&s=71d07c9da95aa95b22984c97ae5abdd1 not downloaded yet
2026-03-29 20:19:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 53c09e6d-30ad-5aae-a0e5-51a9cb2daee0 with identifier: 20492344
2026-03-29 20:19:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 53c09e6d-30ad-5aae-a0e5-51a9cb2daee0 with identifier: 20492344
2026-03-29 20:19:20 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 53c09e6d-30ad-5aae-a0e5-51a9cb2daee0 with identifier: 20492344 to the API
2026-03-29 20:19:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2344/20492344/exterior_rear_driver-1774715927523.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '53c09e6d-30ad-5aae-a0e5-51a9cb2daee0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'EY72 DVR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20492344',
'listing': 'auction',
'location': 'Essex Basildon',
'make': 'Nissan',
'model': 'X-Trail',
'odometer': 24055,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c09e6d-30ad-5aae-a0e5-51a9cb2daee0/53c09e6d-30ad-5aae-a0e5-51a9cb2daee0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 662232,
'Height': 2235,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2344/20492344/exterior_front_driver-1774715922776.jpg',
'Width': 2980},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c09e6d-30ad-5aae-a0e5-51a9cb2daee0/53c09e6d-30ad-5aae-a0e5-51a9cb2daee0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1003702,
'Height': 2441,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2344/20492344/exterior_rear_driver-1774715927523.jpg',
'Width': 3254},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c09e6d-30ad-5aae-a0e5-51a9cb2daee0/53c09e6d-30ad-5aae-a0e5-51a9cb2daee0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1205738,
'Height': 2382,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2344/20492344/exterior_front_passenger-1774715924912.jpg',
'Width': 3176},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c09e6d-30ad-5aae-a0e5-51a9cb2daee0/53c09e6d-30ad-5aae-a0e5-51a9cb2daee0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1192986,
'Height': 2489,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2344/20492344/exterior_rear_passenger-1774715926478.jpg',
'Width': 3319},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c09e6d-30ad-5aae-a0e5-51a9cb2daee0/53c09e6d-30ad-5aae-a0e5-51a9cb2daee0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2198155,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/2344/20492344/interior_front_seats-1774716576104.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c09e6d-30ad-5aae-a0e5-51a9cb2daee0/53c09e6d-30ad-5aae-a0e5-51a9cb2daee0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3180053,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/2344/20492344/interior_rear_seats-1774716571730.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c09e6d-30ad-5aae-a0e5-51a9cb2daee0/53c09e6d-30ad-5aae-a0e5-51a9cb2daee0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1292916,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2344/20492344/interior_dashboard-1774716584498.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c09e6d-30ad-5aae-a0e5-51a9cb2daee0/53c09e6d-30ad-5aae-a0e5-51a9cb2daee0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 946274,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2344/20492344/instrument_cluster-1774716554884.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c09e6d-30ad-5aae-a0e5-51a9cb2daee0/53c09e6d-30ad-5aae-a0e5-51a9cb2daee0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1188618,
'Height': 2418,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2344/20492344/interior_boot-1774775535786.jpg',
'Width': 3225},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53c09e6d-30ad-5aae-a0e5-51a9cb2daee0/53c09e6d-30ad-5aae-a0e5-51a9cb2daee0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 683094,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2344/20492344/docs_service_history-1774716817465.jpg?ixlib=js-3.8.0&auto=format&s=586f69be3d9178b3b262ec9397645268',
'Width': 3840}],
'price': 20229,
'price_includes_vat': False,
'registration_date': '2022-12-20',
'seats_number': None,
'seller_name': None,
'title': 'Nissan X-Trail Nconncta Digt MHEV CVT',
'transmission': 'automatic',
'trim': 'Nconncta Digt MHEV CVT',
'vin': 'JN1T33JC6U0000575',
'year': 2022}
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720492344%27 HTTP/1.1" 200 None
2026-03-29 20:19:21 [motorway.uk] INFO: Saving data for 20492344: {'created_time': 1774815561.143706, 'last_price_update_time': 1774815561.143717, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20492344') HTTP/1.1" 204 0
2026-03-29 20:19:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9183/19449183/exterior_front_passenger-1774370169891.jpg> (referer: None)
2026-03-29 20:19:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5412/20485412/exterior_rear_passenger-1774695013428.jpg> (referer: None)
2026-03-29 20:19:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1332&page=37&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c26ed0>
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165fab30-47b2-5c74-ad11-21e7d0eabbd4/165fab30-47b2-5c74-ad11-21e7d0eabbd4_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9183%252F19449183%252Fexterior_front_passenger-1774370169891.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9183/19449183/exterior_front_passenger-1774370169891.jpg saved to cache
2026-03-29 20:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 165fab30-47b2-5c74-ad11-21e7d0eabbd4
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f6bcd0>
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f72adb02-1a63-5603-8014-b93d7ada819f/f72adb02-1a63-5603-8014-b93d7ada819f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5412%252F20485412%252Fexterior_rear_passenger-1774695013428.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5412/20485412/exterior_rear_passenger-1774695013428.jpg saved to cache
2026-03-29 20:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f72adb02-1a63-5603-8014-b93d7ada819f
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 1393364
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 18170236
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718170236%27 HTTP/1.1" 200 None
2026-03-29 20:19:21 [motorway.uk] INFO: Scrape type for 18170236: 1
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 19713905
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719713905%27 HTTP/1.1" 200 None
2026-03-29 20:19:21 [motorway.uk] INFO: Scrape type for 19713905: 1
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 20474485
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 20298443
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720298443%27 HTTP/1.1" 200 None
2026-03-29 20:19:21 [motorway.uk] INFO: Scrape type for 20298443: 1
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 20477842
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720477842%27 HTTP/1.1" 200 None
2026-03-29 20:19:21 [motorway.uk] INFO: Scrape type for 20477842: 1
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 17624223
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 18291869
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 19097600
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 9530683
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 20452858
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720452858%27 HTTP/1.1" 200 None
2026-03-29 20:19:21 [motorway.uk] INFO: Scrape type for 20452858: 1
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 20455993
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 11012278
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 18039395
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 18741336
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 20303325
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 19210640
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 18047844
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 3222560
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273222560%27 HTTP/1.1" 200 None
2026-03-29 20:19:21 [motorway.uk] INFO: Scrape type for 3222560: 1
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 19609067
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 19886187
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719886187%27 HTTP/1.1" 200 None
2026-03-29 20:19:21 [motorway.uk] INFO: Scrape type for 19886187: 1
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 19659666
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719659666%27 HTTP/1.1" 200 None
2026-03-29 20:19:21 [motorway.uk] INFO: Scrape type for 19659666: 1
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 20424304
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 17898601
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 14573343
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714573343%27 HTTP/1.1" 200 None
2026-03-29 20:19:21 [motorway.uk] INFO: Scrape type for 14573343: 1
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 19859082
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 20450166
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720450166%27 HTTP/1.1" 200 None
2026-03-29 20:19:21 [motorway.uk] INFO: Scrape type for 20450166: 1
2026-03-29 20:19:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5412/20485412/docs_service_history-1774696444073.jpg?ixlib=js-3.8.0&auto=format&s=71d07c9da95aa95b22984c97ae5abdd1> (referer: None)
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 18005774
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 17064602
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 20473269
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 19371488
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 10398218
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 20445276
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 16325362
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 17674234
2026-03-29 20:19:21 [motorway.uk] INFO: Found listing with ID: 20319628
2026-03-29 20:19:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5412/20485412/interior_boot-1774695785898.jpg> (referer: None)
2026-03-29 20:19:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5412/20485412/instrument_cluster-1774695804531.jpg> (referer: None)
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658536f90>
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f72adb02-1a63-5603-8014-b93d7ada819f/f72adb02-1a63-5603-8014-b93d7ada819f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5412%252F20485412%252Fdocs_service_history-1774696444073.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D71d07c9da95aa95b22984c97ae5abdd1') HTTP/1.1" 204 0
2026-03-29 20:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5412/20485412/docs_service_history-1774696444073.jpg?ixlib=js-3.8.0&auto=format&s=71d07c9da95aa95b22984c97ae5abdd1 saved to cache
2026-03-29 20:19:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f72adb02-1a63-5603-8014-b93d7ada819f
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be69b50>
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f72adb02-1a63-5603-8014-b93d7ada819f/f72adb02-1a63-5603-8014-b93d7ada819f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5412%252F20485412%252Finterior_boot-1774695785898.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5412/20485412/interior_boot-1774695785898.jpg saved to cache
2026-03-29 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f72adb02-1a63-5603-8014-b93d7ada819f
2026-03-29 20:19:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582d79d0>
2026-03-29 20:19:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f72adb02-1a63-5603-8014-b93d7ada819f/f72adb02-1a63-5603-8014-b93d7ada819f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5412%252F20485412%252Finstrument_cluster-1774695804531.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5412/20485412/instrument_cluster-1774695804531.jpg saved to cache
2026-03-29 20:19:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f72adb02-1a63-5603-8014-b93d7ada819f
2026-03-29 20:19:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20474722.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb301e21-5170-5094-8a2d-bf95bdd3f919 with identifier: 20474722
2026-03-29 20:19:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb301e21-5170-5094-8a2d-bf95bdd3f919 with scrape type 1
2026-03-29 20:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb301e21-5170-5094-8a2d-bf95bdd3f919
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4722%252F20474722%252Fexterior_front_driver-1774625596670.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4722/20474722/exterior_front_driver-1774625596670.jpg not downloaded yet
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4722%252F20474722%252Fexterior_rear_driver-1774627383657.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4722/20474722/exterior_rear_driver-1774627383657.jpg not downloaded yet
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4722%252F20474722%252Fexterior_front_passenger-1774627385385.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4722/20474722/exterior_front_passenger-1774627385385.jpg not downloaded yet
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4722%252F20474722%252Fexterior_rear_passenger-1774627386970.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4722/20474722/exterior_rear_passenger-1774627386970.jpg not downloaded yet
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4722%252F20474722%252Finterior_front_seats-1774627846408.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4722/20474722/interior_front_seats-1774627846408.jpg not downloaded yet
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4722%252F20474722%252Finterior_rear_seats-1774627811890.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4722/20474722/interior_rear_seats-1774627811890.jpg not downloaded yet
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4722%252F20474722%252Finterior_dashboard-1774627884986.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4722/20474722/interior_dashboard-1774627884986.jpg not downloaded yet
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4722%252F20474722%252Finstrument_cluster-1774707811425.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4722/20474722/instrument_cluster-1774707811425.jpg not downloaded yet
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4722%252F20474722%252Finterior_boot-1774627815768.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4722/20474722/interior_boot-1774627815768.jpg not downloaded yet
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4722%252F20474722%252Fdocs_service_history-1774628110972.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfff8ee1e9676fcb6aebadaeb03d1e34c%27 HTTP/1.1" 200 None
2026-03-29 20:19:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4722/20474722/docs_service_history-1774628110972.jpg?ixlib=js-3.8.0&auto=format&s=fff8ee1e9676fcb6aebadaeb03d1e34c not downloaded yet
2026-03-29 20:19:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16024734.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49354e28-7b6e-57b2-abd1-79128243f547 with identifier: 16024734
2026-03-29 20:19:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49354e28-7b6e-57b2-abd1-79128243f547 with scrape type 1
2026-03-29 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 49354e28-7b6e-57b2-abd1-79128243f547
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4734%252F16024734%252Fexterior_front_driver-1774711311901.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4734/16024734/exterior_front_driver-1774711311901.jpg not downloaded yet
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4734%252F16024734%252Fexterior_rear_driver-1774711324452.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4734/16024734/exterior_rear_driver-1774711324452.jpg not downloaded yet
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4734%252F16024734%252Fexterior_front_passenger-1774711346832.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4734/16024734/exterior_front_passenger-1774711346832.jpg not downloaded yet
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4734%252F16024734%252Fexterior_rear_passenger-1774704136972.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4734/16024734/exterior_rear_passenger-1774704136972.jpg not downloaded yet
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4734%252F16024734%252Finterior_front_seats-1774709179828.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4734/16024734/interior_front_seats-1774709179828.jpg not downloaded yet
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4734%252F16024734%252Finterior_rear_seats-1774709177575.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4734/16024734/interior_rear_seats-1774709177575.jpg not downloaded yet
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4734%252F16024734%252Finterior_dashboard-1774711383465.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4734/16024734/interior_dashboard-1774711383465.jpg not downloaded yet
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4734%252F16024734%252Finterior_boot-1774711396394.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4734/16024734/interior_boot-1774711396394.jpg not downloaded yet
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4734%252F16024734%252Fdocs_service_history-1774709489780.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da8076f3f60fe66c678410e38251fdf43%27 HTTP/1.1" 200 None
2026-03-29 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4734/16024734/docs_service_history-1774709489780.jpg?ixlib=js-3.8.0&auto=format&s=a8076f3f60fe66c678410e38251fdf43 not downloaded yet
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4734%252F16024734%252Fdocs_service_history-1774709579501.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db0deab6b435e6e4b54cc3c77129de2dc%27 HTTP/1.1" 200 None
2026-03-29 20:19:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4734/16024734/docs_service_history-1774709579501.jpg?ixlib=js-3.8.0&auto=format&s=b0deab6b435e6e4b54cc3c77129de2dc not downloaded yet
2026-03-29 20:19:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4722/20474722/docs_service_history-1774628110972.jpg?ixlib=js-3.8.0&auto=format&s=fff8ee1e9676fcb6aebadaeb03d1e34c> (referer: None)
2026-03-29 20:19:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a47490>
2026-03-29 20:19:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb301e21-5170-5094-8a2d-bf95bdd3f919/bb301e21-5170-5094-8a2d-bf95bdd3f919_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4722%252F20474722%252Fdocs_service_history-1774628110972.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfff8ee1e9676fcb6aebadaeb03d1e34c') HTTP/1.1" 204 0
2026-03-29 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4722/20474722/docs_service_history-1774628110972.jpg?ixlib=js-3.8.0&auto=format&s=fff8ee1e9676fcb6aebadaeb03d1e34c saved to cache
2026-03-29 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bb301e21-5170-5094-8a2d-bf95bdd3f919
2026-03-29 20:19:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4734/16024734/docs_service_history-1774709579501.jpg?ixlib=js-3.8.0&auto=format&s=b0deab6b435e6e4b54cc3c77129de2dc> (referer: None)
2026-03-29 20:19:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65bf147d0>
2026-03-29 20:19:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49354e28-7b6e-57b2-abd1-79128243f547/49354e28-7b6e-57b2-abd1-79128243f547_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4734%252F16024734%252Fdocs_service_history-1774709579501.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db0deab6b435e6e4b54cc3c77129de2dc') HTTP/1.1" 204 0
2026-03-29 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4734/16024734/docs_service_history-1774709579501.jpg?ixlib=js-3.8.0&auto=format&s=b0deab6b435e6e4b54cc3c77129de2dc saved to cache
2026-03-29 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 49354e28-7b6e-57b2-abd1-79128243f547
2026-03-29 20:19:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4734/16024734/docs_service_history-1774709489780.jpg?ixlib=js-3.8.0&auto=format&s=a8076f3f60fe66c678410e38251fdf43> (referer: None)
2026-03-29 20:19:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658519010>
2026-03-29 20:19:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49354e28-7b6e-57b2-abd1-79128243f547/49354e28-7b6e-57b2-abd1-79128243f547_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4734%252F16024734%252Fdocs_service_history-1774709489780.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da8076f3f60fe66c678410e38251fdf43') HTTP/1.1" 204 0
2026-03-29 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4734/16024734/docs_service_history-1774709489780.jpg?ixlib=js-3.8.0&auto=format&s=a8076f3f60fe66c678410e38251fdf43 saved to cache
2026-03-29 20:19:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 49354e28-7b6e-57b2-abd1-79128243f547
2026-03-29 20:19:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4734/16024734/interior_boot-1774711396394.jpg> (referer: None)
2026-03-29 20:19:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e2e190>
2026-03-29 20:19:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49354e28-7b6e-57b2-abd1-79128243f547/49354e28-7b6e-57b2-abd1-79128243f547_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4734%252F16024734%252Finterior_boot-1774711396394.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4734/16024734/interior_boot-1774711396394.jpg saved to cache
2026-03-29 20:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 49354e28-7b6e-57b2-abd1-79128243f547
2026-03-29 20:19:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4734/16024734/interior_dashboard-1774711383465.jpg> (referer: None)
2026-03-29 20:19:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65851a6d0>
2026-03-29 20:19:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49354e28-7b6e-57b2-abd1-79128243f547/49354e28-7b6e-57b2-abd1-79128243f547_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4734%252F16024734%252Finterior_dashboard-1774711383465.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4734/16024734/interior_dashboard-1774711383465.jpg saved to cache
2026-03-29 20:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 49354e28-7b6e-57b2-abd1-79128243f547
2026-03-29 20:19:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4734/16024734/interior_rear_seats-1774709177575.jpg> (referer: None)
2026-03-29 20:19:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfb6b50>
2026-03-29 20:19:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49354e28-7b6e-57b2-abd1-79128243f547/49354e28-7b6e-57b2-abd1-79128243f547_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4734%252F16024734%252Finterior_rear_seats-1774709177575.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4734/16024734/interior_rear_seats-1774709177575.jpg saved to cache
2026-03-29 20:19:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 49354e28-7b6e-57b2-abd1-79128243f547
2026-03-29 20:19:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19433460.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4734/16024734/interior_front_seats-1774709179828.jpg> (referer: None)
2026-03-29 20:19:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1abdfe48-8ced-5c90-8c3f-0868e1c0aeea with identifier: 19433460
2026-03-29 20:19:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1abdfe48-8ced-5c90-8c3f-0868e1c0aeea with scrape type 1
2026-03-29 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1abdfe48-8ced-5c90-8c3f-0868e1c0aeea
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3460%252F19433460%252Fexterior_front_driver-1772299763438.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3460/19433460/exterior_front_driver-1772299763438.jpg already downloaded
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3460%252F19433460%252Fexterior_rear_driver-1771838533396.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3460/19433460/exterior_rear_driver-1771838533396.jpg already downloaded
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3460%252F19433460%252Fexterior_front_passenger-1772299811234.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3460/19433460/exterior_front_passenger-1772299811234.jpg already downloaded
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3460%252F19433460%252Fexterior_rear_passenger-1771838555056.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3460/19433460/exterior_rear_passenger-1771838555056.jpg already downloaded
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3460%252F19433460%252Finterior_front_seats-1771838928241.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3460/19433460/interior_front_seats-1771838928241.jpg already downloaded
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3460%252F19433460%252Finterior_rear_seats-1771838943502.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3460/19433460/interior_rear_seats-1771838943502.jpg already downloaded
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3460%252F19433460%252Finterior_dashboard-1771838982860.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3460/19433460/interior_dashboard-1771838982860.jpg already downloaded
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3460%252F19433460%252Finstrument_cluster-1771838896694.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3460/19433460/instrument_cluster-1771838896694.jpg already downloaded
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3460%252F19433460%252Finterior_boot-1772371802976.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3460/19433460/interior_boot-1772371802976.jpg already downloaded
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F3460%252F19433460%252Fdocs_service_history-1771850961916.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D02ef2a4b3edcd5c51c664f31c3f9dd76%27 HTTP/1.1" 200 None
2026-03-29 20:19:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/3460/19433460/docs_service_history-1771850961916.jpg?ixlib=js-3.8.0&auto=format&s=02ef2a4b3edcd5c51c664f31c3f9dd76 already downloaded
2026-03-29 20:19:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 1abdfe48-8ced-5c90-8c3f-0868e1c0aeea, identifier: 19433460
2026-03-29 20:19:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 1abdfe48-8ced-5c90-8c3f-0868e1c0aeea with identifier: 19433460
2026-03-29 20:19:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 1abdfe48-8ced-5c90-8c3f-0868e1c0aeea with identifier: 19433460
2026-03-29 20:19:27 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 1abdfe48-8ced-5c90-8c3f-0868e1c0aeea with identifier: 19433460 to the API
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19433460.json>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.1L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '1abdfe48-8ced-5c90-8c3f-0868e1c0aeea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'WN64 XLY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19433460',
'listing': 'auction',
'location': 'Swindon Swindon',
'make': 'Mercedes',
'model': 'GLA',
'odometer': 122941,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/3460/19433460/exterior_front_driver-1772299763438.jpg',
'https://motorway-photos-redacted.imgix.net/3460/19433460/exterior_rear_driver-1771838533396.jpg',
'https://motorway-photos-redacted.imgix.net/3460/19433460/exterior_front_passenger-1772299811234.jpg',
'https://motorway-photos-redacted.imgix.net/3460/19433460/exterior_rear_passenger-1771838555056.jpg',
'https://motorway-photos.imgix.net/3460/19433460/interior_front_seats-1771838928241.jpg',
'https://motorway-photos.imgix.net/3460/19433460/interior_rear_seats-1771838943502.jpg',
'https://motorway-photos-redacted.imgix.net/3460/19433460/interior_dashboard-1771838982860.jpg',
'https://motorway-photos.imgix.net/3460/19433460/instrument_cluster-1771838896694.jpg',
'https://motorway-photos.imgix.net/3460/19433460/interior_boot-1772371802976.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/3460/19433460/docs_service_history-1771850961916.jpg?ixlib=js-3.8.0&auto=format&s=02ef2a4b3edcd5c51c664f31c3f9dd76'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85a342ca-6646-57e7-a196-7965e1cfa332/85a342ca-6646-57e7-a196-7965e1cfa332_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1765434,
'Height': 2827,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3460/19433460/exterior_front_driver-1772299763438.jpg',
'Width': 3769},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85a342ca-6646-57e7-a196-7965e1cfa332/85a342ca-6646-57e7-a196-7965e1cfa332_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2179229,
'Height': 2749,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3460/19433460/exterior_rear_driver-1771838533396.jpg',
'Width': 3665},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85a342ca-6646-57e7-a196-7965e1cfa332/85a342ca-6646-57e7-a196-7965e1cfa332_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2053593,
'Height': 2881,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3460/19433460/exterior_front_passenger-1772299811234.jpg',
'Width': 3841},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85a342ca-6646-57e7-a196-7965e1cfa332/85a342ca-6646-57e7-a196-7965e1cfa332_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1784000,
'Height': 2607,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3460/19433460/exterior_rear_passenger-1771838555056.jpg',
'Width': 3476},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85a342ca-6646-57e7-a196-7965e1cfa332/85a342ca-6646-57e7-a196-7965e1cfa332_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3934262,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3460/19433460/interior_front_seats-1771838928241.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85a342ca-6646-57e7-a196-7965e1cfa332/85a342ca-6646-57e7-a196-7965e1cfa332_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4020552,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3460/19433460/interior_rear_seats-1771838943502.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85a342ca-6646-57e7-a196-7965e1cfa332/85a342ca-6646-57e7-a196-7965e1cfa332_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1552483,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3460/19433460/interior_dashboard-1771838982860.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85a342ca-6646-57e7-a196-7965e1cfa332/85a342ca-6646-57e7-a196-7965e1cfa332_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3238533,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3460/19433460/instrument_cluster-1771838896694.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85a342ca-6646-57e7-a196-7965e1cfa332/85a342ca-6646-57e7-a196-7965e1cfa332_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3412855,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3460/19433460/interior_boot-1772371802976.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85a342ca-6646-57e7-a196-7965e1cfa332/85a342ca-6646-57e7-a196-7965e1cfa332_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109267,
'Height': 842,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/3460/19433460/docs_service_history-1771850961916.jpg?ixlib=js-3.8.0&auto=format&s=02ef2a4b3edcd5c51c664f31c3f9dd76',
'Width': 596}],
'price': 5262,
'price_includes_vat': False,
'registration_date': '2014-11-11',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes GLA220 Amgline PREM+CDI 4MAT A',
'transmission': 'automatic',
'trim': '220 Amgline PREM+CDI 4MAT A',
'vin': 'WDC1569052J068575',
'year': 2014}
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719433460%27 HTTP/1.1" 200 None
2026-03-29 20:19:27 [motorway.uk] INFO: Saving data for 19433460: {'created_time': 1774815567.878823, 'last_price_update_time': 1774815567.878834, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19433460') HTTP/1.1" 204 0
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658816e90>
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49354e28-7b6e-57b2-abd1-79128243f547/49354e28-7b6e-57b2-abd1-79128243f547_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4734%252F16024734%252Finterior_front_seats-1774709179828.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4734/16024734/interior_front_seats-1774709179828.jpg saved to cache
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 49354e28-7b6e-57b2-abd1-79128243f547
2026-03-29 20:19:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4734/16024734/exterior_rear_passenger-1774704136972.jpg> (referer: None)
2026-03-29 20:19:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4734/16024734/exterior_front_passenger-1774711346832.jpg> (referer: None)
2026-03-29 20:19:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/7888251.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587b8dd0>
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49354e28-7b6e-57b2-abd1-79128243f547/49354e28-7b6e-57b2-abd1-79128243f547_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4734%252F16024734%252Fexterior_rear_passenger-1774704136972.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4734/16024734/exterior_rear_passenger-1774704136972.jpg saved to cache
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 49354e28-7b6e-57b2-abd1-79128243f547
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584d56d0>
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49354e28-7b6e-57b2-abd1-79128243f547/49354e28-7b6e-57b2-abd1-79128243f547_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4734%252F16024734%252Fexterior_front_passenger-1774711346832.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4734/16024734/exterior_front_passenger-1774711346832.jpg saved to cache
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 49354e28-7b6e-57b2-abd1-79128243f547
2026-03-29 20:19:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 137c6281-088f-534c-a5d6-61577ca62f7f with identifier: 7888251
2026-03-29 20:19:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 137c6281-088f-534c-a5d6-61577ca62f7f with scrape type 1
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 137c6281-088f-534c-a5d6-61577ca62f7f
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8251%252F7888251%252Fexterior_front_driver-1774699940540.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8251/7888251/exterior_front_driver-1774699940540.jpeg not downloaded yet
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8251%252F7888251%252Fexterior_rear_driver-1774700023777.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8251/7888251/exterior_rear_driver-1774700023777.jpeg not downloaded yet
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8251%252F7888251%252Fexterior_front_passenger-1774699965420.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8251/7888251/exterior_front_passenger-1774699965420.jpeg not downloaded yet
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8251%252F7888251%252Fexterior_rear_passenger-1774700066350.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8251/7888251/exterior_rear_passenger-1774700066350.jpeg not downloaded yet
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8251%252F7888251%252Finterior_front_seats-1774700112069.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8251/7888251/interior_front_seats-1774700112069.jpeg not downloaded yet
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8251%252F7888251%252Finterior_rear_seats-1774700268770.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8251/7888251/interior_rear_seats-1774700268770.jpeg not downloaded yet
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8251%252F7888251%252Finterior_dashboard-1774700323394.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8251/7888251/interior_dashboard-1774700323394.jpeg not downloaded yet
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8251%252F7888251%252Finstrument_cluster-1774700352272.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8251/7888251/instrument_cluster-1774700352272.jpeg not downloaded yet
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8251%252F7888251%252Finterior_boot-1774700340774.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8251/7888251/interior_boot-1774700340774.jpeg not downloaded yet
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8251%252F7888251%252Fdocs_service_history-1774701757610.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Deef5f26a1bf11740d5691c21607251ed%27 HTTP/1.1" 200 None
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8251/7888251/docs_service_history-1774701757610.jpeg?ixlib=js-3.8.0&auto=format&s=eef5f26a1bf11740d5691c21607251ed not downloaded yet
2026-03-29 20:19:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4722/20474722/interior_boot-1774627815768.jpg> (referer: None)
2026-03-29 20:19:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4734/16024734/exterior_front_driver-1774711311901.jpg> (referer: None)
2026-03-29 20:19:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4734/16024734/exterior_rear_driver-1774711324452.jpg> (referer: None)
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a46f10>
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb301e21-5170-5094-8a2d-bf95bdd3f919/bb301e21-5170-5094-8a2d-bf95bdd3f919_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4722%252F20474722%252Finterior_boot-1774627815768.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4722/20474722/interior_boot-1774627815768.jpg saved to cache
2026-03-29 20:19:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bb301e21-5170-5094-8a2d-bf95bdd3f919
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a13090>
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49354e28-7b6e-57b2-abd1-79128243f547/49354e28-7b6e-57b2-abd1-79128243f547_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4734%252F16024734%252Fexterior_front_driver-1774711311901.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4734/16024734/exterior_front_driver-1774711311901.jpg saved to cache
2026-03-29 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49354e28-7b6e-57b2-abd1-79128243f547
2026-03-29 20:19:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65ab04650>
2026-03-29 20:19:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49354e28-7b6e-57b2-abd1-79128243f547/49354e28-7b6e-57b2-abd1-79128243f547_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4734%252F16024734%252Fexterior_rear_driver-1774711324452.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4734/16024734/exterior_rear_driver-1774711324452.jpg saved to cache
2026-03-29 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 49354e28-7b6e-57b2-abd1-79128243f547
2026-03-29 20:19:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49354e28-7b6e-57b2-abd1-79128243f547, skipping ID generation
2026-03-29 20:19:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49354e28-7b6e-57b2-abd1-79128243f547 with scrape type 1
2026-03-29 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49354e28-7b6e-57b2-abd1-79128243f547 sending to next pipeline
2026-03-29 20:19:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 49354e28-7b6e-57b2-abd1-79128243f547, identifier: 16024734
2026-03-29 20:19:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 49354e28-7b6e-57b2-abd1-79128243f547 with identifier: 16024734
2026-03-29 20:19:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 49354e28-7b6e-57b2-abd1-79128243f547 with identifier: 16024734
2026-03-29 20:19:29 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 49354e28-7b6e-57b2-abd1-79128243f547 with identifier: 16024734 to the API
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/4734/16024734/exterior_rear_driver-1774711324452.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '49354e28-7b6e-57b2-abd1-79128243f547',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'RV14 YZU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/16024734',
'listing': 'auction',
'location': 'Hampshire Southampton',
'make': 'Kia',
'model': 'Rio',
'odometer': 67618,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49354e28-7b6e-57b2-abd1-79128243f547/49354e28-7b6e-57b2-abd1-79128243f547_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2150620,
'Height': 2641,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4734/16024734/exterior_front_driver-1774711311901.jpg',
'Width': 3521},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49354e28-7b6e-57b2-abd1-79128243f547/49354e28-7b6e-57b2-abd1-79128243f547_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1960196,
'Height': 2416,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4734/16024734/exterior_rear_driver-1774711324452.jpg',
'Width': 3221},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49354e28-7b6e-57b2-abd1-79128243f547/49354e28-7b6e-57b2-abd1-79128243f547_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1965708,
'Height': 2787,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4734/16024734/exterior_front_passenger-1774711346832.jpg',
'Width': 3716},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49354e28-7b6e-57b2-abd1-79128243f547/49354e28-7b6e-57b2-abd1-79128243f547_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1563960,
'Height': 2640,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4734/16024734/exterior_rear_passenger-1774704136972.jpg',
'Width': 3520},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49354e28-7b6e-57b2-abd1-79128243f547/49354e28-7b6e-57b2-abd1-79128243f547_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1794427,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4734/16024734/interior_front_seats-1774709179828.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49354e28-7b6e-57b2-abd1-79128243f547/49354e28-7b6e-57b2-abd1-79128243f547_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1885030,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4734/16024734/interior_rear_seats-1774709177575.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49354e28-7b6e-57b2-abd1-79128243f547/49354e28-7b6e-57b2-abd1-79128243f547_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2052964,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4734/16024734/interior_dashboard-1774711383465.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49354e28-7b6e-57b2-abd1-79128243f547/49354e28-7b6e-57b2-abd1-79128243f547_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2074711,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4734/16024734/interior_boot-1774711396394.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49354e28-7b6e-57b2-abd1-79128243f547/49354e28-7b6e-57b2-abd1-79128243f547_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 688975,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4734/16024734/docs_service_history-1774709489780.jpg?ixlib=js-3.8.0&auto=format&s=a8076f3f60fe66c678410e38251fdf43',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49354e28-7b6e-57b2-abd1-79128243f547/49354e28-7b6e-57b2-abd1-79128243f547_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1041670,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4734/16024734/docs_service_history-1774709579501.jpg?ixlib=js-3.8.0&auto=format&s=b0deab6b435e6e4b54cc3c77129de2dc',
'Width': 3840}],
'price': 2246,
'price_includes_vat': False,
'registration_date': '2014-03-31',
'seats_number': None,
'seller_name': None,
'title': 'Kia Rio 1',
'transmission': 'manual',
'trim': '1',
'vin': 'KNADM511LE6935342',
'year': 2014}
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716024734%27 HTTP/1.1" 200 None
2026-03-29 20:19:29 [motorway.uk] INFO: Saving data for 16024734: {'created_time': 1774815569.725155, 'last_price_update_time': 1774815569.725166, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='16024734') HTTP/1.1" 204 0
2026-03-29 20:19:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20492217.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8251/7888251/docs_service_history-1774701757610.jpeg?ixlib=js-3.8.0&auto=format&s=eef5f26a1bf11740d5691c21607251ed> (referer: None)
2026-03-29 20:19:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8251/7888251/instrument_cluster-1774700352272.jpeg> (referer: None)
2026-03-29 20:19:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8251/7888251/interior_boot-1774700340774.jpeg> (referer: None)
2026-03-29 20:19:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a73baf94-6acc-558d-9e97-8756297fc494 with identifier: 20492217
2026-03-29 20:19:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a73baf94-6acc-558d-9e97-8756297fc494 with scrape type 1
2026-03-29 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a73baf94-6acc-558d-9e97-8756297fc494
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2217%252F20492217%252Fexterior_front_driver-1774720342821.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2217/20492217/exterior_front_driver-1774720342821.jpg not downloaded yet
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2217%252F20492217%252Fexterior_rear_driver-1774720295077.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2217/20492217/exterior_rear_driver-1774720295077.jpg not downloaded yet
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2217%252F20492217%252Fexterior_front_passenger-1774720321429.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2217/20492217/exterior_front_passenger-1774720321429.jpg not downloaded yet
2026-03-29 20:19:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65845cc90>
2026-03-29 20:19:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c6281-088f-534c-a5d6-61577ca62f7f/137c6281-088f-534c-a5d6-61577ca62f7f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8251%252F7888251%252Fdocs_service_history-1774701757610.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Deef5f26a1bf11740d5691c21607251ed') HTTP/1.1" 204 0
2026-03-29 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8251/7888251/docs_service_history-1774701757610.jpeg?ixlib=js-3.8.0&auto=format&s=eef5f26a1bf11740d5691c21607251ed saved to cache
2026-03-29 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 137c6281-088f-534c-a5d6-61577ca62f7f
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2217%252F20492217%252Fexterior_rear_passenger-1774720308301.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2217/20492217/exterior_rear_passenger-1774720308301.jpg not downloaded yet
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2217%252F20492217%252Finterior_front_seats-1774720759199.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2217/20492217/interior_front_seats-1774720759199.jpg not downloaded yet
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2217%252F20492217%252Finterior_rear_seats-1774720777825.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2217/20492217/interior_rear_seats-1774720777825.jpg not downloaded yet
2026-03-29 20:19:30 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:19:30 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:19:30 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00(\xa4\r\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\xe3\x8f\x00(\x9a\x1b\x00\x00\x00\x00'
2026-03-29 20:19:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658833710>
2026-03-29 20:19:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c6281-088f-534c-a5d6-61577ca62f7f/137c6281-088f-534c-a5d6-61577ca62f7f_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8251%252F7888251%252Finstrument_cluster-1774700352272.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8251/7888251/instrument_cluster-1774700352272.jpeg saved to cache
2026-03-29 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 137c6281-088f-534c-a5d6-61577ca62f7f
2026-03-29 20:19:30 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:19:30 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:19:30 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00@\xce#\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x029\x17\x00@\xc41\x00\x00\x00\x00'
2026-03-29 20:19:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a92890>
2026-03-29 20:19:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c6281-088f-534c-a5d6-61577ca62f7f/137c6281-088f-534c-a5d6-61577ca62f7f_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8251%252F7888251%252Finterior_boot-1774700340774.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8251/7888251/interior_boot-1774700340774.jpeg saved to cache
2026-03-29 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 137c6281-088f-534c-a5d6-61577ca62f7f
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2217%252F20492217%252Finterior_dashboard-1774720822006.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2217/20492217/interior_dashboard-1774720822006.jpg not downloaded yet
2026-03-29 20:19:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19750029.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2217%252F20492217%252Finstrument_cluster-1774720843541.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2217/20492217/instrument_cluster-1774720843541.jpg not downloaded yet
2026-03-29 20:19:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2217%252F20492217%252Finterior_boot-1774720891112.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2217/20492217/interior_boot-1774720891112.jpg not downloaded yet
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2217%252F20492217%252Fdocs_service_history-1774722606693.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbaf90942c3760e69a3aeaefdd4068fe4%27 HTTP/1.1" 200 None
2026-03-29 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2217/20492217/docs_service_history-1774722606693.jpg?ixlib=js-3.8.0&auto=format&s=baf90942c3760e69a3aeaefdd4068fe4 not downloaded yet
2026-03-29 20:19:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8251/7888251/interior_rear_seats-1774700268770.jpeg> (referer: None)
2026-03-29 20:19:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8251/7888251/interior_dashboard-1774700323394.jpeg> (referer: None)
2026-03-29 20:19:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 085ec6be-fbbb-5ec5-963b-f7295ec5c7ba with identifier: 19750029
2026-03-29 20:19:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 085ec6be-fbbb-5ec5-963b-f7295ec5c7ba with scrape type 1
2026-03-29 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 085ec6be-fbbb-5ec5-963b-f7295ec5c7ba
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0029%252F19750029%252Fexterior_front_driver-1771240047163.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0029/19750029/exterior_front_driver-1771240047163.jpg not downloaded yet
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0029%252F19750029%252Fexterior_rear_driver-1771239936301.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0029/19750029/exterior_rear_driver-1771239936301.jpg not downloaded yet
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0029%252F19750029%252Fexterior_front_passenger-1771239901088.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0029/19750029/exterior_front_passenger-1771239901088.jpg not downloaded yet
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0029%252F19750029%252Fexterior_rear_passenger-1771239905160.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0029/19750029/exterior_rear_passenger-1771239905160.jpg not downloaded yet
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0029%252F19750029%252Finterior_front_seats-1774781965117.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0029/19750029/interior_front_seats-1774781965117.jpg not downloaded yet
2026-03-29 20:19:30 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:19:30 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:19:30 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00!\xd1\x81\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xfa\xa2\x00!\xc7\x8f\x00\x00\x00\x00'
2026-03-29 20:19:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586f78d0>
2026-03-29 20:19:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c6281-088f-534c-a5d6-61577ca62f7f/137c6281-088f-534c-a5d6-61577ca62f7f_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8251%252F7888251%252Finterior_rear_seats-1774700268770.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8251/7888251/interior_rear_seats-1774700268770.jpeg saved to cache
2026-03-29 20:19:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 137c6281-088f-534c-a5d6-61577ca62f7f
2026-03-29 20:19:30 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:19:30 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:19:30 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x004G\xbb\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\\[\x004=\xc9\x00\x00\x00\x00'
2026-03-29 20:19:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658490990>
2026-03-29 20:19:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c6281-088f-534c-a5d6-61577ca62f7f/137c6281-088f-534c-a5d6-61577ca62f7f_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8251%252F7888251%252Finterior_dashboard-1774700323394.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8251/7888251/interior_dashboard-1774700323394.jpeg saved to cache
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 137c6281-088f-534c-a5d6-61577ca62f7f
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0029%252F19750029%252Finterior_rear_seats-1771240479547.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0029/19750029/interior_rear_seats-1771240479547.jpg not downloaded yet
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0029%252F19750029%252Finterior_dashboard-1774784798695.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0029/19750029/interior_dashboard-1774784798695.jpg not downloaded yet
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0029%252F19750029%252Finterior_boot-1774785325382.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0029/19750029/interior_boot-1774785325382.jpg not downloaded yet
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0029%252F19750029%252Fdocs_service_history-1774781488713.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dac2070d8d6ee6bf23960fde445c5fa95%27 HTTP/1.1" 200 None
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0029/19750029/docs_service_history-1774781488713.jpg?ixlib=js-3.8.0&auto=format&s=ac2070d8d6ee6bf23960fde445c5fa95 not downloaded yet
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0029%252F19750029%252Fdocs_service_history-1774782024974.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9db90993c04ddeacccb30e4ebd52f645%27 HTTP/1.1" 200 None
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0029/19750029/docs_service_history-1774782024974.jpg?ixlib=js-3.8.0&auto=format&s=9db90993c04ddeacccb30e4ebd52f645 not downloaded yet
2026-03-29 20:19:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2217/20492217/interior_rear_seats-1774720777825.jpg> (referer: None)
2026-03-29 20:19:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2217/20492217/interior_dashboard-1774720822006.jpg> (referer: None)
2026-03-29 20:19:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2217/20492217/interior_front_seats-1774720759199.jpg> (referer: None)
2026-03-29 20:19:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65815b2d0>
2026-03-29 20:19:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a73baf94-6acc-558d-9e97-8756297fc494/a73baf94-6acc-558d-9e97-8756297fc494_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2217%252F20492217%252Finterior_rear_seats-1774720777825.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2217/20492217/interior_rear_seats-1774720777825.jpg saved to cache
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a73baf94-6acc-558d-9e97-8756297fc494
2026-03-29 20:19:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c24c90>
2026-03-29 20:19:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a73baf94-6acc-558d-9e97-8756297fc494/a73baf94-6acc-558d-9e97-8756297fc494_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2217%252F20492217%252Finterior_dashboard-1774720822006.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2217/20492217/interior_dashboard-1774720822006.jpg saved to cache
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a73baf94-6acc-558d-9e97-8756297fc494
2026-03-29 20:19:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65bc04d10>
2026-03-29 20:19:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a73baf94-6acc-558d-9e97-8756297fc494/a73baf94-6acc-558d-9e97-8756297fc494_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2217%252F20492217%252Finterior_front_seats-1774720759199.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2217/20492217/interior_front_seats-1774720759199.jpg saved to cache
2026-03-29 20:19:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a73baf94-6acc-558d-9e97-8756297fc494
2026-03-29 20:19:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2217/20492217/docs_service_history-1774722606693.jpg?ixlib=js-3.8.0&auto=format&s=baf90942c3760e69a3aeaefdd4068fe4> (referer: None)
2026-03-29 20:19:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0029/19750029/docs_service_history-1774781488713.jpg?ixlib=js-3.8.0&auto=format&s=ac2070d8d6ee6bf23960fde445c5fa95> (referer: None)
2026-03-29 20:19:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0029/19750029/docs_service_history-1774782024974.jpg?ixlib=js-3.8.0&auto=format&s=9db90993c04ddeacccb30e4ebd52f645> (referer: None)
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:19:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658daab10>
2026-03-29 20:19:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a73baf94-6acc-558d-9e97-8756297fc494/a73baf94-6acc-558d-9e97-8756297fc494_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2217%252F20492217%252Fdocs_service_history-1774722606693.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbaf90942c3760e69a3aeaefdd4068fe4') HTTP/1.1" 204 0
2026-03-29 20:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2217/20492217/docs_service_history-1774722606693.jpg?ixlib=js-3.8.0&auto=format&s=baf90942c3760e69a3aeaefdd4068fe4 saved to cache
2026-03-29 20:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a73baf94-6acc-558d-9e97-8756297fc494
2026-03-29 20:19:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b173d0>
2026-03-29 20:19:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_085ec6be-fbbb-5ec5-963b-f7295ec5c7ba/085ec6be-fbbb-5ec5-963b-f7295ec5c7ba_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0029%252F19750029%252Fdocs_service_history-1774781488713.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dac2070d8d6ee6bf23960fde445c5fa95') HTTP/1.1" 204 0
2026-03-29 20:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0029/19750029/docs_service_history-1774781488713.jpg?ixlib=js-3.8.0&auto=format&s=ac2070d8d6ee6bf23960fde445c5fa95 saved to cache
2026-03-29 20:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 085ec6be-fbbb-5ec5-963b-f7295ec5c7ba
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-S938B\x00'
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'S938BXXS8BZB5\x00'
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:29 11:51:54\x00'
2026-03-29 20:19:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658718890>
2026-03-29 20:19:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_085ec6be-fbbb-5ec5-963b-f7295ec5c7ba/085ec6be-fbbb-5ec5-963b-f7295ec5c7ba_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0029%252F19750029%252Fdocs_service_history-1774782024974.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9db90993c04ddeacccb30e4ebd52f645') HTTP/1.1" 204 0
2026-03-29 20:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0029/19750029/docs_service_history-1774782024974.jpg?ixlib=js-3.8.0&auto=format&s=9db90993c04ddeacccb30e4ebd52f645 saved to cache
2026-03-29 20:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 085ec6be-fbbb-5ec5-963b-f7295ec5c7ba
2026-03-29 20:19:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0029/19750029/interior_rear_seats-1771240479547.jpg> (referer: None)
2026-03-29 20:19:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0029/19750029/interior_boot-1774785325382.jpg> (referer: None)
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-S938B\x00'
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'S938BXXS7BYLR\x00'
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:32 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:02:16 11:13:55\x00'
2026-03-29 20:19:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c248d0>
2026-03-29 20:19:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_085ec6be-fbbb-5ec5-963b-f7295ec5c7ba/085ec6be-fbbb-5ec5-963b-f7295ec5c7ba_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0029%252F19750029%252Finterior_rear_seats-1771240479547.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0029/19750029/interior_rear_seats-1771240479547.jpg saved to cache
2026-03-29 20:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 085ec6be-fbbb-5ec5-963b-f7295ec5c7ba
2026-03-29 20:19:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658da8a10>
2026-03-29 20:19:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_085ec6be-fbbb-5ec5-963b-f7295ec5c7ba/085ec6be-fbbb-5ec5-963b-f7295ec5c7ba_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0029%252F19750029%252Finterior_boot-1774785325382.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0029/19750029/interior_boot-1774785325382.jpg saved to cache
2026-03-29 20:19:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 085ec6be-fbbb-5ec5-963b-f7295ec5c7ba
2026-03-29 20:19:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0029/19750029/interior_dashboard-1774784798695.jpg> (referer: None)
2026-03-29 20:19:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0029/19750029/exterior_rear_passenger-1771239905160.jpg> (referer: None)
2026-03-29 20:19:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14573343.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c15f10>
2026-03-29 20:19:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_085ec6be-fbbb-5ec5-963b-f7295ec5c7ba/085ec6be-fbbb-5ec5-963b-f7295ec5c7ba_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0029%252F19750029%252Finterior_dashboard-1774784798695.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0029/19750029/interior_dashboard-1774784798695.jpg saved to cache
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 085ec6be-fbbb-5ec5-963b-f7295ec5c7ba
2026-03-29 20:19:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20130547.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bd9f050>
2026-03-29 20:19:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_085ec6be-fbbb-5ec5-963b-f7295ec5c7ba/085ec6be-fbbb-5ec5-963b-f7295ec5c7ba_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0029%252F19750029%252Fexterior_rear_passenger-1771239905160.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0029/19750029/exterior_rear_passenger-1771239905160.jpg saved to cache
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 085ec6be-fbbb-5ec5-963b-f7295ec5c7ba
2026-03-29 20:19:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66bcfb52-58aa-52ff-bd95-da479b77b96a with identifier: 14573343
2026-03-29 20:19:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66bcfb52-58aa-52ff-bd95-da479b77b96a with scrape type 1
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 66bcfb52-58aa-52ff-bd95-da479b77b96a
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3343%252F14573343%252Fexterior_front_driver-1774712609308.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3343/14573343/exterior_front_driver-1774712609308.jpg not downloaded yet
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3343%252F14573343%252Fexterior_rear_driver-1774712668420.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3343/14573343/exterior_rear_driver-1774712668420.jpg not downloaded yet
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3343%252F14573343%252Fexterior_front_passenger-1774712641185.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3343/14573343/exterior_front_passenger-1774712641185.jpg not downloaded yet
2026-03-29 20:19:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e1d790e-fb26-544b-aa48-5abddba6d09b with identifier: 20130547
2026-03-29 20:19:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e1d790e-fb26-544b-aa48-5abddba6d09b with scrape type 1
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0e1d790e-fb26-544b-aa48-5abddba6d09b
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0547%252F20130547%252Fexterior_front_driver-1774179816766.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0547/20130547/exterior_front_driver-1774179816766.jpeg not downloaded yet
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3343%252F14573343%252Fexterior_rear_passenger-1774712658636.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3343/14573343/exterior_rear_passenger-1774712658636.jpg not downloaded yet
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0547%252F20130547%252Fexterior_rear_driver-1774179748476.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0547/20130547/exterior_rear_driver-1774179748476.jpeg not downloaded yet
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3343%252F14573343%252Finterior_front_seats-1774712855539.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3343/14573343/interior_front_seats-1774712855539.jpg not downloaded yet
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0547%252F20130547%252Fexterior_front_passenger-1774179779887.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0547/20130547/exterior_front_passenger-1774179779887.jpeg not downloaded yet
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3343%252F14573343%252Finterior_rear_seats-1774712785049.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3343/14573343/interior_rear_seats-1774712785049.jpg not downloaded yet
2026-03-29 20:19:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0029/19750029/exterior_front_driver-1771240047163.jpg> (referer: None)
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0547%252F20130547%252Fexterior_rear_passenger-1774179760193.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0547/20130547/exterior_rear_passenger-1774179760193.jpeg not downloaded yet
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3343%252F14573343%252Finterior_dashboard-1774712819246.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3343/14573343/interior_dashboard-1774712819246.jpg not downloaded yet
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0547%252F20130547%252Finterior_front_seats-1774179334798.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0547/20130547/interior_front_seats-1774179334798.jpeg not downloaded yet
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3343%252F14573343%252Finstrument_cluster-1774712895799.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3343/14573343/instrument_cluster-1774712895799.jpg not downloaded yet
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0547%252F20130547%252Finterior_rear_seats-1774179386648.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0547/20130547/interior_rear_seats-1774179386648.jpeg not downloaded yet
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3343%252F14573343%252Finterior_boot-1774712830192.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3343/14573343/interior_boot-1774712830192.jpg not downloaded yet
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0547%252F20130547%252Finterior_dashboard-1774179505662.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0547/20130547/interior_dashboard-1774179505662.jpeg not downloaded yet
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3343%252F14573343%252F14573343-docs_service_history-modified-1774713750884.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd495ade1f0c6b5daf087dac08b64d7ec%27 HTTP/1.1" 200 None
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3343/14573343/14573343-docs_service_history-modified-1774713750884.jpeg?ixlib=js-3.8.0&auto=format&s=d495ade1f0c6b5daf087dac08b64d7ec not downloaded yet
2026-03-29 20:19:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658aded10>
2026-03-29 20:19:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_085ec6be-fbbb-5ec5-963b-f7295ec5c7ba/085ec6be-fbbb-5ec5-963b-f7295ec5c7ba_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0029%252F19750029%252Fexterior_front_driver-1771240047163.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0029/19750029/exterior_front_driver-1771240047163.jpg saved to cache
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 085ec6be-fbbb-5ec5-963b-f7295ec5c7ba
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0547%252F20130547%252Finstrument_cluster-1774179485795.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0547/20130547/instrument_cluster-1774179485795.jpeg not downloaded yet
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0547%252F20130547%252Finterior_boot-1774179540458.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0547/20130547/interior_boot-1774179540458.jpeg not downloaded yet
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0547%252F20130547%252Fdocs_service_history-1774306290586.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3097a2b066eac221202c4342c2754661%27 HTTP/1.1" 200 None
2026-03-29 20:19:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0547/20130547/docs_service_history-1774306290586.jpeg?ixlib=js-3.8.0&auto=format&s=3097a2b066eac221202c4342c2754661 not downloaded yet
2026-03-29 20:19:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0029/19750029/exterior_rear_driver-1771239936301.jpg> (referer: None)
2026-03-29 20:19:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0029/19750029/exterior_front_passenger-1771239901088.jpg> (referer: None)
2026-03-29 20:19:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2217/20492217/exterior_rear_passenger-1774720308301.jpg> (referer: None)
2026-03-29 20:19:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2217/20492217/instrument_cluster-1774720843541.jpg> (referer: None)
2026-03-29 20:19:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0029/19750029/interior_front_seats-1774781965117.jpg> (referer: None)
2026-03-29 20:19:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2217/20492217/interior_boot-1774720891112.jpg> (referer: None)
2026-03-29 20:19:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0547/20130547/exterior_front_passenger-1774179779887.jpeg> (referer: None)
2026-03-29 20:19:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be55850>
2026-03-29 20:19:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_085ec6be-fbbb-5ec5-963b-f7295ec5c7ba/085ec6be-fbbb-5ec5-963b-f7295ec5c7ba_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0029%252F19750029%252Fexterior_rear_driver-1771239936301.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0029/19750029/exterior_rear_driver-1771239936301.jpg saved to cache
2026-03-29 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 085ec6be-fbbb-5ec5-963b-f7295ec5c7ba
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e24c90>
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_085ec6be-fbbb-5ec5-963b-f7295ec5c7ba/085ec6be-fbbb-5ec5-963b-f7295ec5c7ba_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0029%252F19750029%252Fexterior_front_passenger-1771239901088.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0029/19750029/exterior_front_passenger-1771239901088.jpg saved to cache
2026-03-29 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 085ec6be-fbbb-5ec5-963b-f7295ec5c7ba
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c5ab50>
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a73baf94-6acc-558d-9e97-8756297fc494/a73baf94-6acc-558d-9e97-8756297fc494_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2217%252F20492217%252Fexterior_rear_passenger-1774720308301.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2217/20492217/exterior_rear_passenger-1774720308301.jpg saved to cache
2026-03-29 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a73baf94-6acc-558d-9e97-8756297fc494
2026-03-29 20:19:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:19:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65852ef10>
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a73baf94-6acc-558d-9e97-8756297fc494/a73baf94-6acc-558d-9e97-8756297fc494_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2217%252F20492217%252Finstrument_cluster-1774720843541.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2217/20492217/instrument_cluster-1774720843541.jpg saved to cache
2026-03-29 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a73baf94-6acc-558d-9e97-8756297fc494
2026-03-29 20:19:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 158 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 166 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:34 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xf0'
2026-03-29 20:19:34 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 174 - value: b'SM-S938B\x00'
2026-03-29 20:19:34 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 70 - Data Location: 183 - value: b'samsung\x00'
2026-03-29 20:19:34 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 191 - value: b'S938BXXS8BZB5\x00'
2026-03-29 20:19:34 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xf4'
2026-03-29 20:19:34 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe1'
2026-03-29 20:19:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:19:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:34 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 154 - Data Location: 205 - value: b'2026:03:29 11:55:34\x00'
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658734ad0>
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_085ec6be-fbbb-5ec5-963b-f7295ec5c7ba/085ec6be-fbbb-5ec5-963b-f7295ec5c7ba_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0029%252F19750029%252Finterior_front_seats-1774781965117.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0029/19750029/interior_front_seats-1774781965117.jpg saved to cache
2026-03-29 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 085ec6be-fbbb-5ec5-963b-f7295ec5c7ba
2026-03-29 20:19:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 085ec6be-fbbb-5ec5-963b-f7295ec5c7ba, skipping ID generation
2026-03-29 20:19:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 085ec6be-fbbb-5ec5-963b-f7295ec5c7ba with scrape type 1
2026-03-29 20:19:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 085ec6be-fbbb-5ec5-963b-f7295ec5c7ba sending to next pipeline
2026-03-29 20:19:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 085ec6be-fbbb-5ec5-963b-f7295ec5c7ba, identifier: 19750029
2026-03-29 20:19:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c5a010>
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a73baf94-6acc-558d-9e97-8756297fc494/a73baf94-6acc-558d-9e97-8756297fc494_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2217%252F20492217%252Finterior_boot-1774720891112.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2217/20492217/interior_boot-1774720891112.jpg saved to cache
2026-03-29 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a73baf94-6acc-558d-9e97-8756297fc494
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65843ce50>
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e1d790e-fb26-544b-aa48-5abddba6d09b/0e1d790e-fb26-544b-aa48-5abddba6d09b_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0547%252F20130547%252Fexterior_front_passenger-1774179779887.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0547/20130547/exterior_front_passenger-1774179779887.jpeg saved to cache
2026-03-29 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0e1d790e-fb26-544b-aa48-5abddba6d09b
2026-03-29 20:19:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 085ec6be-fbbb-5ec5-963b-f7295ec5c7ba with identifier: 19750029
2026-03-29 20:19:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 085ec6be-fbbb-5ec5-963b-f7295ec5c7ba with identifier: 19750029
2026-03-29 20:19:35 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 085ec6be-fbbb-5ec5-963b-f7295ec5c7ba with identifier: 19750029 to the API
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/0029/19750029/interior_front_seats-1774781965117.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '085ec6be-fbbb-5ec5-963b-f7295ec5c7ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'AE64 VFP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19750029',
'listing': 'auction',
'location': 'Surrey Godalming',
'make': 'BMW',
'model': '1 Series',
'odometer': 116753,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_085ec6be-fbbb-5ec5-963b-f7295ec5c7ba/085ec6be-fbbb-5ec5-963b-f7295ec5c7ba_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1216518,
'Height': 1955,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0029/19750029/exterior_front_driver-1771240047163.jpg',
'Width': 2606},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_085ec6be-fbbb-5ec5-963b-f7295ec5c7ba/085ec6be-fbbb-5ec5-963b-f7295ec5c7ba_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1465697,
'Height': 1988,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0029/19750029/exterior_rear_driver-1771239936301.jpg',
'Width': 2650},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_085ec6be-fbbb-5ec5-963b-f7295ec5c7ba/085ec6be-fbbb-5ec5-963b-f7295ec5c7ba_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1543701,
'Height': 2055,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0029/19750029/exterior_front_passenger-1771239901088.jpg',
'Width': 2740},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_085ec6be-fbbb-5ec5-963b-f7295ec5c7ba/085ec6be-fbbb-5ec5-963b-f7295ec5c7ba_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1367198,
'Height': 2040,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0029/19750029/exterior_rear_passenger-1771239905160.jpg',
'Width': 2720},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_085ec6be-fbbb-5ec5-963b-f7295ec5c7ba/085ec6be-fbbb-5ec5-963b-f7295ec5c7ba_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6510247,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/0029/19750029/interior_front_seats-1774781965117.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_085ec6be-fbbb-5ec5-963b-f7295ec5c7ba/085ec6be-fbbb-5ec5-963b-f7295ec5c7ba_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7841826,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/0029/19750029/interior_rear_seats-1771240479547.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_085ec6be-fbbb-5ec5-963b-f7295ec5c7ba/085ec6be-fbbb-5ec5-963b-f7295ec5c7ba_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1545351,
'Height': 2295,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0029/19750029/interior_dashboard-1774784798695.jpg',
'Width': 3060},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_085ec6be-fbbb-5ec5-963b-f7295ec5c7ba/085ec6be-fbbb-5ec5-963b-f7295ec5c7ba_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1713489,
'Height': 2295,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0029/19750029/interior_boot-1774785325382.jpg',
'Width': 3060},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_085ec6be-fbbb-5ec5-963b-f7295ec5c7ba/085ec6be-fbbb-5ec5-963b-f7295ec5c7ba_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 750756,
'Height': 4000,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0029/19750029/docs_service_history-1774781488713.jpg?ixlib=js-3.8.0&auto=format&s=ac2070d8d6ee6bf23960fde445c5fa95',
'Width': 3000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_085ec6be-fbbb-5ec5-963b-f7295ec5c7ba/085ec6be-fbbb-5ec5-963b-f7295ec5c7ba_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5336040,
'Height': 3060,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0029/19750029/docs_service_history-1774782024974.jpg?ixlib=js-3.8.0&auto=format&s=9db90993c04ddeacccb30e4ebd52f645',
'Width': 4080}],
'price': 4716,
'price_includes_vat': False,
'registration_date': '2014-09-11',
'seats_number': None,
'seller_name': None,
'title': 'BMW 125D M Sport Auto',
'transmission': 'automatic',
'trim': '125D M Sport Auto',
'vin': 'WBA1C52000E981789',
'year': 2014}
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719750029%27 HTTP/1.1" 200 None
2026-03-29 20:19:35 [motorway.uk] INFO: Saving data for 19750029: {'created_time': 1774815575.561773, 'last_price_update_time': 1774815575.561785, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19750029') HTTP/1.1" 204 0
2026-03-29 20:19:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0547/20130547/docs_service_history-1774306290586.jpeg?ixlib=js-3.8.0&auto=format&s=3097a2b066eac221202c4342c2754661> (referer: None)
2026-03-29 20:19:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0547/20130547/instrument_cluster-1774179485795.jpeg> (referer: None)
2026-03-29 20:19:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0547/20130547/interior_boot-1774179540458.jpeg> (referer: None)
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658737a50>
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e1d790e-fb26-544b-aa48-5abddba6d09b/0e1d790e-fb26-544b-aa48-5abddba6d09b_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0547%252F20130547%252Fdocs_service_history-1774306290586.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3097a2b066eac221202c4342c2754661') HTTP/1.1" 204 0
2026-03-29 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0547/20130547/docs_service_history-1774306290586.jpeg?ixlib=js-3.8.0&auto=format&s=3097a2b066eac221202c4342c2754661 saved to cache
2026-03-29 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0e1d790e-fb26-544b-aa48-5abddba6d09b
2026-03-29 20:19:35 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:19:35 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:19:35 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x000\xf4(\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02V\xf4\x000\xe9\xdc\x00\x00\x00\x00'
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e47d50>
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e1d790e-fb26-544b-aa48-5abddba6d09b/0e1d790e-fb26-544b-aa48-5abddba6d09b_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0547%252F20130547%252Finstrument_cluster-1774179485795.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0547/20130547/instrument_cluster-1774179485795.jpeg saved to cache
2026-03-29 20:19:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0e1d790e-fb26-544b-aa48-5abddba6d09b
2026-03-29 20:19:35 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:19:35 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:19:35 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00C\xc3\x14\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03\x9a\x9f\x00C\xb8\xc8\x00\x00\x00\x00'
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65887e050>
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e1d790e-fb26-544b-aa48-5abddba6d09b/0e1d790e-fb26-544b-aa48-5abddba6d09b_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0547%252F20130547%252Finterior_boot-1774179540458.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0547/20130547/interior_boot-1774179540458.jpeg saved to cache
2026-03-29 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0e1d790e-fb26-544b-aa48-5abddba6d09b
2026-03-29 20:19:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/3343/14573343/14573343-docs_service_history-modified-1774713750884.jpeg?ixlib=js-3.8.0&auto=format&s=d495ade1f0c6b5daf087dac08b64d7ec> (referer: None)
2026-03-29 20:19:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3343/14573343/interior_boot-1774712830192.jpg> (referer: None)
2026-03-29 20:19:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3343/14573343/instrument_cluster-1774712895799.jpg> (referer: None)
2026-03-29 20:19:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0547/20130547/interior_rear_seats-1774179386648.jpeg> (referer: None)
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583c5b90>
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66bcfb52-58aa-52ff-bd95-da479b77b96a/66bcfb52-58aa-52ff-bd95-da479b77b96a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3343%252F14573343%252F14573343-docs_service_history-modified-1774713750884.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd495ade1f0c6b5daf087dac08b64d7ec') HTTP/1.1" 204 0
2026-03-29 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3343/14573343/14573343-docs_service_history-modified-1774713750884.jpeg?ixlib=js-3.8.0&auto=format&s=d495ade1f0c6b5daf087dac08b64d7ec saved to cache
2026-03-29 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 66bcfb52-58aa-52ff-bd95-da479b77b96a
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a48ad0>
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66bcfb52-58aa-52ff-bd95-da479b77b96a/66bcfb52-58aa-52ff-bd95-da479b77b96a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3343%252F14573343%252Finterior_boot-1774712830192.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3343/14573343/interior_boot-1774712830192.jpg saved to cache
2026-03-29 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 66bcfb52-58aa-52ff-bd95-da479b77b96a
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658563650>
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66bcfb52-58aa-52ff-bd95-da479b77b96a/66bcfb52-58aa-52ff-bd95-da479b77b96a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3343%252F14573343%252Finstrument_cluster-1774712895799.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3343/14573343/instrument_cluster-1774712895799.jpg saved to cache
2026-03-29 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 66bcfb52-58aa-52ff-bd95-da479b77b96a
2026-03-29 20:19:36 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:19:36 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:19:36 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00%\x82\x86\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xe7\xca\x00%x:\x00\x00\x00\x00'
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64b939850>
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e1d790e-fb26-544b-aa48-5abddba6d09b/0e1d790e-fb26-544b-aa48-5abddba6d09b_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0547%252F20130547%252Finterior_rear_seats-1774179386648.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0547/20130547/interior_rear_seats-1774179386648.jpeg saved to cache
2026-03-29 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0e1d790e-fb26-544b-aa48-5abddba6d09b
2026-03-29 20:19:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0547/20130547/interior_front_seats-1774179334798.jpeg> (referer: None)
2026-03-29 20:19:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3343/14573343/interior_front_seats-1774712855539.jpg> (referer: None)
2026-03-29 20:19:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3343/14573343/interior_rear_seats-1774712785049.jpg> (referer: None)
2026-03-29 20:19:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0547/20130547/interior_dashboard-1774179505662.jpeg> (referer: None)
2026-03-29 20:19:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3343/14573343/interior_dashboard-1774712819246.jpg> (referer: None)
2026-03-29 20:19:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0547/20130547/exterior_rear_passenger-1774179760193.jpeg> (referer: None)
2026-03-29 20:19:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1368&page=38&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:36 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:19:36 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:19:36 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00-\xfb=\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02Mi\x00-\xf0\xf1\x00\x00\x00\x00'
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c3e150>
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e1d790e-fb26-544b-aa48-5abddba6d09b/0e1d790e-fb26-544b-aa48-5abddba6d09b_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0547%252F20130547%252Finterior_front_seats-1774179334798.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0547/20130547/interior_front_seats-1774179334798.jpeg saved to cache
2026-03-29 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0e1d790e-fb26-544b-aa48-5abddba6d09b
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587379d0>
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66bcfb52-58aa-52ff-bd95-da479b77b96a/66bcfb52-58aa-52ff-bd95-da479b77b96a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3343%252F14573343%252Finterior_front_seats-1774712855539.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3343/14573343/interior_front_seats-1774712855539.jpg saved to cache
2026-03-29 20:19:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 66bcfb52-58aa-52ff-bd95-da479b77b96a
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c4ff10>
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66bcfb52-58aa-52ff-bd95-da479b77b96a/66bcfb52-58aa-52ff-bd95-da479b77b96a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3343%252F14573343%252Finterior_rear_seats-1774712785049.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3343/14573343/interior_rear_seats-1774712785049.jpg saved to cache
2026-03-29 20:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 66bcfb52-58aa-52ff-bd95-da479b77b96a
2026-03-29 20:19:37 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:19:37 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:19:37 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x002m`\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03\x0f\xcb\x002c\x14\x00\x00\x00\x00'
2026-03-29 20:19:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfa3e50>
2026-03-29 20:19:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e1d790e-fb26-544b-aa48-5abddba6d09b/0e1d790e-fb26-544b-aa48-5abddba6d09b_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0547%252F20130547%252Finterior_dashboard-1774179505662.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0547/20130547/interior_dashboard-1774179505662.jpeg saved to cache
2026-03-29 20:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0e1d790e-fb26-544b-aa48-5abddba6d09b
2026-03-29 20:19:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf0ab50>
2026-03-29 20:19:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66bcfb52-58aa-52ff-bd95-da479b77b96a/66bcfb52-58aa-52ff-bd95-da479b77b96a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3343%252F14573343%252Finterior_dashboard-1774712819246.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3343/14573343/interior_dashboard-1774712819246.jpg saved to cache
2026-03-29 20:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 66bcfb52-58aa-52ff-bd95-da479b77b96a
2026-03-29 20:19:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6585551d0>
2026-03-29 20:19:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e1d790e-fb26-544b-aa48-5abddba6d09b/0e1d790e-fb26-544b-aa48-5abddba6d09b_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0547%252F20130547%252Fexterior_rear_passenger-1774179760193.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0547/20130547/exterior_rear_passenger-1774179760193.jpeg saved to cache
2026-03-29 20:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0e1d790e-fb26-544b-aa48-5abddba6d09b
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 20171913
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 20353654
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 19798610
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 20208609
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 20403793
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720403793%27 HTTP/1.1" 200 None
2026-03-29 20:19:37 [motorway.uk] INFO: Scrape type for 20403793: 1
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 18826766
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718826766%27 HTTP/1.1" 200 None
2026-03-29 20:19:37 [motorway.uk] INFO: Scrape type for 18826766: 1
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 15306667
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 18106884
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718106884%27 HTTP/1.1" 200 None
2026-03-29 20:19:37 [motorway.uk] INFO: Scrape type for 18106884: 1
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 20481936
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720481936%27 HTTP/1.1" 200 None
2026-03-29 20:19:37 [motorway.uk] INFO: Scrape type for 20481936: 1
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 17411348
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 20387296
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 20352821
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 20440778
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 20434747
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 20475784
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 13472860
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 19800646
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 20486113
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 9188015
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279188015%27 HTTP/1.1" 200 None
2026-03-29 20:19:37 [motorway.uk] INFO: Scrape type for 9188015: 1
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 19873205
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 19831066
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719831066%27 HTTP/1.1" 200 None
2026-03-29 20:19:37 [motorway.uk] INFO: Scrape type for 19831066: 2
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 18930020
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 19619181
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 20103257
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720103257%27 HTTP/1.1" 200 None
2026-03-29 20:19:37 [motorway.uk] INFO: Scrape type for 20103257: 1
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 20453524
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720453524%27 HTTP/1.1" 200 None
2026-03-29 20:19:37 [motorway.uk] INFO: Scrape type for 20453524: 1
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 4610978
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%274610978%27 HTTP/1.1" 200 None
2026-03-29 20:19:37 [motorway.uk] INFO: Scrape type for 4610978: 1
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 20397419
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 17989138
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 20389959
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 20460435
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 20487343
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 19895213
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 20432299
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 19974522
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719974522%27 HTTP/1.1" 200 None
2026-03-29 20:19:37 [motorway.uk] INFO: Scrape type for 19974522: 1
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 18180278
2026-03-29 20:19:37 [motorway.uk] INFO: Found listing with ID: 19957959
2026-03-29 20:19:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0547/20130547/exterior_rear_driver-1774179748476.jpeg> (referer: None)
2026-03-29 20:19:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65843c790>
2026-03-29 20:19:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e1d790e-fb26-544b-aa48-5abddba6d09b/0e1d790e-fb26-544b-aa48-5abddba6d09b_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0547%252F20130547%252Fexterior_rear_driver-1774179748476.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0547/20130547/exterior_rear_driver-1774179748476.jpeg saved to cache
2026-03-29 20:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0e1d790e-fb26-544b-aa48-5abddba6d09b
2026-03-29 20:19:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3343/14573343/exterior_front_driver-1774712609308.jpg> (referer: None)
2026-03-29 20:19:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3343/14573343/exterior_rear_passenger-1774712658636.jpg> (referer: None)
2026-03-29 20:19:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3343/14573343/exterior_front_passenger-1774712641185.jpg> (referer: None)
2026-03-29 20:19:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0547/20130547/exterior_front_driver-1774179816766.jpeg> (referer: None)
2026-03-29 20:19:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2217/20492217/exterior_front_passenger-1774720321429.jpg> (referer: None)
2026-03-29 20:19:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c5a010>
2026-03-29 20:19:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66bcfb52-58aa-52ff-bd95-da479b77b96a/66bcfb52-58aa-52ff-bd95-da479b77b96a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3343%252F14573343%252Fexterior_front_driver-1774712609308.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3343/14573343/exterior_front_driver-1774712609308.jpg saved to cache
2026-03-29 20:19:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 66bcfb52-58aa-52ff-bd95-da479b77b96a
2026-03-29 20:19:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589fbd10>
2026-03-29 20:19:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66bcfb52-58aa-52ff-bd95-da479b77b96a/66bcfb52-58aa-52ff-bd95-da479b77b96a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3343%252F14573343%252Fexterior_rear_passenger-1774712658636.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3343/14573343/exterior_rear_passenger-1774712658636.jpg saved to cache
2026-03-29 20:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 66bcfb52-58aa-52ff-bd95-da479b77b96a
2026-03-29 20:19:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b2e690>
2026-03-29 20:19:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66bcfb52-58aa-52ff-bd95-da479b77b96a/66bcfb52-58aa-52ff-bd95-da479b77b96a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3343%252F14573343%252Fexterior_front_passenger-1774712641185.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3343/14573343/exterior_front_passenger-1774712641185.jpg saved to cache
2026-03-29 20:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 66bcfb52-58aa-52ff-bd95-da479b77b96a
2026-03-29 20:19:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b4a410>
2026-03-29 20:19:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e1d790e-fb26-544b-aa48-5abddba6d09b/0e1d790e-fb26-544b-aa48-5abddba6d09b_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0547%252F20130547%252Fexterior_front_driver-1774179816766.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0547/20130547/exterior_front_driver-1774179816766.jpeg saved to cache
2026-03-29 20:19:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e1d790e-fb26-544b-aa48-5abddba6d09b
2026-03-29 20:19:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e1d790e-fb26-544b-aa48-5abddba6d09b, skipping ID generation
2026-03-29 20:19:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e1d790e-fb26-544b-aa48-5abddba6d09b with scrape type 1
2026-03-29 20:19:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e1d790e-fb26-544b-aa48-5abddba6d09b sending to next pipeline
2026-03-29 20:19:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 0e1d790e-fb26-544b-aa48-5abddba6d09b, identifier: 20130547
2026-03-29 20:19:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 0e1d790e-fb26-544b-aa48-5abddba6d09b with identifier: 20130547
2026-03-29 20:19:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 0e1d790e-fb26-544b-aa48-5abddba6d09b with identifier: 20130547
2026-03-29 20:19:38 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 0e1d790e-fb26-544b-aa48-5abddba6d09b with identifier: 20130547 to the API
2026-03-29 20:19:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0547/20130547/exterior_front_driver-1774179816766.jpeg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '0e1d790e-fb26-544b-aa48-5abddba6d09b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'WM08 UPC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20130547',
'listing': 'auction',
'location': 'Hampshire Southampton',
'make': 'BMW',
'model': '1 Series',
'odometer': 95715,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e1d790e-fb26-544b-aa48-5abddba6d09b/0e1d790e-fb26-544b-aa48-5abddba6d09b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2096062,
'Height': 2666,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0547/20130547/exterior_front_driver-1774179816766.jpeg',
'Width': 3554},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e1d790e-fb26-544b-aa48-5abddba6d09b/0e1d790e-fb26-544b-aa48-5abddba6d09b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2555750,
'Height': 2980,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0547/20130547/exterior_rear_driver-1774179748476.jpeg',
'Width': 3973},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e1d790e-fb26-544b-aa48-5abddba6d09b/0e1d790e-fb26-544b-aa48-5abddba6d09b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2416250,
'Height': 2997,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0547/20130547/exterior_front_passenger-1774179779887.jpeg',
'Width': 3996},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e1d790e-fb26-544b-aa48-5abddba6d09b/0e1d790e-fb26-544b-aa48-5abddba6d09b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2165937,
'Height': 2959,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0547/20130547/exterior_rear_passenger-1774179760193.jpeg',
'Width': 3945},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e1d790e-fb26-544b-aa48-5abddba6d09b/0e1d790e-fb26-544b-aa48-5abddba6d09b_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3164326,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0547/20130547/interior_front_seats-1774179334798.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e1d790e-fb26-544b-aa48-5abddba6d09b/0e1d790e-fb26-544b-aa48-5abddba6d09b_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2583120,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0547/20130547/interior_rear_seats-1774179386648.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e1d790e-fb26-544b-aa48-5abddba6d09b/0e1d790e-fb26-544b-aa48-5abddba6d09b_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3505451,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0547/20130547/interior_dashboard-1774179505662.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e1d790e-fb26-544b-aa48-5abddba6d09b/0e1d790e-fb26-544b-aa48-5abddba6d09b_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3361564,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0547/20130547/instrument_cluster-1774179485795.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e1d790e-fb26-544b-aa48-5abddba6d09b/0e1d790e-fb26-544b-aa48-5abddba6d09b_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4677043,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0547/20130547/interior_boot-1774179540458.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e1d790e-fb26-544b-aa48-5abddba6d09b/0e1d790e-fb26-544b-aa48-5abddba6d09b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1607738,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0547/20130547/docs_service_history-1774306290586.jpeg?ixlib=js-3.8.0&auto=format&s=3097a2b066eac221202c4342c2754661',
'Width': 4032}],
'price': 2259,
'price_includes_vat': False,
'registration_date': '2008-08-08',
'seats_number': None,
'seller_name': None,
'title': 'BMW 118D M Sport Auto',
'transmission': 'automatic',
'trim': '118D M Sport Auto',
'vin': 'WBAUD72050PE41075',
'year': 2008}
2026-03-29 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720130547%27 HTTP/1.1" 200 None
2026-03-29 20:19:38 [motorway.uk] INFO: Saving data for 20130547: {'created_time': 1774815578.941438, 'last_price_update_time': 1774815578.94145, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20130547') HTTP/1.1" 204 0
2026-03-29 20:19:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598c8a50>
2026-03-29 20:19:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a73baf94-6acc-558d-9e97-8756297fc494/a73baf94-6acc-558d-9e97-8756297fc494_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2217%252F20492217%252Fexterior_front_passenger-1774720321429.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2217/20492217/exterior_front_passenger-1774720321429.jpg saved to cache
2026-03-29 20:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a73baf94-6acc-558d-9e97-8756297fc494
2026-03-29 20:19:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3343/14573343/exterior_rear_driver-1774712668420.jpg> (referer: None)
2026-03-29 20:19:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d4e8d0>
2026-03-29 20:19:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66bcfb52-58aa-52ff-bd95-da479b77b96a/66bcfb52-58aa-52ff-bd95-da479b77b96a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3343%252F14573343%252Fexterior_rear_driver-1774712668420.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3343/14573343/exterior_rear_driver-1774712668420.jpg saved to cache
2026-03-29 20:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 66bcfb52-58aa-52ff-bd95-da479b77b96a
2026-03-29 20:19:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 66bcfb52-58aa-52ff-bd95-da479b77b96a, skipping ID generation
2026-03-29 20:19:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66bcfb52-58aa-52ff-bd95-da479b77b96a with scrape type 1
2026-03-29 20:19:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 66bcfb52-58aa-52ff-bd95-da479b77b96a sending to next pipeline
2026-03-29 20:19:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 66bcfb52-58aa-52ff-bd95-da479b77b96a, identifier: 14573343
2026-03-29 20:19:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 66bcfb52-58aa-52ff-bd95-da479b77b96a with identifier: 14573343
2026-03-29 20:19:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 66bcfb52-58aa-52ff-bd95-da479b77b96a with identifier: 14573343
2026-03-29 20:19:39 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 66bcfb52-58aa-52ff-bd95-da479b77b96a with identifier: 14573343 to the API
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3343/14573343/exterior_rear_driver-1774712668420.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '66bcfb52-58aa-52ff-bd95-da479b77b96a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WG22 FOH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/14573343',
'listing': 'auction',
'location': 'Gloucestershire Cheltenham',
'make': 'Mercedes',
'model': 'AMG',
'odometer': 23799,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66bcfb52-58aa-52ff-bd95-da479b77b96a/66bcfb52-58aa-52ff-bd95-da479b77b96a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 895774,
'Height': 2157,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3343/14573343/exterior_front_driver-1774712609308.jpg',
'Width': 2876},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66bcfb52-58aa-52ff-bd95-da479b77b96a/66bcfb52-58aa-52ff-bd95-da479b77b96a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548846,
'Height': 2287,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3343/14573343/exterior_rear_driver-1774712668420.jpg',
'Width': 3049},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66bcfb52-58aa-52ff-bd95-da479b77b96a/66bcfb52-58aa-52ff-bd95-da479b77b96a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 816179,
'Height': 2279,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3343/14573343/exterior_front_passenger-1774712641185.jpg',
'Width': 3038},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66bcfb52-58aa-52ff-bd95-da479b77b96a/66bcfb52-58aa-52ff-bd95-da479b77b96a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 824932,
'Height': 2319,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3343/14573343/exterior_rear_passenger-1774712658636.jpg',
'Width': 3092},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66bcfb52-58aa-52ff-bd95-da479b77b96a/66bcfb52-58aa-52ff-bd95-da479b77b96a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1233491,
'Height': 3072,
'OriginUrl': 'https://motorway-photos.imgix.net/3343/14573343/interior_front_seats-1774712855539.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66bcfb52-58aa-52ff-bd95-da479b77b96a/66bcfb52-58aa-52ff-bd95-da479b77b96a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1207624,
'Height': 3072,
'OriginUrl': 'https://motorway-photos.imgix.net/3343/14573343/interior_rear_seats-1774712785049.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66bcfb52-58aa-52ff-bd95-da479b77b96a/66bcfb52-58aa-52ff-bd95-da479b77b96a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1176449,
'Height': 3072,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3343/14573343/interior_dashboard-1774712819246.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66bcfb52-58aa-52ff-bd95-da479b77b96a/66bcfb52-58aa-52ff-bd95-da479b77b96a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 943161,
'Height': 3072,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3343/14573343/instrument_cluster-1774712895799.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66bcfb52-58aa-52ff-bd95-da479b77b96a/66bcfb52-58aa-52ff-bd95-da479b77b96a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1015597,
'Height': 3072,
'OriginUrl': 'https://motorway-photos.imgix.net/3343/14573343/interior_boot-1774712830192.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_66bcfb52-58aa-52ff-bd95-da479b77b96a/66bcfb52-58aa-52ff-bd95-da479b77b96a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 129014,
'Height': 1790,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/3343/14573343/14573343-docs_service_history-modified-1774713750884.jpeg?ixlib=js-3.8.0&auto=format&s=d495ade1f0c6b5daf087dac08b64d7ec',
'Width': 1343}],
'price': 24367,
'price_includes_vat': False,
'registration_date': '2022-05-21',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes AMG CLA 35 Premium 4MATIC Auto',
'transmission': 'automatic',
'trim': 'CLA 35 Premium 4MATIC Auto',
'vin': 'W1K1183512N308786',
'year': 2022}
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714573343%27 HTTP/1.1" 200 None
2026-03-29 20:19:39 [motorway.uk] INFO: Saving data for 14573343: {'created_time': 1774815579.780243, 'last_price_update_time': 1774815579.780253, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='14573343') HTTP/1.1" 204 0
2026-03-29 20:19:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13628545.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d15d962-11e6-5ca7-b539-a53b24167352 with identifier: 13628545
2026-03-29 20:19:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d15d962-11e6-5ca7-b539-a53b24167352 with scrape type 1
2026-03-29 20:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0d15d962-11e6-5ca7-b539-a53b24167352
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8545%252F13628545%252Fexterior_front_driver-1774721804986.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8545/13628545/exterior_front_driver-1774721804986.jpeg not downloaded yet
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8545%252F13628545%252F13628545-exterior_rear_driver-modified-1774781815218.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8545/13628545/13628545-exterior_rear_driver-modified-1774781815218.jpeg not downloaded yet
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8545%252F13628545%252Fexterior_front_passenger-1774721814981.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8545/13628545/exterior_front_passenger-1774721814981.jpeg not downloaded yet
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8545%252F13628545%252F13628545-exterior_rear_passenger-modified-1774781837236.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8545/13628545/13628545-exterior_rear_passenger-modified-1774781837236.jpeg not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8545%252F13628545%252Finterior_front_seats-1774722148886.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8545/13628545/interior_front_seats-1774722148886.jpeg not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8545%252F13628545%252Finterior_rear_seats-1774722043725.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8545/13628545/interior_rear_seats-1774722043725.jpeg not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8545%252F13628545%252F13628545-interior_dashboard-modified-1774781909652.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8545/13628545/13628545-interior_dashboard-modified-1774781909652.jpeg not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8545%252F13628545%252F13628545-instrument_cluster-modified-1774781949542.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8545/13628545/13628545-instrument_cluster-modified-1774781949542.jpeg not downloaded yet
2026-03-29 20:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20450166.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8545%252F13628545%252Finterior_boot-1774722094586.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8545/13628545/interior_boot-1774722094586.jpeg not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8545%252F13628545%252F13628545-docs_service_history-modified-1774782120721.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da88acb976392271e94c046996f875906%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8545/13628545/13628545-docs_service_history-modified-1774782120721.jpeg?ixlib=js-3.8.0&auto=format&s=a88acb976392271e94c046996f875906 not downloaded yet
2026-03-29 20:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19189698.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ae03905-fe2f-550c-b063-813d66824638 with identifier: 20450166
2026-03-29 20:19:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ae03905-fe2f-550c-b063-813d66824638 with scrape type 1
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5ae03905-fe2f-550c-b063-813d66824638
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0166%252F20450166%252Fexterior_front_driver-1774773862903.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0166/20450166/exterior_front_driver-1774773862903.jpg not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0166%252F20450166%252Fexterior_rear_driver-1774773958253.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0166/20450166/exterior_rear_driver-1774773958253.jpg not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0166%252F20450166%252Fexterior_front_passenger-1774774379123.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0166/20450166/exterior_front_passenger-1774774379123.jpg not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0166%252F20450166%252Fexterior_rear_passenger-1774774036021.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0166/20450166/exterior_rear_passenger-1774774036021.jpg not downloaded yet
2026-03-29 20:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20020846.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d556f659-7139-5edb-b94e-2fe4a5a70566 with identifier: 19189698
2026-03-29 20:19:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d556f659-7139-5edb-b94e-2fe4a5a70566 with scrape type 1
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d556f659-7139-5edb-b94e-2fe4a5a70566
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9698%252F19189698%252Fexterior_front_driver-1774711687012.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9698/19189698/exterior_front_driver-1774711687012.jpg not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0166%252F20450166%252Finterior_front_seats-1774772024203.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0166/20450166/interior_front_seats-1774772024203.jpg not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9698%252F19189698%252Fexterior_rear_driver-1774711716533.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9698/19189698/exterior_rear_driver-1774711716533.jpg not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0166%252F20450166%252Finterior_rear_seats-1774772010464.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0166/20450166/interior_rear_seats-1774772010464.jpg not downloaded yet
2026-03-29 20:19:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab00e38c-56dd-50ae-8c85-d51b6e009397 with identifier: 20020846
2026-03-29 20:19:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab00e38c-56dd-50ae-8c85-d51b6e009397 with scrape type 1
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ab00e38c-56dd-50ae-8c85-d51b6e009397
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0846%252F20020846%252Fexterior_front_driver-1774632660615.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0846/20020846/exterior_front_driver-1774632660615.jpeg not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9698%252F19189698%252Fexterior_front_passenger-1774716454410.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9698/19189698/exterior_front_passenger-1774716454410.jpg not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0166%252F20450166%252Finterior_dashboard-1774772191764.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0166/20450166/interior_dashboard-1774772191764.jpg not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0846%252F20020846%252Fexterior_rear_driver-1774632349065.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0846/20020846/exterior_rear_driver-1774632349065.jpeg not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9698%252F19189698%252Fexterior_rear_passenger-1774711753381.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9698/19189698/exterior_rear_passenger-1774711753381.jpg not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0166%252F20450166%252Finterior_boot-1774772006143.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0166/20450166/interior_boot-1774772006143.jpg not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0846%252F20020846%252Fexterior_front_passenger-1774632321086.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0846/20020846/exterior_front_passenger-1774632321086.jpeg not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9698%252F19189698%252Finterior_front_seats-1774712385682.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9698/19189698/interior_front_seats-1774712385682.jpg not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0166%252F20450166%252Fdocs_service_history-1774772045379.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D49d4143f42318138d31f6ab051fde7c7%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0166/20450166/docs_service_history-1774772045379.jpg?ixlib=js-3.8.0&auto=format&s=49d4143f42318138d31f6ab051fde7c7 not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0846%252F20020846%252Fexterior_rear_passenger-1774632334213.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0846/20020846/exterior_rear_passenger-1774632334213.jpeg not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9698%252F19189698%252Finterior_rear_seats-1774712368594.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9698/19189698/interior_rear_seats-1774712368594.jpg not downloaded yet
2026-03-29 20:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0166/20450166/exterior_front_passenger-1774774379123.jpg> (referer: None)
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0166%252F20450166%252Fdamage_scratches-1774773625463.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0166/20450166/damage_scratches-1774773625463.jpg not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0846%252F20020846%252Finterior_front_seats-1774632541459.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0846/20020846/interior_front_seats-1774632541459.jpeg not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9698%252F19189698%252Finterior_dashboard-1774712393301.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9698/19189698/interior_dashboard-1774712393301.jpg not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0846%252F20020846%252Finterior_rear_seats-1774632419768.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0846/20020846/interior_rear_seats-1774632419768.jpeg not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9698%252F19189698%252Finstrument_cluster-1774712365606.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9698/19189698/instrument_cluster-1774712365606.jpg not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0846%252F20020846%252Finterior_dashboard-1774632453998.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0846/20020846/interior_dashboard-1774632453998.jpeg not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9698%252F19189698%252Finterior_boot-1774712375039.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9698/19189698/interior_boot-1774712375039.jpg not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0846%252F20020846%252Finterior_boot-1774632466937.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0846/20020846/interior_boot-1774632466937.jpeg not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9698%252F19189698%252Fdocs_service_history-1774712730486.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db044c16a4d25d41ab85e534e540f298e%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9698/19189698/docs_service_history-1774712730486.jpg?ixlib=js-3.8.0&auto=format&s=b044c16a4d25d41ab85e534e540f298e not downloaded yet
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c586d0>
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ae03905-fe2f-550c-b063-813d66824638/5ae03905-fe2f-550c-b063-813d66824638_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0166%252F20450166%252Fexterior_front_passenger-1774774379123.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0166/20450166/exterior_front_passenger-1774774379123.jpg saved to cache
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5ae03905-fe2f-550c-b063-813d66824638
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0846%252F20020846%252Fdocs_service_history-1774633374793.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D79fc389826ce525f80a2c7122dc9afde%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0846/20020846/docs_service_history-1774633374793.jpeg?ixlib=js-3.8.0&auto=format&s=79fc389826ce525f80a2c7122dc9afde not downloaded yet
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0846%252F20020846%252Fdocs_service_history-1774633384263.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De0a3bd5052929a8c92bc184bf38d1fcc%27 HTTP/1.1" 200 None
2026-03-29 20:19:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0846/20020846/docs_service_history-1774633384263.jpeg?ixlib=js-3.8.0&auto=format&s=e0a3bd5052929a8c92bc184bf38d1fcc not downloaded yet
2026-03-29 20:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/8545/13628545/13628545-docs_service_history-modified-1774782120721.jpeg?ixlib=js-3.8.0&auto=format&s=a88acb976392271e94c046996f875906> (referer: None)
2026-03-29 20:19:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8545/13628545/13628545-interior_dashboard-modified-1774781909652.jpeg> (referer: None)
2026-03-29 20:19:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659afd2d0>
2026-03-29 20:19:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d15d962-11e6-5ca7-b539-a53b24167352/0d15d962-11e6-5ca7-b539-a53b24167352_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8545%252F13628545%252F13628545-docs_service_history-modified-1774782120721.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da88acb976392271e94c046996f875906') HTTP/1.1" 204 0
2026-03-29 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8545/13628545/13628545-docs_service_history-modified-1774782120721.jpeg?ixlib=js-3.8.0&auto=format&s=a88acb976392271e94c046996f875906 saved to cache
2026-03-29 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0d15d962-11e6-5ca7-b539-a53b24167352
2026-03-29 20:19:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583fa2d0>
2026-03-29 20:19:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d15d962-11e6-5ca7-b539-a53b24167352/0d15d962-11e6-5ca7-b539-a53b24167352_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8545%252F13628545%252F13628545-interior_dashboard-modified-1774781909652.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8545/13628545/13628545-interior_dashboard-modified-1774781909652.jpeg saved to cache
2026-03-29 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0d15d962-11e6-5ca7-b539-a53b24167352
2026-03-29 20:19:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9698/19189698/interior_rear_seats-1774712368594.jpg> (referer: None)
2026-03-29 20:19:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0846/20020846/docs_service_history-1774633374793.jpeg?ixlib=js-3.8.0&auto=format&s=79fc389826ce525f80a2c7122dc9afde> (referer: None)
2026-03-29 20:19:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0846/20020846/docs_service_history-1774633384263.jpeg?ixlib=js-3.8.0&auto=format&s=e0a3bd5052929a8c92bc184bf38d1fcc> (referer: None)
2026-03-29 20:19:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589c4910>
2026-03-29 20:19:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d556f659-7139-5edb-b94e-2fe4a5a70566/d556f659-7139-5edb-b94e-2fe4a5a70566_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9698%252F19189698%252Finterior_rear_seats-1774712368594.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9698/19189698/interior_rear_seats-1774712368594.jpg saved to cache
2026-03-29 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d556f659-7139-5edb-b94e-2fe4a5a70566
2026-03-29 20:19:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c39450>
2026-03-29 20:19:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab00e38c-56dd-50ae-8c85-d51b6e009397/ab00e38c-56dd-50ae-8c85-d51b6e009397_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0846%252F20020846%252Fdocs_service_history-1774633374793.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D79fc389826ce525f80a2c7122dc9afde') HTTP/1.1" 204 0
2026-03-29 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0846/20020846/docs_service_history-1774633374793.jpeg?ixlib=js-3.8.0&auto=format&s=79fc389826ce525f80a2c7122dc9afde saved to cache
2026-03-29 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ab00e38c-56dd-50ae-8c85-d51b6e009397
2026-03-29 20:19:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ae0190>
2026-03-29 20:19:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab00e38c-56dd-50ae-8c85-d51b6e009397/ab00e38c-56dd-50ae-8c85-d51b6e009397_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0846%252F20020846%252Fdocs_service_history-1774633384263.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De0a3bd5052929a8c92bc184bf38d1fcc') HTTP/1.1" 204 0
2026-03-29 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0846/20020846/docs_service_history-1774633384263.jpeg?ixlib=js-3.8.0&auto=format&s=e0a3bd5052929a8c92bc184bf38d1fcc saved to cache
2026-03-29 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ab00e38c-56dd-50ae-8c85-d51b6e009397
2026-03-29 20:19:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19659666.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9698/19189698/docs_service_history-1774712730486.jpg?ixlib=js-3.8.0&auto=format&s=b044c16a4d25d41ab85e534e540f298e> (referer: None)
2026-03-29 20:19:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e977a8f-3e20-507c-ad90-6c627ef92912 with identifier: 19659666
2026-03-29 20:19:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e977a8f-3e20-507c-ad90-6c627ef92912 with scrape type 1
2026-03-29 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e977a8f-3e20-507c-ad90-6c627ef92912
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9666%252F19659666%252Fexterior_front_driver-1770379627828.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9666/19659666/exterior_front_driver-1770379627828.jpeg already downloaded
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9666%252F19659666%252Fexterior_rear_driver-1770379612588.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9666/19659666/exterior_rear_driver-1770379612588.jpeg already downloaded
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9666%252F19659666%252Fexterior_front_passenger-1770379581171.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9666/19659666/exterior_front_passenger-1770379581171.jpeg already downloaded
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9666%252F19659666%252Fexterior_rear_passenger-1770379603103.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9666/19659666/exterior_rear_passenger-1770379603103.jpeg already downloaded
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9666%252F19659666%252Finterior_front_seats-1770379869895.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9666/19659666/interior_front_seats-1770379869895.jpeg already downloaded
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9666%252F19659666%252Finterior_rear_seats-1770379740355.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9666/19659666/interior_rear_seats-1770379740355.jpeg already downloaded
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9666%252F19659666%252F19659666-interior_dashboard-modified-1771603533744.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9666/19659666/19659666-interior_dashboard-modified-1771603533744.jpeg already downloaded
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9666%252F19659666%252F19659666-instrument_cluster-modified-1771603437468.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9666/19659666/19659666-instrument_cluster-modified-1771603437468.jpeg already downloaded
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9666%252F19659666%252Finterior_boot-1770379791398.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9666/19659666/interior_boot-1770379791398.jpeg already downloaded
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9666%252F19659666%252F19659666-docs_service_history-modified-1771611346180.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0115792dec032e935246960fba485c3a%27 HTTP/1.1" 200 None
2026-03-29 20:19:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9666/19659666/19659666-docs_service_history-modified-1771611346180.jpeg?ixlib=js-3.8.0&auto=format&s=0115792dec032e935246960fba485c3a already downloaded
2026-03-29 20:19:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8e977a8f-3e20-507c-ad90-6c627ef92912, identifier: 19659666
2026-03-29 20:19:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8e977a8f-3e20-507c-ad90-6c627ef92912 with identifier: 19659666
2026-03-29 20:19:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8e977a8f-3e20-507c-ad90-6c627ef92912 with identifier: 19659666
2026-03-29 20:19:42 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8e977a8f-3e20-507c-ad90-6c627ef92912 with identifier: 19659666 to the API
2026-03-29 20:19:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19659666.json>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '8e977a8f-3e20-507c-ad90-6c627ef92912',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'G9 NKY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19659666',
'listing': 'auction',
'location': 'North Lanarkshire Coatbridge',
'make': 'Audi',
'model': 'Q5',
'odometer': 57488,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/9666/19659666/exterior_front_driver-1770379627828.jpeg',
'https://motorway-photos-redacted.imgix.net/9666/19659666/exterior_rear_driver-1770379612588.jpeg',
'https://motorway-photos-redacted.imgix.net/9666/19659666/exterior_front_passenger-1770379581171.jpeg',
'https://motorway-photos-redacted.imgix.net/9666/19659666/exterior_rear_passenger-1770379603103.jpeg',
'https://motorway-photos.imgix.net/9666/19659666/interior_front_seats-1770379869895.jpeg',
'https://motorway-photos.imgix.net/9666/19659666/interior_rear_seats-1770379740355.jpeg',
'https://motorway-photos-modified.imgix.net/9666/19659666/19659666-interior_dashboard-modified-1771603533744.jpeg',
'https://motorway-photos-modified.imgix.net/9666/19659666/19659666-instrument_cluster-modified-1771603437468.jpeg',
'https://motorway-photos.imgix.net/9666/19659666/interior_boot-1770379791398.jpeg',
'https://motorway-service-history-photos.imgix.net/modified/9666/19659666/19659666-docs_service_history-modified-1771611346180.jpeg?ixlib=js-3.8.0&auto=format&s=0115792dec032e935246960fba485c3a'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e977a8f-3e20-507c-ad90-6c627ef92912/8e977a8f-3e20-507c-ad90-6c627ef92912_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3284082,
'Height': 4660,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9666/19659666/exterior_front_driver-1770379627828.jpeg',
'Width': 6213},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e977a8f-3e20-507c-ad90-6c627ef92912/8e977a8f-3e20-507c-ad90-6c627ef92912_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4197617,
'Height': 4616,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9666/19659666/exterior_rear_driver-1770379612588.jpeg',
'Width': 6155},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e977a8f-3e20-507c-ad90-6c627ef92912/8e977a8f-3e20-507c-ad90-6c627ef92912_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3860273,
'Height': 4586,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9666/19659666/exterior_front_passenger-1770379581171.jpeg',
'Width': 6114},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e977a8f-3e20-507c-ad90-6c627ef92912/8e977a8f-3e20-507c-ad90-6c627ef92912_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4075717,
'Height': 4633,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9666/19659666/exterior_rear_passenger-1770379603103.jpeg',
'Width': 6177},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e977a8f-3e20-507c-ad90-6c627ef92912/8e977a8f-3e20-507c-ad90-6c627ef92912_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 8889328,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/9666/19659666/interior_front_seats-1770379869895.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e977a8f-3e20-507c-ad90-6c627ef92912/8e977a8f-3e20-507c-ad90-6c627ef92912_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 8412183,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/9666/19659666/interior_rear_seats-1770379740355.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e977a8f-3e20-507c-ad90-6c627ef92912/8e977a8f-3e20-507c-ad90-6c627ef92912_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5380824,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9666/19659666/19659666-interior_dashboard-modified-1771603533744.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e977a8f-3e20-507c-ad90-6c627ef92912/8e977a8f-3e20-507c-ad90-6c627ef92912_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 1579907,
'Height': 3209,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9666/19659666/19659666-instrument_cluster-modified-1771603437468.jpeg',
'Width': 4279},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e977a8f-3e20-507c-ad90-6c627ef92912/8e977a8f-3e20-507c-ad90-6c627ef92912_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 7066960,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/9666/19659666/interior_boot-1770379791398.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e977a8f-3e20-507c-ad90-6c627ef92912/8e977a8f-3e20-507c-ad90-6c627ef92912_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89945,
'Height': 1162,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/9666/19659666/19659666-docs_service_history-modified-1771611346180.jpeg?ixlib=js-3.8.0&auto=format&s=0115792dec032e935246960fba485c3a',
'Width': 1549}],
'price': 18422,
'price_includes_vat': False,
'registration_date': '2019-04-29',
'seats_number': None,
'seller_name': None,
'title': 'Audi Q5 S Line 40 TDI Quattro S-A',
'transmission': 'automatic',
'trim': 'S Line 40 TDI Quattro S-A',
'vin': 'WAUZZZFY3K2062138',
'year': 2019}
2026-03-29 20:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719659666%27 HTTP/1.1" 200 None
2026-03-29 20:19:42 [motorway.uk] INFO: Saving data for 19659666: {'created_time': 1774815582.525793, 'last_price_update_time': 1774815582.525804, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19659666') HTTP/1.1" 204 0
2026-03-29 20:19:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a0e2d0>
2026-03-29 20:19:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d556f659-7139-5edb-b94e-2fe4a5a70566/d556f659-7139-5edb-b94e-2fe4a5a70566_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9698%252F19189698%252Fdocs_service_history-1774712730486.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db044c16a4d25d41ab85e534e540f298e') HTTP/1.1" 204 0
2026-03-29 20:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9698/19189698/docs_service_history-1774712730486.jpg?ixlib=js-3.8.0&auto=format&s=b044c16a4d25d41ab85e534e540f298e saved to cache
2026-03-29 20:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d556f659-7139-5edb-b94e-2fe4a5a70566
2026-03-29 20:19:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0846/20020846/interior_boot-1774632466937.jpeg> (referer: None)
2026-03-29 20:19:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9698/19189698/instrument_cluster-1774712365606.jpg> (referer: None)
2026-03-29 20:19:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9698/19189698/interior_boot-1774712375039.jpg> (referer: None)
2026-03-29 20:19:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0846/20020846/interior_dashboard-1774632453998.jpeg> (referer: None)
2026-03-29 20:19:42 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:19:42 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:19:42 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x001\xec>\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xe8\xa4\x001\xe1\xa0\x00\x00\x00\x00'
2026-03-29 20:19:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a0e990>
2026-03-29 20:19:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab00e38c-56dd-50ae-8c85-d51b6e009397/ab00e38c-56dd-50ae-8c85-d51b6e009397_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0846%252F20020846%252Finterior_boot-1774632466937.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0846/20020846/interior_boot-1774632466937.jpeg saved to cache
2026-03-29 20:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ab00e38c-56dd-50ae-8c85-d51b6e009397
2026-03-29 20:19:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20403793.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/4610978.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bee9d50>
2026-03-29 20:19:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d556f659-7139-5edb-b94e-2fe4a5a70566/d556f659-7139-5edb-b94e-2fe4a5a70566_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9698%252F19189698%252Finstrument_cluster-1774712365606.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9698/19189698/instrument_cluster-1774712365606.jpg saved to cache
2026-03-29 20:19:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d556f659-7139-5edb-b94e-2fe4a5a70566
2026-03-29 20:19:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ace410>
2026-03-29 20:19:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d556f659-7139-5edb-b94e-2fe4a5a70566/d556f659-7139-5edb-b94e-2fe4a5a70566_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9698%252F19189698%252Finterior_boot-1774712375039.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9698/19189698/interior_boot-1774712375039.jpg saved to cache
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d556f659-7139-5edb-b94e-2fe4a5a70566
2026-03-29 20:19:43 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:19:43 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:19:43 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x009\xf3\n\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xe2\xfb\x009\xe8l\x00\x00\x00\x00'
2026-03-29 20:19:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bd922d0>
2026-03-29 20:19:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab00e38c-56dd-50ae-8c85-d51b6e009397/ab00e38c-56dd-50ae-8c85-d51b6e009397_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0846%252F20020846%252Finterior_dashboard-1774632453998.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0846/20020846/interior_dashboard-1774632453998.jpeg saved to cache
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ab00e38c-56dd-50ae-8c85-d51b6e009397
2026-03-29 20:19:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d47b74f8-51da-5db6-b64c-19647684da8c with identifier: 20403793
2026-03-29 20:19:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d47b74f8-51da-5db6-b64c-19647684da8c with scrape type 1
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d47b74f8-51da-5db6-b64c-19647684da8c
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3793%252F20403793%252Fexterior_front_driver-1774695565616.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3793/20403793/exterior_front_driver-1774695565616.jpg not downloaded yet
2026-03-29 20:19:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5283d03-b5c9-5d91-8fdf-3c598fb48b96 with identifier: 4610978
2026-03-29 20:19:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5283d03-b5c9-5d91-8fdf-3c598fb48b96 with scrape type 1
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5283d03-b5c9-5d91-8fdf-3c598fb48b96
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0978%252F4610978%252Fexterior_front_driver-1774619527373.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0978/4610978/exterior_front_driver-1774619527373.jpg not downloaded yet
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3793%252F20403793%252Fexterior_rear_driver-1774695584180.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3793/20403793/exterior_rear_driver-1774695584180.jpg not downloaded yet
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0978%252F4610978%252Fexterior_rear_driver-1774619530989.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0978/4610978/exterior_rear_driver-1774619530989.jpg not downloaded yet
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3793%252F20403793%252Fexterior_front_passenger-1774695604327.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3793/20403793/exterior_front_passenger-1774695604327.jpg not downloaded yet
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0978%252F4610978%252Fexterior_front_passenger-1774619538810.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0978/4610978/exterior_front_passenger-1774619538810.jpg not downloaded yet
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3793%252F20403793%252Fexterior_rear_passenger-1774695589919.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3793/20403793/exterior_rear_passenger-1774695589919.jpg not downloaded yet
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0978%252F4610978%252Fexterior_rear_passenger-1774619553512.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0978/4610978/exterior_rear_passenger-1774619553512.jpg not downloaded yet
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3793%252F20403793%252Finterior_front_seats-1774696307264.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3793/20403793/interior_front_seats-1774696307264.jpg not downloaded yet
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0978%252F4610978%252Finterior_front_seats-1774619974101.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0978/4610978/interior_front_seats-1774619974101.jpg not downloaded yet
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3793%252F20403793%252Finterior_rear_seats-1774696243278.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3793/20403793/interior_rear_seats-1774696243278.jpg not downloaded yet
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0978%252F4610978%252Finterior_rear_seats-1774619969881.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0978/4610978/interior_rear_seats-1774619969881.jpg not downloaded yet
2026-03-29 20:19:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0166/20450166/damage_scratches-1774773625463.jpg> (referer: None)
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3793%252F20403793%252Finterior_dashboard-1774696271005.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3793/20403793/interior_dashboard-1774696271005.jpg not downloaded yet
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0978%252F4610978%252Finterior_dashboard-1774619975421.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0978/4610978/interior_dashboard-1774619975421.jpg not downloaded yet
2026-03-29 20:19:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0166/20450166/docs_service_history-1774772045379.jpg?ixlib=js-3.8.0&auto=format&s=49d4143f42318138d31f6ab051fde7c7> (referer: None)
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3793%252F20403793%252Finstrument_cluster-1774696338223.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3793/20403793/instrument_cluster-1774696338223.jpg not downloaded yet
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0978%252F4610978%252Finstrument_cluster-1774620032420.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0978/4610978/instrument_cluster-1774620032420.jpg not downloaded yet
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3793%252F20403793%252Finterior_boot-1774696289437.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3793/20403793/interior_boot-1774696289437.jpg not downloaded yet
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0978%252F4610978%252Finterior_boot-1774619981557.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0978/4610978/interior_boot-1774619981557.jpg not downloaded yet
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3793%252F20403793%252Fdocs_service_history-1774697006437.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1c8f09180d0210a209a268d03004a83d%27 HTTP/1.1" 200 None
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3793/20403793/docs_service_history-1774697006437.jpg?ixlib=js-3.8.0&auto=format&s=1c8f09180d0210a209a268d03004a83d not downloaded yet
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0978%252F4610978%252Fdocs_service_history-1774620324518.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbfc1450669de4ca595fb6cfee4a45e2c%27 HTTP/1.1" 200 None
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0978/4610978/docs_service_history-1774620324518.jpg?ixlib=js-3.8.0&auto=format&s=bfc1450669de4ca595fb6cfee4a45e2c not downloaded yet
2026-03-29 20:19:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bd91b50>
2026-03-29 20:19:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ae03905-fe2f-550c-b063-813d66824638/5ae03905-fe2f-550c-b063-813d66824638_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0166%252F20450166%252Fdamage_scratches-1774773625463.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0166/20450166/damage_scratches-1774773625463.jpg saved to cache
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5ae03905-fe2f-550c-b063-813d66824638
2026-03-29 20:19:43 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:19:43 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:19:43 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x01\xcb\x99\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x9aC\x00\x01\xae\x07\x00\x00\x00\x00'
2026-03-29 20:19:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b1ab50>
2026-03-29 20:19:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ae03905-fe2f-550c-b063-813d66824638/5ae03905-fe2f-550c-b063-813d66824638_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0166%252F20450166%252Fdocs_service_history-1774772045379.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D49d4143f42318138d31f6ab051fde7c7') HTTP/1.1" 204 0
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0166/20450166/docs_service_history-1774772045379.jpg?ixlib=js-3.8.0&auto=format&s=49d4143f42318138d31f6ab051fde7c7 saved to cache
2026-03-29 20:19:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5ae03905-fe2f-550c-b063-813d66824638
2026-03-29 20:19:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0846/20020846/interior_rear_seats-1774632419768.jpeg> (referer: None)
2026-03-29 20:19:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0846/20020846/exterior_rear_passenger-1774632334213.jpeg> (referer: None)
2026-03-29 20:19:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9698/19189698/interior_dashboard-1774712393301.jpg> (referer: None)
2026-03-29 20:19:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0978/4610978/interior_rear_seats-1774619969881.jpg> (referer: None)
2026-03-29 20:19:43 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:19:43 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:19:43 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00)+T\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xbfk\x00) \xb6\x00\x00\x00\x00'
2026-03-29 20:19:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b1a6d0>
2026-03-29 20:19:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab00e38c-56dd-50ae-8c85-d51b6e009397/ab00e38c-56dd-50ae-8c85-d51b6e009397_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0846%252F20020846%252Finterior_rear_seats-1774632419768.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0846/20020846/interior_rear_seats-1774632419768.jpeg saved to cache
2026-03-29 20:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ab00e38c-56dd-50ae-8c85-d51b6e009397
2026-03-29 20:19:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0846/20020846/interior_front_seats-1774632541459.jpeg> (referer: None)
2026-03-29 20:19:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587372d0>
2026-03-29 20:19:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab00e38c-56dd-50ae-8c85-d51b6e009397/ab00e38c-56dd-50ae-8c85-d51b6e009397_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0846%252F20020846%252Fexterior_rear_passenger-1774632334213.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0846/20020846/exterior_rear_passenger-1774632334213.jpeg saved to cache
2026-03-29 20:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ab00e38c-56dd-50ae-8c85-d51b6e009397
2026-03-29 20:19:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599c22d0>
2026-03-29 20:19:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d556f659-7139-5edb-b94e-2fe4a5a70566/d556f659-7139-5edb-b94e-2fe4a5a70566_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9698%252F19189698%252Finterior_dashboard-1774712393301.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9698/19189698/interior_dashboard-1774712393301.jpg saved to cache
2026-03-29 20:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d556f659-7139-5edb-b94e-2fe4a5a70566
2026-03-29 20:19:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf50cd0>
2026-03-29 20:19:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5283d03-b5c9-5d91-8fdf-3c598fb48b96/c5283d03-b5c9-5d91-8fdf-3c598fb48b96_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0978%252F4610978%252Finterior_rear_seats-1774619969881.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0978/4610978/interior_rear_seats-1774619969881.jpg saved to cache
2026-03-29 20:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5283d03-b5c9-5d91-8fdf-3c598fb48b96
2026-03-29 20:19:44 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:19:44 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:19:44 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x008\xa5d\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xdf-\x008\x9a\xc6\x00\x00\x00\x00'
2026-03-29 20:19:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e26b50>
2026-03-29 20:19:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab00e38c-56dd-50ae-8c85-d51b6e009397/ab00e38c-56dd-50ae-8c85-d51b6e009397_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0846%252F20020846%252Finterior_front_seats-1774632541459.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0846/20020846/interior_front_seats-1774632541459.jpeg saved to cache
2026-03-29 20:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab00e38c-56dd-50ae-8c85-d51b6e009397
2026-03-29 20:19:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0978/4610978/docs_service_history-1774620324518.jpg?ixlib=js-3.8.0&auto=format&s=bfc1450669de4ca595fb6cfee4a45e2c> (referer: None)
2026-03-29 20:19:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0978/4610978/interior_dashboard-1774619975421.jpg> (referer: None)
2026-03-29 20:19:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65887df90>
2026-03-29 20:19:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5283d03-b5c9-5d91-8fdf-3c598fb48b96/c5283d03-b5c9-5d91-8fdf-3c598fb48b96_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0978%252F4610978%252Fdocs_service_history-1774620324518.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbfc1450669de4ca595fb6cfee4a45e2c') HTTP/1.1" 204 0
2026-03-29 20:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0978/4610978/docs_service_history-1774620324518.jpg?ixlib=js-3.8.0&auto=format&s=bfc1450669de4ca595fb6cfee4a45e2c saved to cache
2026-03-29 20:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c5283d03-b5c9-5d91-8fdf-3c598fb48b96
2026-03-29 20:19:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3793/20403793/docs_service_history-1774697006437.jpg?ixlib=js-3.8.0&auto=format&s=1c8f09180d0210a209a268d03004a83d> (referer: None)
2026-03-29 20:19:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583c7090>
2026-03-29 20:19:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5283d03-b5c9-5d91-8fdf-3c598fb48b96/c5283d03-b5c9-5d91-8fdf-3c598fb48b96_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0978%252F4610978%252Finterior_dashboard-1774619975421.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0978/4610978/interior_dashboard-1774619975421.jpg saved to cache
2026-03-29 20:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5283d03-b5c9-5d91-8fdf-3c598fb48b96
2026-03-29 20:19:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658833550>
2026-03-29 20:19:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d47b74f8-51da-5db6-b64c-19647684da8c/d47b74f8-51da-5db6-b64c-19647684da8c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3793%252F20403793%252Fdocs_service_history-1774697006437.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1c8f09180d0210a209a268d03004a83d') HTTP/1.1" 204 0
2026-03-29 20:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3793/20403793/docs_service_history-1774697006437.jpg?ixlib=js-3.8.0&auto=format&s=1c8f09180d0210a209a268d03004a83d saved to cache
2026-03-29 20:19:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d47b74f8-51da-5db6-b64c-19647684da8c
2026-03-29 20:19:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0978/4610978/interior_boot-1774619981557.jpg> (referer: None)
2026-03-29 20:19:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0978/4610978/instrument_cluster-1774620032420.jpg> (referer: None)
2026-03-29 20:19:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3793/20403793/instrument_cluster-1774696338223.jpg> (referer: None)
2026-03-29 20:19:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3793/20403793/interior_boot-1774696289437.jpg> (referer: None)
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583c4490>
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5283d03-b5c9-5d91-8fdf-3c598fb48b96/c5283d03-b5c9-5d91-8fdf-3c598fb48b96_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0978%252F4610978%252Finterior_boot-1774619981557.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0978/4610978/interior_boot-1774619981557.jpg saved to cache
2026-03-29 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c5283d03-b5c9-5d91-8fdf-3c598fb48b96
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c3dcd0>
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5283d03-b5c9-5d91-8fdf-3c598fb48b96/c5283d03-b5c9-5d91-8fdf-3c598fb48b96_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0978%252F4610978%252Finstrument_cluster-1774620032420.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0978/4610978/instrument_cluster-1774620032420.jpg saved to cache
2026-03-29 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5283d03-b5c9-5d91-8fdf-3c598fb48b96
2026-03-29 20:19:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:19:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658736390>
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d47b74f8-51da-5db6-b64c-19647684da8c/d47b74f8-51da-5db6-b64c-19647684da8c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3793%252F20403793%252Finstrument_cluster-1774696338223.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3793/20403793/instrument_cluster-1774696338223.jpg saved to cache
2026-03-29 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d47b74f8-51da-5db6-b64c-19647684da8c
2026-03-29 20:19:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:19:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65843d1d0>
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d47b74f8-51da-5db6-b64c-19647684da8c/d47b74f8-51da-5db6-b64c-19647684da8c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3793%252F20403793%252Finterior_boot-1774696289437.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3793/20403793/interior_boot-1774696289437.jpg saved to cache
2026-03-29 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d47b74f8-51da-5db6-b64c-19647684da8c
2026-03-29 20:19:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3793/20403793/interior_dashboard-1774696271005.jpg> (referer: None)
2026-03-29 20:19:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0978/4610978/interior_front_seats-1774619974101.jpg> (referer: None)
2026-03-29 20:19:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3793/20403793/interior_front_seats-1774696307264.jpg> (referer: None)
2026-03-29 20:19:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3793/20403793/interior_rear_seats-1774696243278.jpg> (referer: None)
2026-03-29 20:19:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:19:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582e8d50>
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d47b74f8-51da-5db6-b64c-19647684da8c/d47b74f8-51da-5db6-b64c-19647684da8c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3793%252F20403793%252Finterior_dashboard-1774696271005.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3793/20403793/interior_dashboard-1774696271005.jpg saved to cache
2026-03-29 20:19:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d47b74f8-51da-5db6-b64c-19647684da8c
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b181d0>
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5283d03-b5c9-5d91-8fdf-3c598fb48b96/c5283d03-b5c9-5d91-8fdf-3c598fb48b96_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0978%252F4610978%252Finterior_front_seats-1774619974101.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0978/4610978/interior_front_seats-1774619974101.jpg saved to cache
2026-03-29 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5283d03-b5c9-5d91-8fdf-3c598fb48b96
2026-03-29 20:19:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:19:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f7cd90>
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d47b74f8-51da-5db6-b64c-19647684da8c/d47b74f8-51da-5db6-b64c-19647684da8c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3793%252F20403793%252Finterior_front_seats-1774696307264.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3793/20403793/interior_front_seats-1774696307264.jpg saved to cache
2026-03-29 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d47b74f8-51da-5db6-b64c-19647684da8c
2026-03-29 20:19:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:19:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599c3cd0>
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d47b74f8-51da-5db6-b64c-19647684da8c/d47b74f8-51da-5db6-b64c-19647684da8c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3793%252F20403793%252Finterior_rear_seats-1774696243278.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3793/20403793/interior_rear_seats-1774696243278.jpg saved to cache
2026-03-29 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d47b74f8-51da-5db6-b64c-19647684da8c
2026-03-29 20:19:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0978/4610978/exterior_rear_passenger-1774619553512.jpg> (referer: None)
2026-03-29 20:19:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0978/4610978/exterior_front_passenger-1774619538810.jpg> (referer: None)
2026-03-29 20:19:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3793/20403793/exterior_rear_passenger-1774695589919.jpg> (referer: None)
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589fb010>
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5283d03-b5c9-5d91-8fdf-3c598fb48b96/c5283d03-b5c9-5d91-8fdf-3c598fb48b96_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0978%252F4610978%252Fexterior_rear_passenger-1774619553512.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0978/4610978/exterior_rear_passenger-1774619553512.jpg saved to cache
2026-03-29 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5283d03-b5c9-5d91-8fdf-3c598fb48b96
2026-03-29 20:19:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19831066.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d4c290>
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5283d03-b5c9-5d91-8fdf-3c598fb48b96/c5283d03-b5c9-5d91-8fdf-3c598fb48b96_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0978%252F4610978%252Fexterior_front_passenger-1774619538810.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0978/4610978/exterior_front_passenger-1774619538810.jpg saved to cache
2026-03-29 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5283d03-b5c9-5d91-8fdf-3c598fb48b96
2026-03-29 20:19:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20103257.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65887f150>
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d47b74f8-51da-5db6-b64c-19647684da8c/d47b74f8-51da-5db6-b64c-19647684da8c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3793%252F20403793%252Fexterior_rear_passenger-1774695589919.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3793/20403793/exterior_rear_passenger-1774695589919.jpg saved to cache
2026-03-29 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d47b74f8-51da-5db6-b64c-19647684da8c
2026-03-29 20:19:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:19:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 045f7678-df11-57aa-8dec-bf5b6a2c1818 with identifier: 19831066
2026-03-29 20:19:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 045f7678-df11-57aa-8dec-bf5b6a2c1818 with scrape type 2
2026-03-29 20:19:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 045f7678-df11-57aa-8dec-bf5b6a2c1818 with scrape type 2
2026-03-29 20:19:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 045f7678-df11-57aa-8dec-bf5b6a2c1818, identifier: 19831066
2026-03-29 20:19:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7985a26c-0522-531a-a935-518c9a2306c8 with identifier: 20103257
2026-03-29 20:19:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7985a26c-0522-531a-a935-518c9a2306c8 with scrape type 1
2026-03-29 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7985a26c-0522-531a-a935-518c9a2306c8
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3257%252F20103257%252Fexterior_front_driver-1774111226852.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3257/20103257/exterior_front_driver-1774111226852.jpg not downloaded yet
2026-03-29 20:19:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 045f7678-df11-57aa-8dec-bf5b6a2c1818 with identifier: 19831066
2026-03-29 20:19:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 045f7678-df11-57aa-8dec-bf5b6a2c1818 with identifier: 19831066
2026-03-29 20:19:47 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 045f7678-df11-57aa-8dec-bf5b6a2c1818 with identifier: 19831066 to the API
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19831066.json>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '045f7678-df11-57aa-8dec-bf5b6a2c1818',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DV22 BFM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19831066',
'listing': 'auction',
'location': 'York York',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 18742,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 14125,
'price_includes_vat': False,
'registration_date': '2022-03-29',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Qashqai N-Connecta DiG-T MHEV',
'transmission': 'manual',
'trim': 'N-Connecta DiG-T MHEV',
'vin': 'SJNTAAJ12U1070746',
'year': 2022}
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719831066%27 HTTP/1.1" 200 None
2026-03-29 20:19:47 [motorway.uk] INFO: Saving data for 19831066: {'auction_closing_time': 1774884600.0, 'created_time': 1774384899.085138, 'last_price_update_time': 1774815587.525982}
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19831066') HTTP/1.1" 204 0
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3257%252F20103257%252Fexterior_rear_driver-1774103463405.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3257/20103257/exterior_rear_driver-1774103463405.jpg not downloaded yet
2026-03-29 20:19:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20453524.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0166/20450166/interior_boot-1774772006143.jpg> (referer: None)
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3257%252F20103257%252Fexterior_front_passenger-1774103493915.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3257/20103257/exterior_front_passenger-1774103493915.jpg not downloaded yet
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3257%252F20103257%252Fexterior_rear_passenger-1774103474823.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3257/20103257/exterior_rear_passenger-1774103474823.jpg not downloaded yet
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3257%252F20103257%252Finterior_front_seats-1774110924376.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3257/20103257/interior_front_seats-1774110924376.jpg not downloaded yet
2026-03-29 20:19:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0978/4610978/exterior_front_driver-1774619527373.jpg> (referer: None)
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3257%252F20103257%252Finterior_rear_seats-1774110706750.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3257/20103257/interior_rear_seats-1774110706750.jpg not downloaded yet
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3257%252F20103257%252Finterior_dashboard-1774110743677.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3257/20103257/interior_dashboard-1774110743677.jpg not downloaded yet
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3257%252F20103257%252Finstrument_cluster-1774110705277.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3257/20103257/instrument_cluster-1774110705277.jpg not downloaded yet
2026-03-29 20:19:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0978/4610978/exterior_rear_driver-1774619530989.jpg> (referer: None)
2026-03-29 20:19:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14e85347-b1ed-5ba2-ab01-860b4511adec with identifier: 20453524
2026-03-29 20:19:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14e85347-b1ed-5ba2-ab01-860b4511adec with scrape type 1
2026-03-29 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 14e85347-b1ed-5ba2-ab01-860b4511adec
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3524%252F20453524%252Fexterior_front_driver-1774701413778.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3524/20453524/exterior_front_driver-1774701413778.jpg not downloaded yet
2026-03-29 20:19:47 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:19:47 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:19:47 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x01\xfej\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\xa6\xd6\x00\x01\xdb\x92\x00\x00\x00\x00'
2026-03-29 20:19:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598bd890>
2026-03-29 20:19:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ae03905-fe2f-550c-b063-813d66824638/5ae03905-fe2f-550c-b063-813d66824638_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0166%252F20450166%252Finterior_boot-1774772006143.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0166/20450166/interior_boot-1774772006143.jpg saved to cache
2026-03-29 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5ae03905-fe2f-550c-b063-813d66824638
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3257%252F20103257%252Finterior_boot-1774110787957.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3257/20103257/interior_boot-1774110787957.jpg not downloaded yet
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3524%252F20453524%252Fexterior_rear_driver-1774701427205.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3524/20453524/exterior_rear_driver-1774701427205.jpg not downloaded yet
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3257%252F20103257%252Fdocs_service_history-1774180040434.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbcc3950673fe050971bcdfe9959ddac4%27 HTTP/1.1" 200 None
2026-03-29 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3257/20103257/docs_service_history-1774180040434.jpg?ixlib=js-3.8.0&auto=format&s=bcc3950673fe050971bcdfe9959ddac4 not downloaded yet
2026-03-29 20:19:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65befcfd0>
2026-03-29 20:19:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5283d03-b5c9-5d91-8fdf-3c598fb48b96/c5283d03-b5c9-5d91-8fdf-3c598fb48b96_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0978%252F4610978%252Fexterior_front_driver-1774619527373.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0978/4610978/exterior_front_driver-1774619527373.jpg saved to cache
2026-03-29 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5283d03-b5c9-5d91-8fdf-3c598fb48b96
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3524%252F20453524%252Fexterior_front_passenger-1774701453499.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3524/20453524/exterior_front_passenger-1774701453499.jpg not downloaded yet
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3524%252F20453524%252Fexterior_rear_passenger-1774701441129.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3524/20453524/exterior_rear_passenger-1774701441129.jpg not downloaded yet
2026-03-29 20:19:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65befa7d0>
2026-03-29 20:19:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5283d03-b5c9-5d91-8fdf-3c598fb48b96/c5283d03-b5c9-5d91-8fdf-3c598fb48b96_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0978%252F4610978%252Fexterior_rear_driver-1774619530989.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0978/4610978/exterior_rear_driver-1774619530989.jpg saved to cache
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5283d03-b5c9-5d91-8fdf-3c598fb48b96
2026-03-29 20:19:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5283d03-b5c9-5d91-8fdf-3c598fb48b96, skipping ID generation
2026-03-29 20:19:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5283d03-b5c9-5d91-8fdf-3c598fb48b96 with scrape type 1
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5283d03-b5c9-5d91-8fdf-3c598fb48b96 sending to next pipeline
2026-03-29 20:19:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c5283d03-b5c9-5d91-8fdf-3c598fb48b96, identifier: 4610978
2026-03-29 20:19:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c5283d03-b5c9-5d91-8fdf-3c598fb48b96 with identifier: 4610978
2026-03-29 20:19:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c5283d03-b5c9-5d91-8fdf-3c598fb48b96 with identifier: 4610978
2026-03-29 20:19:48 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c5283d03-b5c9-5d91-8fdf-3c598fb48b96 with identifier: 4610978 to the API
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0978/4610978/exterior_rear_driver-1774619530989.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'c5283d03-b5c9-5d91-8fdf-3c598fb48b96',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LN11 UWH',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/4610978',
'listing': 'auction',
'location': 'Surrey Staines',
'make': 'SEAT',
'model': 'Ibiza',
'odometer': 92984,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5283d03-b5c9-5d91-8fdf-3c598fb48b96/c5283d03-b5c9-5d91-8fdf-3c598fb48b96_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1377045,
'Height': 2212,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0978/4610978/exterior_front_driver-1774619527373.jpg',
'Width': 2949},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5283d03-b5c9-5d91-8fdf-3c598fb48b96/c5283d03-b5c9-5d91-8fdf-3c598fb48b96_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1240221,
'Height': 2096,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0978/4610978/exterior_rear_driver-1774619530989.jpg',
'Width': 2794},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5283d03-b5c9-5d91-8fdf-3c598fb48b96/c5283d03-b5c9-5d91-8fdf-3c598fb48b96_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1083755,
'Height': 2396,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0978/4610978/exterior_front_passenger-1774619538810.jpg',
'Width': 3195},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5283d03-b5c9-5d91-8fdf-3c598fb48b96/c5283d03-b5c9-5d91-8fdf-3c598fb48b96_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1259856,
'Height': 2315,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0978/4610978/exterior_rear_passenger-1774619553512.jpg',
'Width': 3086},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5283d03-b5c9-5d91-8fdf-3c598fb48b96/c5283d03-b5c9-5d91-8fdf-3c598fb48b96_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2162354,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0978/4610978/interior_front_seats-1774619974101.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5283d03-b5c9-5d91-8fdf-3c598fb48b96/c5283d03-b5c9-5d91-8fdf-3c598fb48b96_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3577983,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0978/4610978/interior_rear_seats-1774619969881.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5283d03-b5c9-5d91-8fdf-3c598fb48b96/c5283d03-b5c9-5d91-8fdf-3c598fb48b96_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1875453,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0978/4610978/interior_dashboard-1774619975421.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5283d03-b5c9-5d91-8fdf-3c598fb48b96/c5283d03-b5c9-5d91-8fdf-3c598fb48b96_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1715930,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0978/4610978/instrument_cluster-1774620032420.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5283d03-b5c9-5d91-8fdf-3c598fb48b96/c5283d03-b5c9-5d91-8fdf-3c598fb48b96_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2455116,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0978/4610978/interior_boot-1774619981557.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5283d03-b5c9-5d91-8fdf-3c598fb48b96/c5283d03-b5c9-5d91-8fdf-3c598fb48b96_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1755167,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0978/4610978/docs_service_history-1774620324518.jpg?ixlib=js-3.8.0&auto=format&s=bfc1450669de4ca595fb6cfee4a45e2c',
'Width': 3840}],
'price': 1050,
'price_includes_vat': False,
'registration_date': '2011-03-16',
'seats_number': None,
'seller_name': None,
'title': 'SEAT Ibiza Chill',
'transmission': 'manual',
'trim': 'Chill',
'vin': 'VSSZZZ6JZBR127328',
'year': 2011}
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%274610978%27 HTTP/1.1" 200 None
2026-03-29 20:19:48 [motorway.uk] INFO: Saving data for 4610978: {'created_time': 1774815588.517041, 'last_price_update_time': 1774815588.517051, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='4610978') HTTP/1.1" 204 0
2026-03-29 20:19:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0846/20020846/exterior_front_passenger-1774632321086.jpeg> (referer: None)
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3524%252F20453524%252Finterior_front_seats-1774701899798.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3524/20453524/interior_front_seats-1774701899798.jpg not downloaded yet
2026-03-29 20:19:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3793/20403793/exterior_front_driver-1774695565616.jpg> (referer: None)
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3524%252F20453524%252Finterior_rear_seats-1774701920004.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3524/20453524/interior_rear_seats-1774701920004.jpg not downloaded yet
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3524%252F20453524%252Finterior_dashboard-1774714820769.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3524/20453524/interior_dashboard-1774714820769.jpg not downloaded yet
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3524%252F20453524%252Finstrument_cluster-1774701976779.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3524/20453524/instrument_cluster-1774701976779.jpg not downloaded yet
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3524%252F20453524%252Finterior_boot-1774701988188.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3524/20453524/interior_boot-1774701988188.jpg not downloaded yet
2026-03-29 20:19:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9698/19189698/interior_front_seats-1774712385682.jpg> (referer: None)
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3524%252F20453524%252Fdocs_service_history-1774714620908.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1afcb6eaf726408003ca564506554529%27 HTTP/1.1" 200 None
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3524/20453524/docs_service_history-1774714620908.jpg?ixlib=js-3.8.0&auto=format&s=1afcb6eaf726408003ca564506554529 not downloaded yet
2026-03-29 20:19:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3793/20403793/exterior_rear_driver-1774695584180.jpg> (referer: None)
2026-03-29 20:19:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bd91490>
2026-03-29 20:19:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab00e38c-56dd-50ae-8c85-d51b6e009397/ab00e38c-56dd-50ae-8c85-d51b6e009397_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0846%252F20020846%252Fexterior_front_passenger-1774632321086.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0846/20020846/exterior_front_passenger-1774632321086.jpeg saved to cache
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ab00e38c-56dd-50ae-8c85-d51b6e009397
2026-03-29 20:19:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3793/20403793/exterior_front_passenger-1774695604327.jpg> (referer: None)
2026-03-29 20:19:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfa3bd0>
2026-03-29 20:19:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d47b74f8-51da-5db6-b64c-19647684da8c/d47b74f8-51da-5db6-b64c-19647684da8c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3793%252F20403793%252Fexterior_front_driver-1774695565616.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3793/20403793/exterior_front_driver-1774695565616.jpg saved to cache
2026-03-29 20:19:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d47b74f8-51da-5db6-b64c-19647684da8c
2026-03-29 20:19:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64beebed0>
2026-03-29 20:19:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d556f659-7139-5edb-b94e-2fe4a5a70566/d556f659-7139-5edb-b94e-2fe4a5a70566_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9698%252F19189698%252Finterior_front_seats-1774712385682.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9698/19189698/interior_front_seats-1774712385682.jpg saved to cache
2026-03-29 20:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d556f659-7139-5edb-b94e-2fe4a5a70566
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ce9b10>
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d47b74f8-51da-5db6-b64c-19647684da8c/d47b74f8-51da-5db6-b64c-19647684da8c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3793%252F20403793%252Fexterior_rear_driver-1774695584180.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3793/20403793/exterior_rear_driver-1774695584180.jpg saved to cache
2026-03-29 20:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d47b74f8-51da-5db6-b64c-19647684da8c
2026-03-29 20:19:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3257/20103257/interior_dashboard-1774110743677.jpg> (referer: None)
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a0ca10>
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d47b74f8-51da-5db6-b64c-19647684da8c/d47b74f8-51da-5db6-b64c-19647684da8c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3793%252F20403793%252Fexterior_front_passenger-1774695604327.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3793/20403793/exterior_front_passenger-1774695604327.jpg saved to cache
2026-03-29 20:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d47b74f8-51da-5db6-b64c-19647684da8c
2026-03-29 20:19:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d47b74f8-51da-5db6-b64c-19647684da8c, skipping ID generation
2026-03-29 20:19:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d47b74f8-51da-5db6-b64c-19647684da8c with scrape type 1
2026-03-29 20:19:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d47b74f8-51da-5db6-b64c-19647684da8c sending to next pipeline
2026-03-29 20:19:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d47b74f8-51da-5db6-b64c-19647684da8c, identifier: 20403793
2026-03-29 20:19:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d47b74f8-51da-5db6-b64c-19647684da8c with identifier: 20403793
2026-03-29 20:19:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d47b74f8-51da-5db6-b64c-19647684da8c with identifier: 20403793
2026-03-29 20:19:49 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d47b74f8-51da-5db6-b64c-19647684da8c with identifier: 20403793 to the API
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3793/20403793/exterior_front_passenger-1774695604327.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'd47b74f8-51da-5db6-b64c-19647684da8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'L555 RJP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20403793',
'listing': 'auction',
'location': 'Suffolk Lowestoft',
'make': 'Skoda',
'model': 'Superb',
'odometer': 82800,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d47b74f8-51da-5db6-b64c-19647684da8c/d47b74f8-51da-5db6-b64c-19647684da8c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2007473,
'Height': 2502,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3793/20403793/exterior_front_driver-1774695565616.jpg',
'Width': 3336},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d47b74f8-51da-5db6-b64c-19647684da8c/d47b74f8-51da-5db6-b64c-19647684da8c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2417120,
'Height': 2792,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3793/20403793/exterior_rear_driver-1774695584180.jpg',
'Width': 3722},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d47b74f8-51da-5db6-b64c-19647684da8c/d47b74f8-51da-5db6-b64c-19647684da8c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2473716,
'Height': 2780,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3793/20403793/exterior_front_passenger-1774695604327.jpg',
'Width': 3707},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d47b74f8-51da-5db6-b64c-19647684da8c/d47b74f8-51da-5db6-b64c-19647684da8c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2105486,
'Height': 2684,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3793/20403793/exterior_rear_passenger-1774695589919.jpg',
'Width': 3578},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d47b74f8-51da-5db6-b64c-19647684da8c/d47b74f8-51da-5db6-b64c-19647684da8c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3179042,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3793/20403793/interior_front_seats-1774696307264.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d47b74f8-51da-5db6-b64c-19647684da8c/d47b74f8-51da-5db6-b64c-19647684da8c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3357107,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3793/20403793/interior_rear_seats-1774696243278.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d47b74f8-51da-5db6-b64c-19647684da8c/d47b74f8-51da-5db6-b64c-19647684da8c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3550835,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3793/20403793/interior_dashboard-1774696271005.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d47b74f8-51da-5db6-b64c-19647684da8c/d47b74f8-51da-5db6-b64c-19647684da8c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2538739,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3793/20403793/instrument_cluster-1774696338223.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d47b74f8-51da-5db6-b64c-19647684da8c/d47b74f8-51da-5db6-b64c-19647684da8c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3316272,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3793/20403793/interior_boot-1774696289437.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d47b74f8-51da-5db6-b64c-19647684da8c/d47b74f8-51da-5db6-b64c-19647684da8c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3366835,
'Height': 3096,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3793/20403793/docs_service_history-1774697006437.jpg?ixlib=js-3.8.0&auto=format&s=1c8f09180d0210a209a268d03004a83d',
'Width': 2079}],
'price': 12854,
'price_includes_vat': False,
'registration_date': '2018-12-10',
'seats_number': None,
'seller_name': None,
'title': 'Skoda Superb Sportline TDI 4X4 S-A',
'transmission': 'automatic',
'trim': 'Sportline TDI 4X4 S-A',
'vin': 'TMBMJ7NP9K7012638',
'year': 2018}
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720403793%27 HTTP/1.1" 200 None
2026-03-29 20:19:49 [motorway.uk] INFO: Saving data for 20403793: {'created_time': 1774815589.816125, 'last_price_update_time': 1774815589.816136, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20403793') HTTP/1.1" 204 0
2026-03-29 20:19:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3257/20103257/exterior_rear_driver-1774103463405.jpg> (referer: None)
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ae1a10>
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7985a26c-0522-531a-a935-518c9a2306c8/7985a26c-0522-531a-a935-518c9a2306c8_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3257%252F20103257%252Finterior_dashboard-1774110743677.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3257/20103257/interior_dashboard-1774110743677.jpg saved to cache
2026-03-29 20:19:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7985a26c-0522-531a-a935-518c9a2306c8
2026-03-29 20:19:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3257/20103257/exterior_front_driver-1774111226852.jpg> (referer: None)
2026-03-29 20:19:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3257/20103257/exterior_rear_passenger-1774103474823.jpg> (referer: None)
2026-03-29 20:19:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3524/20453524/exterior_rear_passenger-1774701441129.jpg> (referer: None)
2026-03-29 20:19:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3524/20453524/interior_rear_seats-1774701920004.jpg> (referer: None)
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf9cb50>
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7985a26c-0522-531a-a935-518c9a2306c8/7985a26c-0522-531a-a935-518c9a2306c8_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3257%252F20103257%252Fexterior_rear_driver-1774103463405.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3257/20103257/exterior_rear_driver-1774103463405.jpg saved to cache
2026-03-29 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7985a26c-0522-531a-a935-518c9a2306c8
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bd92190>
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7985a26c-0522-531a-a935-518c9a2306c8/7985a26c-0522-531a-a935-518c9a2306c8_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3257%252F20103257%252Fexterior_front_driver-1774111226852.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3257/20103257/exterior_front_driver-1774111226852.jpg saved to cache
2026-03-29 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7985a26c-0522-531a-a935-518c9a2306c8
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586d9b50>
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7985a26c-0522-531a-a935-518c9a2306c8/7985a26c-0522-531a-a935-518c9a2306c8_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3257%252F20103257%252Fexterior_rear_passenger-1774103474823.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3257/20103257/exterior_rear_passenger-1774103474823.jpg saved to cache
2026-03-29 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7985a26c-0522-531a-a935-518c9a2306c8
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a6a290>
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14e85347-b1ed-5ba2-ab01-860b4511adec/14e85347-b1ed-5ba2-ab01-860b4511adec_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3524%252F20453524%252Fexterior_rear_passenger-1774701441129.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3524/20453524/exterior_rear_passenger-1774701441129.jpg saved to cache
2026-03-29 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 14e85347-b1ed-5ba2-ab01-860b4511adec
2026-03-29 20:19:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599f0590>
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14e85347-b1ed-5ba2-ab01-860b4511adec/14e85347-b1ed-5ba2-ab01-860b4511adec_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3524%252F20453524%252Finterior_rear_seats-1774701920004.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3524/20453524/interior_rear_seats-1774701920004.jpg saved to cache
2026-03-29 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 14e85347-b1ed-5ba2-ab01-860b4511adec
2026-03-29 20:19:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3524/20453524/exterior_front_passenger-1774701453499.jpg> (referer: None)
2026-03-29 20:19:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3524/20453524/interior_dashboard-1774714820769.jpg> (referer: None)
2026-03-29 20:19:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/3524/20453524/docs_service_history-1774714620908.jpg?ixlib=js-3.8.0&auto=format&s=1afcb6eaf726408003ca564506554529> (referer: None)
2026-03-29 20:19:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3524/20453524/instrument_cluster-1774701976779.jpg> (referer: None)
2026-03-29 20:19:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3524/20453524/interior_boot-1774701988188.jpg> (referer: None)
2026-03-29 20:19:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3524/20453524/interior_front_seats-1774701899798.jpg> (referer: None)
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b21610>
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14e85347-b1ed-5ba2-ab01-860b4511adec/14e85347-b1ed-5ba2-ab01-860b4511adec_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3524%252F20453524%252Fexterior_front_passenger-1774701453499.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3524/20453524/exterior_front_passenger-1774701453499.jpg saved to cache
2026-03-29 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 14e85347-b1ed-5ba2-ab01-860b4511adec
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ae8dd0>
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14e85347-b1ed-5ba2-ab01-860b4511adec/14e85347-b1ed-5ba2-ab01-860b4511adec_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3524%252F20453524%252Finterior_dashboard-1774714820769.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3524/20453524/interior_dashboard-1774714820769.jpg saved to cache
2026-03-29 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 14e85347-b1ed-5ba2-ab01-860b4511adec
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65901fa10>
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14e85347-b1ed-5ba2-ab01-860b4511adec/14e85347-b1ed-5ba2-ab01-860b4511adec_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F3524%252F20453524%252Fdocs_service_history-1774714620908.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1afcb6eaf726408003ca564506554529') HTTP/1.1" 204 0
2026-03-29 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/3524/20453524/docs_service_history-1774714620908.jpg?ixlib=js-3.8.0&auto=format&s=1afcb6eaf726408003ca564506554529 saved to cache
2026-03-29 20:19:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 14e85347-b1ed-5ba2-ab01-860b4511adec
2026-03-29 20:19:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be4e490>
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14e85347-b1ed-5ba2-ab01-860b4511adec/14e85347-b1ed-5ba2-ab01-860b4511adec_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3524%252F20453524%252Finstrument_cluster-1774701976779.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3524/20453524/instrument_cluster-1774701976779.jpg saved to cache
2026-03-29 20:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 14e85347-b1ed-5ba2-ab01-860b4511adec
2026-03-29 20:19:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d43c10>
2026-03-29 20:19:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14e85347-b1ed-5ba2-ab01-860b4511adec/14e85347-b1ed-5ba2-ab01-860b4511adec_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3524%252F20453524%252Finterior_boot-1774701988188.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3524/20453524/interior_boot-1774701988188.jpg saved to cache
2026-03-29 20:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 14e85347-b1ed-5ba2-ab01-860b4511adec
2026-03-29 20:19:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65bc27450>
2026-03-29 20:19:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14e85347-b1ed-5ba2-ab01-860b4511adec/14e85347-b1ed-5ba2-ab01-860b4511adec_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3524%252F20453524%252Finterior_front_seats-1774701899798.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3524/20453524/interior_front_seats-1774701899798.jpg saved to cache
2026-03-29 20:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 14e85347-b1ed-5ba2-ab01-860b4511adec
2026-03-29 20:19:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3524/20453524/exterior_front_driver-1774701413778.jpg> (referer: None)
2026-03-29 20:19:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3524/20453524/exterior_rear_driver-1774701427205.jpg> (referer: None)
2026-03-29 20:19:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3257/20103257/interior_boot-1774110787957.jpg> (referer: None)
2026-03-29 20:19:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3257/20103257/instrument_cluster-1774110705277.jpg> (referer: None)
2026-03-29 20:19:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3257/20103257/docs_service_history-1774180040434.jpg?ixlib=js-3.8.0&auto=format&s=bcc3950673fe050971bcdfe9959ddac4> (referer: None)
2026-03-29 20:19:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599fdf90>
2026-03-29 20:19:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14e85347-b1ed-5ba2-ab01-860b4511adec/14e85347-b1ed-5ba2-ab01-860b4511adec_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3524%252F20453524%252Fexterior_front_driver-1774701413778.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3524/20453524/exterior_front_driver-1774701413778.jpg saved to cache
2026-03-29 20:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14e85347-b1ed-5ba2-ab01-860b4511adec
2026-03-29 20:19:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf9c950>
2026-03-29 20:19:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14e85347-b1ed-5ba2-ab01-860b4511adec/14e85347-b1ed-5ba2-ab01-860b4511adec_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3524%252F20453524%252Fexterior_rear_driver-1774701427205.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3524/20453524/exterior_rear_driver-1774701427205.jpg saved to cache
2026-03-29 20:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 14e85347-b1ed-5ba2-ab01-860b4511adec
2026-03-29 20:19:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14e85347-b1ed-5ba2-ab01-860b4511adec, skipping ID generation
2026-03-29 20:19:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14e85347-b1ed-5ba2-ab01-860b4511adec with scrape type 1
2026-03-29 20:19:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14e85347-b1ed-5ba2-ab01-860b4511adec sending to next pipeline
2026-03-29 20:19:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 14e85347-b1ed-5ba2-ab01-860b4511adec, identifier: 20453524
2026-03-29 20:19:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ae3750>
2026-03-29 20:19:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7985a26c-0522-531a-a935-518c9a2306c8/7985a26c-0522-531a-a935-518c9a2306c8_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3257%252F20103257%252Finterior_boot-1774110787957.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3257/20103257/interior_boot-1774110787957.jpg saved to cache
2026-03-29 20:19:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7985a26c-0522-531a-a935-518c9a2306c8
2026-03-29 20:19:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586d8e10>
2026-03-29 20:19:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7985a26c-0522-531a-a935-518c9a2306c8/7985a26c-0522-531a-a935-518c9a2306c8_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3257%252F20103257%252Finstrument_cluster-1774110705277.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3257/20103257/instrument_cluster-1774110705277.jpg saved to cache
2026-03-29 20:19:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7985a26c-0522-531a-a935-518c9a2306c8
2026-03-29 20:19:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c4e250>
2026-03-29 20:19:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7985a26c-0522-531a-a935-518c9a2306c8/7985a26c-0522-531a-a935-518c9a2306c8_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3257%252F20103257%252Fdocs_service_history-1774180040434.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbcc3950673fe050971bcdfe9959ddac4') HTTP/1.1" 204 0
2026-03-29 20:19:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3257/20103257/docs_service_history-1774180040434.jpg?ixlib=js-3.8.0&auto=format&s=bcc3950673fe050971bcdfe9959ddac4 saved to cache
2026-03-29 20:19:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7985a26c-0522-531a-a935-518c9a2306c8
2026-03-29 20:19:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 14e85347-b1ed-5ba2-ab01-860b4511adec with identifier: 20453524
2026-03-29 20:19:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 14e85347-b1ed-5ba2-ab01-860b4511adec with identifier: 20453524
2026-03-29 20:19:52 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 14e85347-b1ed-5ba2-ab01-860b4511adec with identifier: 20453524 to the API
2026-03-29 20:19:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3524/20453524/exterior_rear_driver-1774701427205.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '14e85347-b1ed-5ba2-ab01-860b4511adec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YP18 OGK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20453524',
'listing': 'auction',
'location': 'Leicestershire Hinckley',
'make': 'SEAT',
'model': 'Leon',
'odometer': 38992,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14e85347-b1ed-5ba2-ab01-860b4511adec/14e85347-b1ed-5ba2-ab01-860b4511adec_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1032917,
'Height': 2224,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3524/20453524/exterior_front_driver-1774701413778.jpg',
'Width': 2965},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14e85347-b1ed-5ba2-ab01-860b4511adec/14e85347-b1ed-5ba2-ab01-860b4511adec_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1317683,
'Height': 2388,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3524/20453524/exterior_rear_driver-1774701427205.jpg',
'Width': 3184},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14e85347-b1ed-5ba2-ab01-860b4511adec/14e85347-b1ed-5ba2-ab01-860b4511adec_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1549822,
'Height': 2345,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3524/20453524/exterior_front_passenger-1774701453499.jpg',
'Width': 3126},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14e85347-b1ed-5ba2-ab01-860b4511adec/14e85347-b1ed-5ba2-ab01-860b4511adec_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1399254,
'Height': 2476,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3524/20453524/exterior_rear_passenger-1774701441129.jpg',
'Width': 3301},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14e85347-b1ed-5ba2-ab01-860b4511adec/14e85347-b1ed-5ba2-ab01-860b4511adec_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2992532,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3524/20453524/interior_front_seats-1774701899798.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14e85347-b1ed-5ba2-ab01-860b4511adec/14e85347-b1ed-5ba2-ab01-860b4511adec_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2230866,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3524/20453524/interior_rear_seats-1774701920004.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14e85347-b1ed-5ba2-ab01-860b4511adec/14e85347-b1ed-5ba2-ab01-860b4511adec_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3112572,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3524/20453524/interior_dashboard-1774714820769.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14e85347-b1ed-5ba2-ab01-860b4511adec/14e85347-b1ed-5ba2-ab01-860b4511adec_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2960781,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3524/20453524/instrument_cluster-1774701976779.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14e85347-b1ed-5ba2-ab01-860b4511adec/14e85347-b1ed-5ba2-ab01-860b4511adec_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3135646,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3524/20453524/interior_boot-1774701988188.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14e85347-b1ed-5ba2-ab01-860b4511adec/14e85347-b1ed-5ba2-ab01-860b4511adec_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3537524,
'Height': 5712,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/3524/20453524/docs_service_history-1774714620908.jpg?ixlib=js-3.8.0&auto=format&s=1afcb6eaf726408003ca564506554529',
'Width': 4284}],
'price': 18241,
'price_includes_vat': False,
'registration_date': '2018-04-27',
'seats_number': None,
'seller_name': None,
'title': 'SEAT Leon Cupra 300 TSI S-A',
'transmission': 'automatic',
'trim': 'Cupra 300 TSI S-A',
'vin': 'VSSZZZ5FZJR134639',
'year': 2018}
2026-03-29 20:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720453524%27 HTTP/1.1" 200 None
2026-03-29 20:19:52 [motorway.uk] INFO: Saving data for 20453524: {'created_time': 1774815592.596801, 'last_price_update_time': 1774815592.596814, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20453524') HTTP/1.1" 204 0
2026-03-29 20:19:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0166/20450166/interior_dashboard-1774772191764.jpg> (referer: None)
2026-03-29 20:19:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9698/19189698/exterior_rear_passenger-1774711753381.jpg> (referer: None)
2026-03-29 20:19:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0846/20020846/exterior_rear_driver-1774632349065.jpeg> (referer: None)
2026-03-29 20:19:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9698/19189698/exterior_front_passenger-1774716454410.jpg> (referer: None)
2026-03-29 20:19:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3257/20103257/exterior_front_passenger-1774103493915.jpg> (referer: None)
2026-03-29 20:19:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3257/20103257/interior_front_seats-1774110924376.jpg> (referer: None)
2026-03-29 20:19:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3257/20103257/interior_rear_seats-1774110706750.jpg> (referer: None)
2026-03-29 20:19:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658da8390>
2026-03-29 20:19:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ae03905-fe2f-550c-b063-813d66824638/5ae03905-fe2f-550c-b063-813d66824638_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0166%252F20450166%252Finterior_dashboard-1774772191764.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0166/20450166/interior_dashboard-1774772191764.jpg saved to cache
2026-03-29 20:19:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5ae03905-fe2f-550c-b063-813d66824638
2026-03-29 20:19:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c5bed0>
2026-03-29 20:19:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d556f659-7139-5edb-b94e-2fe4a5a70566/d556f659-7139-5edb-b94e-2fe4a5a70566_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9698%252F19189698%252Fexterior_rear_passenger-1774711753381.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9698/19189698/exterior_rear_passenger-1774711753381.jpg saved to cache
2026-03-29 20:19:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d556f659-7139-5edb-b94e-2fe4a5a70566
2026-03-29 20:19:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf9c1d0>
2026-03-29 20:19:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab00e38c-56dd-50ae-8c85-d51b6e009397/ab00e38c-56dd-50ae-8c85-d51b6e009397_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0846%252F20020846%252Fexterior_rear_driver-1774632349065.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0846/20020846/exterior_rear_driver-1774632349065.jpeg saved to cache
2026-03-29 20:19:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ab00e38c-56dd-50ae-8c85-d51b6e009397
2026-03-29 20:19:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c4eed0>
2026-03-29 20:19:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d556f659-7139-5edb-b94e-2fe4a5a70566/d556f659-7139-5edb-b94e-2fe4a5a70566_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9698%252F19189698%252Fexterior_front_passenger-1774716454410.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9698/19189698/exterior_front_passenger-1774716454410.jpg saved to cache
2026-03-29 20:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d556f659-7139-5edb-b94e-2fe4a5a70566
2026-03-29 20:19:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599e95d0>
2026-03-29 20:19:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7985a26c-0522-531a-a935-518c9a2306c8/7985a26c-0522-531a-a935-518c9a2306c8_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3257%252F20103257%252Fexterior_front_passenger-1774103493915.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3257/20103257/exterior_front_passenger-1774103493915.jpg saved to cache
2026-03-29 20:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7985a26c-0522-531a-a935-518c9a2306c8
2026-03-29 20:19:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19974522.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0166/20450166/exterior_rear_passenger-1774774036021.jpg> (referer: None)
2026-03-29 20:19:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a0e450>
2026-03-29 20:19:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7985a26c-0522-531a-a935-518c9a2306c8/7985a26c-0522-531a-a935-518c9a2306c8_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3257%252F20103257%252Finterior_front_seats-1774110924376.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3257/20103257/interior_front_seats-1774110924376.jpg saved to cache
2026-03-29 20:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7985a26c-0522-531a-a935-518c9a2306c8
2026-03-29 20:19:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ae16d0>
2026-03-29 20:19:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7985a26c-0522-531a-a935-518c9a2306c8/7985a26c-0522-531a-a935-518c9a2306c8_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3257%252F20103257%252Finterior_rear_seats-1774110706750.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3257/20103257/interior_rear_seats-1774110706750.jpg saved to cache
2026-03-29 20:19:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7985a26c-0522-531a-a935-518c9a2306c8
2026-03-29 20:19:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7985a26c-0522-531a-a935-518c9a2306c8, skipping ID generation
2026-03-29 20:19:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7985a26c-0522-531a-a935-518c9a2306c8 with scrape type 1
2026-03-29 20:19:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7985a26c-0522-531a-a935-518c9a2306c8 sending to next pipeline
2026-03-29 20:19:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 7985a26c-0522-531a-a935-518c9a2306c8, identifier: 20103257
2026-03-29 20:19:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0166/20450166/interior_rear_seats-1774772010464.jpg> (referer: None)
2026-03-29 20:19:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0166/20450166/interior_front_seats-1774772024203.jpg> (referer: None)
2026-03-29 20:19:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7985a26c-0522-531a-a935-518c9a2306c8 with identifier: 20103257
2026-03-29 20:19:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7985a26c-0522-531a-a935-518c9a2306c8 with identifier: 20103257
2026-03-29 20:19:53 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7985a26c-0522-531a-a935-518c9a2306c8 with identifier: 20103257 to the API
2026-03-29 20:19:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/3257/20103257/interior_rear_seats-1774110706750.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '7985a26c-0522-531a-a935-518c9a2306c8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'OV16 OKC',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20103257',
'listing': 'auction',
'location': 'Northamptonshire Northampton',
'make': 'BMW',
'model': '2 Series',
'odometer': 117000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 41,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7985a26c-0522-531a-a935-518c9a2306c8/7985a26c-0522-531a-a935-518c9a2306c8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1811772,
'Height': 2603,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3257/20103257/exterior_front_driver-1774111226852.jpg',
'Width': 3471},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7985a26c-0522-531a-a935-518c9a2306c8/7985a26c-0522-531a-a935-518c9a2306c8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1578727,
'Height': 2730,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3257/20103257/exterior_rear_driver-1774103463405.jpg',
'Width': 3640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7985a26c-0522-531a-a935-518c9a2306c8/7985a26c-0522-531a-a935-518c9a2306c8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2538515,
'Height': 2872,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3257/20103257/exterior_front_passenger-1774103493915.jpg',
'Width': 3829},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7985a26c-0522-531a-a935-518c9a2306c8/7985a26c-0522-531a-a935-518c9a2306c8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2118893,
'Height': 2744,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3257/20103257/exterior_rear_passenger-1774103474823.jpg',
'Width': 3659},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7985a26c-0522-531a-a935-518c9a2306c8/7985a26c-0522-531a-a935-518c9a2306c8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3019587,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3257/20103257/interior_front_seats-1774110924376.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7985a26c-0522-531a-a935-518c9a2306c8/7985a26c-0522-531a-a935-518c9a2306c8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3393518,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3257/20103257/interior_rear_seats-1774110706750.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7985a26c-0522-531a-a935-518c9a2306c8/7985a26c-0522-531a-a935-518c9a2306c8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1239623,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3257/20103257/interior_dashboard-1774110743677.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7985a26c-0522-531a-a935-518c9a2306c8/7985a26c-0522-531a-a935-518c9a2306c8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2591086,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3257/20103257/instrument_cluster-1774110705277.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7985a26c-0522-531a-a935-518c9a2306c8/7985a26c-0522-531a-a935-518c9a2306c8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2221447,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3257/20103257/interior_boot-1774110787957.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7985a26c-0522-531a-a935-518c9a2306c8/7985a26c-0522-531a-a935-518c9a2306c8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5102601,
'Height': 3251,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3257/20103257/docs_service_history-1774180040434.jpg?ixlib=js-3.8.0&auto=format&s=bcc3950673fe050971bcdfe9959ddac4',
'Width': 3168}],
'price': 2413,
'price_includes_vat': False,
'registration_date': '2016-04-14',
'seats_number': None,
'seller_name': None,
'title': 'BMW 216D Sport',
'transmission': 'manual',
'trim': '216D Sport',
'vin': 'WBA2B32000V788165',
'year': 2016}
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720103257%27 HTTP/1.1" 200 None
2026-03-29 20:19:54 [motorway.uk] INFO: Saving data for 20103257: {'created_time': 1774815594.031955, 'last_price_update_time': 1774815594.031966, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20103257') HTTP/1.1" 204 0
2026-03-29 20:19:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20481936.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f401d3a3-52fd-5857-b14d-bebf6eda8275 with identifier: 19974522
2026-03-29 20:19:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f401d3a3-52fd-5857-b14d-bebf6eda8275 with scrape type 1
2026-03-29 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f401d3a3-52fd-5857-b14d-bebf6eda8275
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4522%252F19974522%252Fexterior_front_driver-1774626436781.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4522/19974522/exterior_front_driver-1774626436781.jpeg not downloaded yet
2026-03-29 20:19:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a14c90>
2026-03-29 20:19:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ae03905-fe2f-550c-b063-813d66824638/5ae03905-fe2f-550c-b063-813d66824638_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0166%252F20450166%252Fexterior_rear_passenger-1774774036021.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0166/20450166/exterior_rear_passenger-1774774036021.jpg saved to cache
2026-03-29 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5ae03905-fe2f-550c-b063-813d66824638
2026-03-29 20:19:54 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:19:54 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:19:54 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x01\xa8\xbe\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\xae\x83\x00\x01\x81\x96\x00\x00\x00\x00'
2026-03-29 20:19:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65856bb90>
2026-03-29 20:19:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ae03905-fe2f-550c-b063-813d66824638/5ae03905-fe2f-550c-b063-813d66824638_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0166%252F20450166%252Finterior_rear_seats-1774772010464.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0166/20450166/interior_rear_seats-1774772010464.jpg saved to cache
2026-03-29 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5ae03905-fe2f-550c-b063-813d66824638
2026-03-29 20:19:54 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:19:54 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:19:54 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x01\xdf\x02\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\xb1\xbf\x00\x01\xb4\xe2\x00\x00\x00\x00'
2026-03-29 20:19:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d78d50>
2026-03-29 20:19:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ae03905-fe2f-550c-b063-813d66824638/5ae03905-fe2f-550c-b063-813d66824638_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0166%252F20450166%252Finterior_front_seats-1774772024203.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0166/20450166/interior_front_seats-1774772024203.jpg saved to cache
2026-03-29 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5ae03905-fe2f-550c-b063-813d66824638
2026-03-29 20:19:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9698/19189698/exterior_front_driver-1774711687012.jpg> (referer: None)
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4522%252F19974522%252Fexterior_rear_driver-1774626476509.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4522/19974522/exterior_rear_driver-1774626476509.jpeg not downloaded yet
2026-03-29 20:19:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e343718a-5566-5afb-bd95-38d4aa939e84 with identifier: 20481936
2026-03-29 20:19:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e343718a-5566-5afb-bd95-38d4aa939e84 with scrape type 1
2026-03-29 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e343718a-5566-5afb-bd95-38d4aa939e84
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1936%252F20481936%252Fexterior_front_driver-1774707453657.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1936/20481936/exterior_front_driver-1774707453657.jpg not downloaded yet
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4522%252F19974522%252Fexterior_front_passenger-1774626445607.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4522/19974522/exterior_front_passenger-1774626445607.jpeg not downloaded yet
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1936%252F20481936%252Fexterior_rear_driver-1774707263101.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1936/20481936/exterior_rear_driver-1774707263101.jpg not downloaded yet
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4522%252F19974522%252Fexterior_rear_passenger-1774626462946.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4522/19974522/exterior_rear_passenger-1774626462946.jpeg not downloaded yet
2026-03-29 20:19:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9698/19189698/exterior_rear_driver-1774711716533.jpg> (referer: None)
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1936%252F20481936%252Fexterior_front_passenger-1774707436909.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1936/20481936/exterior_front_passenger-1774707436909.jpg not downloaded yet
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4522%252F19974522%252Finterior_front_seats-1774626055885.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4522/19974522/interior_front_seats-1774626055885.jpeg not downloaded yet
2026-03-29 20:19:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/9188015.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:19:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6585692d0>
2026-03-29 20:19:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d556f659-7139-5edb-b94e-2fe4a5a70566/d556f659-7139-5edb-b94e-2fe4a5a70566_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9698%252F19189698%252Fexterior_front_driver-1774711687012.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9698/19189698/exterior_front_driver-1774711687012.jpg saved to cache
2026-03-29 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d556f659-7139-5edb-b94e-2fe4a5a70566
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1936%252F20481936%252Fexterior_rear_passenger-1774707286862.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1936/20481936/exterior_rear_passenger-1774707286862.jpg not downloaded yet
2026-03-29 20:19:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0166/20450166/exterior_front_driver-1774773862903.jpg> (referer: None)
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4522%252F19974522%252Finterior_rear_seats-1774625802557.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4522/19974522/interior_rear_seats-1774625802557.jpeg not downloaded yet
2026-03-29 20:19:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0166/20450166/exterior_rear_driver-1774773958253.jpg> (referer: None)
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1936%252F20481936%252Finterior_front_seats-1774707862556.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1936/20481936/interior_front_seats-1774707862556.jpg not downloaded yet
2026-03-29 20:19:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c4ed90>
2026-03-29 20:19:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d556f659-7139-5edb-b94e-2fe4a5a70566/d556f659-7139-5edb-b94e-2fe4a5a70566_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9698%252F19189698%252Fexterior_rear_driver-1774711716533.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9698/19189698/exterior_rear_driver-1774711716533.jpg saved to cache
2026-03-29 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d556f659-7139-5edb-b94e-2fe4a5a70566
2026-03-29 20:19:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d556f659-7139-5edb-b94e-2fe4a5a70566, skipping ID generation
2026-03-29 20:19:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d556f659-7139-5edb-b94e-2fe4a5a70566 with scrape type 1
2026-03-29 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d556f659-7139-5edb-b94e-2fe4a5a70566 sending to next pipeline
2026-03-29 20:19:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d556f659-7139-5edb-b94e-2fe4a5a70566, identifier: 19189698
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4522%252F19974522%252Finterior_dashboard-1774626131939.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4522/19974522/interior_dashboard-1774626131939.jpeg not downloaded yet
2026-03-29 20:19:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d556f659-7139-5edb-b94e-2fe4a5a70566 with identifier: 19189698
2026-03-29 20:19:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d556f659-7139-5edb-b94e-2fe4a5a70566 with identifier: 19189698
2026-03-29 20:19:54 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d556f659-7139-5edb-b94e-2fe4a5a70566 with identifier: 19189698 to the API
2026-03-29 20:19:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9698/19189698/exterior_rear_driver-1774711716533.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'd556f659-7139-5edb-b94e-2fe4a5a70566',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AK19 XHY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19189698',
'listing': 'auction',
'location': 'Merseyside Wirral',
'make': 'Land Rover',
'model': 'Range Rover',
'odometer': 55500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d556f659-7139-5edb-b94e-2fe4a5a70566/d556f659-7139-5edb-b94e-2fe4a5a70566_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 718244,
'Height': 2099,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9698/19189698/exterior_front_driver-1774711687012.jpg',
'Width': 2799},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d556f659-7139-5edb-b94e-2fe4a5a70566/d556f659-7139-5edb-b94e-2fe4a5a70566_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 802097,
'Height': 2063,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9698/19189698/exterior_rear_driver-1774711716533.jpg',
'Width': 2751},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d556f659-7139-5edb-b94e-2fe4a5a70566/d556f659-7139-5edb-b94e-2fe4a5a70566_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1447163,
'Height': 2439,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9698/19189698/exterior_front_passenger-1774716454410.jpg',
'Width': 3252},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d556f659-7139-5edb-b94e-2fe4a5a70566/d556f659-7139-5edb-b94e-2fe4a5a70566_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 875051,
'Height': 2215,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9698/19189698/exterior_rear_passenger-1774711753381.jpg',
'Width': 2953},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d556f659-7139-5edb-b94e-2fe4a5a70566/d556f659-7139-5edb-b94e-2fe4a5a70566_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2233890,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9698/19189698/interior_front_seats-1774712385682.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d556f659-7139-5edb-b94e-2fe4a5a70566/d556f659-7139-5edb-b94e-2fe4a5a70566_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2125456,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9698/19189698/interior_rear_seats-1774712368594.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d556f659-7139-5edb-b94e-2fe4a5a70566/d556f659-7139-5edb-b94e-2fe4a5a70566_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1489431,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9698/19189698/interior_dashboard-1774712393301.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d556f659-7139-5edb-b94e-2fe4a5a70566/d556f659-7139-5edb-b94e-2fe4a5a70566_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1624776,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9698/19189698/instrument_cluster-1774712365606.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d556f659-7139-5edb-b94e-2fe4a5a70566/d556f659-7139-5edb-b94e-2fe4a5a70566_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1944509,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9698/19189698/interior_boot-1774712375039.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d556f659-7139-5edb-b94e-2fe4a5a70566/d556f659-7139-5edb-b94e-2fe4a5a70566_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1374505,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9698/19189698/docs_service_history-1774712730486.jpg?ixlib=js-3.8.0&auto=format&s=b044c16a4d25d41ab85e534e540f298e',
'Width': 3840}],
'price': 9451,
'price_includes_vat': False,
'registration_date': '2019-03-26',
'seats_number': None,
'seller_name': None,
'title': 'Land Rover Range Rover Evoque SE Tech TD4 A',
'transmission': 'automatic',
'trim': 'Evoque SE Tech TD4 A',
'vin': 'SALVA2AN2KH342796',
'year': 2019}
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719189698%27 HTTP/1.1" 200 None
2026-03-29 20:19:55 [motorway.uk] INFO: Saving data for 19189698: {'created_time': 1774815595.143765, 'last_price_update_time': 1774815595.143778, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19189698') HTTP/1.1" 204 0
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1936%252F20481936%252Finterior_rear_seats-1774707880645.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1936/20481936/interior_rear_seats-1774707880645.jpg not downloaded yet
2026-03-29 20:19:55 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (14061491) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/4522/19974522/interior_front_seats-1774626055885.jpeg>.
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4522%252F19974522%252Finterior_boot-1774625733358.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4522/19974522/interior_boot-1774625733358.jpeg not downloaded yet
2026-03-29 20:19:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd71f959-30f2-5b99-92b1-1d2b2bc5e929 with identifier: 9188015
2026-03-29 20:19:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd71f959-30f2-5b99-92b1-1d2b2bc5e929 with scrape type 1
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bd71f959-30f2-5b99-92b1-1d2b2bc5e929
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8015%252F9188015%252Fexterior_front_driver-1774713830169.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8015/9188015/exterior_front_driver-1774713830169.jpg not downloaded yet
2026-03-29 20:19:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ce3c90>
2026-03-29 20:19:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ae03905-fe2f-550c-b063-813d66824638/5ae03905-fe2f-550c-b063-813d66824638_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0166%252F20450166%252Fexterior_front_driver-1774773862903.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0166/20450166/exterior_front_driver-1774773862903.jpg saved to cache
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5ae03905-fe2f-550c-b063-813d66824638
2026-03-29 20:19:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64b946e90>
2026-03-29 20:19:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ae03905-fe2f-550c-b063-813d66824638/5ae03905-fe2f-550c-b063-813d66824638_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0166%252F20450166%252Fexterior_rear_driver-1774773958253.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0166/20450166/exterior_rear_driver-1774773958253.jpg saved to cache
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5ae03905-fe2f-550c-b063-813d66824638
2026-03-29 20:19:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5ae03905-fe2f-550c-b063-813d66824638, skipping ID generation
2026-03-29 20:19:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ae03905-fe2f-550c-b063-813d66824638 with scrape type 1
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5ae03905-fe2f-550c-b063-813d66824638 sending to next pipeline
2026-03-29 20:19:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5ae03905-fe2f-550c-b063-813d66824638, identifier: 20450166
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1936%252F20481936%252Finterior_dashboard-1774708976890.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1936/20481936/interior_dashboard-1774708976890.jpg not downloaded yet
2026-03-29 20:19:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5ae03905-fe2f-550c-b063-813d66824638 with identifier: 20450166
2026-03-29 20:19:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5ae03905-fe2f-550c-b063-813d66824638 with identifier: 20450166
2026-03-29 20:19:55 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5ae03905-fe2f-550c-b063-813d66824638 with identifier: 20450166 to the API
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/0166/20450166/exterior_rear_driver-1774773958253.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '5ae03905-fe2f-550c-b063-813d66824638',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'RF23 EZX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20450166',
'listing': 'auction',
'location': 'Hampshire Southampton',
'make': 'Nissan',
'model': 'Juke',
'odometer': 25000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ae03905-fe2f-550c-b063-813d66824638/5ae03905-fe2f-550c-b063-813d66824638_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66861,
'Height': 397,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0166/20450166/exterior_front_driver-1774773862903.jpg',
'Width': 530},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ae03905-fe2f-550c-b063-813d66824638/5ae03905-fe2f-550c-b063-813d66824638_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 128567,
'Height': 585,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0166/20450166/exterior_rear_driver-1774773958253.jpg',
'Width': 780},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ae03905-fe2f-550c-b063-813d66824638/5ae03905-fe2f-550c-b063-813d66824638_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81095,
'Height': 449,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0166/20450166/exterior_front_passenger-1774774379123.jpg',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ae03905-fe2f-550c-b063-813d66824638/5ae03905-fe2f-550c-b063-813d66824638_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113810,
'Height': 585,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0166/20450166/exterior_rear_passenger-1774774036021.jpg',
'Width': 780},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ae03905-fe2f-550c-b063-813d66824638/5ae03905-fe2f-550c-b063-813d66824638_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 168129,
'Height': 480,
'OriginUrl': 'https://motorway-photos.imgix.net/0166/20450166/interior_front_seats-1774772024203.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ae03905-fe2f-550c-b063-813d66824638/5ae03905-fe2f-550c-b063-813d66824638_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 153409,
'Height': 480,
'OriginUrl': 'https://motorway-photos.imgix.net/0166/20450166/interior_rear_seats-1774772010464.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ae03905-fe2f-550c-b063-813d66824638/5ae03905-fe2f-550c-b063-813d66824638_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68948,
'Height': 640,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0166/20450166/interior_dashboard-1774772191764.jpg',
'Width': 480},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ae03905-fe2f-550c-b063-813d66824638/5ae03905-fe2f-550c-b063-813d66824638_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 173376,
'Height': 480,
'OriginUrl': 'https://motorway-photos.imgix.net/0166/20450166/interior_boot-1774772006143.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ae03905-fe2f-550c-b063-813d66824638/5ae03905-fe2f-550c-b063-813d66824638_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 157148,
'Height': 480,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0166/20450166/docs_service_history-1774772045379.jpg?ixlib=js-3.8.0&auto=format&s=49d4143f42318138d31f6ab051fde7c7',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ae03905-fe2f-550c-b063-813d66824638/5ae03905-fe2f-550c-b063-813d66824638_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 15419,
'Height': 180,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0166/20450166/damage_scratches-1774773625463.jpg',
'Width': 240}],
'price': 15397,
'price_includes_vat': False,
'registration_date': '2023-06-03',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Juke Tekna HEV CVT',
'transmission': 'automatic',
'trim': 'Tekna HEV CVT',
'vin': 'SJNFCAF16U1245293',
'year': 2023}
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720450166%27 HTTP/1.1" 200 None
2026-03-29 20:19:55 [motorway.uk] INFO: Saving data for 20450166: {'created_time': 1774815595.828599, 'last_price_update_time': 1774815595.82861, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20450166') HTTP/1.1" 204 0
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4522%252F19974522%252Fdocs_service_history-1774637162133.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D84f5114cc91d241f283b00cd711d38c0%27 HTTP/1.1" 200 None
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4522/19974522/docs_service_history-1774637162133.jpeg?ixlib=js-3.8.0&auto=format&s=84f5114cc91d241f283b00cd711d38c0 not downloaded yet
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8015%252F9188015%252Fexterior_rear_driver-1774713860998.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8015/9188015/exterior_rear_driver-1774713860998.jpg not downloaded yet
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1936%252F20481936%252Finterior_boot-1774707938741.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1936/20481936/interior_boot-1774707938741.jpg not downloaded yet
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4522%252F19974522%252Fdocs_service_history-1774637162131.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7780952bd3e4bf8c3163df18e9bf15e1%27 HTTP/1.1" 200 None
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4522/19974522/docs_service_history-1774637162131.jpeg?ixlib=js-3.8.0&auto=format&s=7780952bd3e4bf8c3163df18e9bf15e1 not downloaded yet
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8015%252F9188015%252Fexterior_front_passenger-1774713880007.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8015/9188015/exterior_front_passenger-1774713880007.jpg not downloaded yet
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1936%252F20481936%252Fdamage_scratches-1774707580232.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1936/20481936/damage_scratches-1774707580232.jpg not downloaded yet
2026-03-29 20:19:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0846/20020846/exterior_front_driver-1774632660615.jpeg> (referer: None)
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8015%252F9188015%252Fexterior_rear_passenger-1774713869173.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8015/9188015/exterior_rear_passenger-1774713869173.jpg not downloaded yet
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1936%252F20481936%252Fwheels_front_driver-1774707628108.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1936/20481936/wheels_front_driver-1774707628108.jpg not downloaded yet
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8015%252F9188015%252Finterior_front_seats-1774714187884.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8015/9188015/interior_front_seats-1774714187884.jpg not downloaded yet
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8015%252F9188015%252Finterior_rear_seats-1774714204275.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8015/9188015/interior_rear_seats-1774714204275.jpg not downloaded yet
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8015%252F9188015%252Finterior_dashboard-1774714230159.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8015/9188015/interior_dashboard-1774714230159.jpg not downloaded yet
2026-03-29 20:19:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1936/20481936/exterior_rear_passenger-1774707286862.jpg> (referer: None)
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8015%252F9188015%252Finstrument_cluster-1774714287037.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8015/9188015/instrument_cluster-1774714287037.jpg not downloaded yet
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584c6cd0>
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab00e38c-56dd-50ae-8c85-d51b6e009397/ab00e38c-56dd-50ae-8c85-d51b6e009397_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0846%252F20020846%252Fexterior_front_driver-1774632660615.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0846/20020846/exterior_front_driver-1774632660615.jpeg saved to cache
2026-03-29 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab00e38c-56dd-50ae-8c85-d51b6e009397
2026-03-29 20:19:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab00e38c-56dd-50ae-8c85-d51b6e009397, skipping ID generation
2026-03-29 20:19:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab00e38c-56dd-50ae-8c85-d51b6e009397 with scrape type 1
2026-03-29 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab00e38c-56dd-50ae-8c85-d51b6e009397 sending to next pipeline
2026-03-29 20:19:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ab00e38c-56dd-50ae-8c85-d51b6e009397, identifier: 20020846
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8015%252F9188015%252Finterior_boot-1774714264783.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8015/9188015/interior_boot-1774714264783.jpg not downloaded yet
2026-03-29 20:19:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ab00e38c-56dd-50ae-8c85-d51b6e009397 with identifier: 20020846
2026-03-29 20:19:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ab00e38c-56dd-50ae-8c85-d51b6e009397 with identifier: 20020846
2026-03-29 20:19:56 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ab00e38c-56dd-50ae-8c85-d51b6e009397 with identifier: 20020846 to the API
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:19:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0846/20020846/exterior_front_driver-1774632660615.jpeg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'ab00e38c-56dd-50ae-8c85-d51b6e009397',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'KV62 KKS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20020846',
'listing': 'auction',
'location': 'Wokingham Reading',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 29000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab00e38c-56dd-50ae-8c85-d51b6e009397/ab00e38c-56dd-50ae-8c85-d51b6e009397_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1665503,
'Height': 2838,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0846/20020846/exterior_front_driver-1774632660615.jpeg',
'Width': 3784},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab00e38c-56dd-50ae-8c85-d51b6e009397/ab00e38c-56dd-50ae-8c85-d51b6e009397_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 926820,
'Height': 1971,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0846/20020846/exterior_rear_driver-1774632349065.jpeg',
'Width': 2628},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab00e38c-56dd-50ae-8c85-d51b6e009397/ab00e38c-56dd-50ae-8c85-d51b6e009397_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1420462,
'Height': 2455,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0846/20020846/exterior_front_passenger-1774632321086.jpeg',
'Width': 3273},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab00e38c-56dd-50ae-8c85-d51b6e009397/ab00e38c-56dd-50ae-8c85-d51b6e009397_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1361274,
'Height': 2401,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0846/20020846/exterior_rear_passenger-1774632334213.jpeg',
'Width': 3201},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab00e38c-56dd-50ae-8c85-d51b6e009397/ab00e38c-56dd-50ae-8c85-d51b6e009397_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3900561,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0846/20020846/interior_front_seats-1774632541459.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab00e38c-56dd-50ae-8c85-d51b6e009397/ab00e38c-56dd-50ae-8c85-d51b6e009397_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2812607,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0846/20020846/interior_rear_seats-1774632419768.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab00e38c-56dd-50ae-8c85-d51b6e009397/ab00e38c-56dd-50ae-8c85-d51b6e009397_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3986949,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0846/20020846/interior_dashboard-1774632453998.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab00e38c-56dd-50ae-8c85-d51b6e009397/ab00e38c-56dd-50ae-8c85-d51b6e009397_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3462370,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0846/20020846/interior_boot-1774632466937.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab00e38c-56dd-50ae-8c85-d51b6e009397/ab00e38c-56dd-50ae-8c85-d51b6e009397_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1685755,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0846/20020846/docs_service_history-1774633374793.jpeg?ixlib=js-3.8.0&auto=format&s=79fc389826ce525f80a2c7122dc9afde',
'Width': 3024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab00e38c-56dd-50ae-8c85-d51b6e009397/ab00e38c-56dd-50ae-8c85-d51b6e009397_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1827176,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0846/20020846/docs_service_history-1774633384263.jpeg?ixlib=js-3.8.0&auto=format&s=e0a3bd5052929a8c92bc184bf38d1fcc',
'Width': 3024}],
'price': 4023,
'price_includes_vat': False,
'registration_date': '2012-09-28',
'seats_number': None,
'seller_name': None,
'title': 'Ford Fiesta Zetec',
'transmission': 'manual',
'trim': 'Zetec',
'vin': 'WF0JXXGAJJCE55044',
'year': 2012}
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720020846%27 HTTP/1.1" 200 None
2026-03-29 20:19:56 [motorway.uk] INFO: Saving data for 20020846: {'created_time': 1774815596.779074, 'last_price_update_time': 1774815596.779083, 'auction_closing_time': 1774884600.0}
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20020846') HTTP/1.1" 204 0
2026-03-29 20:19:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8545/13628545/13628545-exterior_rear_passenger-modified-1774781837236.jpeg> (referer: None)
2026-03-29 20:19:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8545/13628545/exterior_front_passenger-1774721814981.jpeg> (referer: None)
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8015%252F9188015%252Fdocs_service_history-1774714351149.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Daa6a7120dda3e43e1279dc763437d953%27 HTTP/1.1" 200 None
2026-03-29 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8015/9188015/docs_service_history-1774714351149.jpg?ixlib=js-3.8.0&auto=format&s=aa6a7120dda3e43e1279dc763437d953 not downloaded yet
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a91d50>
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e343718a-5566-5afb-bd95-38d4aa939e84/e343718a-5566-5afb-bd95-38d4aa939e84_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1936%252F20481936%252Fexterior_rear_passenger-1774707286862.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1936/20481936/exterior_rear_passenger-1774707286862.jpg saved to cache
2026-03-29 20:19:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e343718a-5566-5afb-bd95-38d4aa939e84
2026-03-29 20:19:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1936/20481936/exterior_front_passenger-1774707436909.jpg> (referer: None)
2026-03-29 20:19:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8545/13628545/13628545-instrument_cluster-modified-1774781949542.jpeg> (referer: None)
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bf6590>
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d15d962-11e6-5ca7-b539-a53b24167352/0d15d962-11e6-5ca7-b539-a53b24167352_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8545%252F13628545%252F13628545-exterior_rear_passenger-modified-1774781837236.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8545/13628545/13628545-exterior_rear_passenger-modified-1774781837236.jpeg saved to cache
2026-03-29 20:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d15d962-11e6-5ca7-b539-a53b24167352
2026-03-29 20:19:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8545/13628545/interior_boot-1774722094586.jpeg> (referer: None)
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658b383d0>
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d15d962-11e6-5ca7-b539-a53b24167352/0d15d962-11e6-5ca7-b539-a53b24167352_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8545%252F13628545%252Fexterior_front_passenger-1774721814981.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8545/13628545/exterior_front_passenger-1774721814981.jpeg saved to cache
2026-03-29 20:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d15d962-11e6-5ca7-b539-a53b24167352
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659bd8250>
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e343718a-5566-5afb-bd95-38d4aa939e84/e343718a-5566-5afb-bd95-38d4aa939e84_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1936%252F20481936%252Fexterior_front_passenger-1774707436909.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1936/20481936/exterior_front_passenger-1774707436909.jpg saved to cache
2026-03-29 20:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e343718a-5566-5afb-bd95-38d4aa939e84
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658b3ae50>
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d15d962-11e6-5ca7-b539-a53b24167352/0d15d962-11e6-5ca7-b539-a53b24167352_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8545%252F13628545%252F13628545-instrument_cluster-modified-1774781949542.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8545/13628545/13628545-instrument_cluster-modified-1774781949542.jpeg saved to cache
2026-03-29 20:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0d15d962-11e6-5ca7-b539-a53b24167352
2026-03-29 20:19:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8545/13628545/interior_rear_seats-1774722043725.jpeg> (referer: None)
2026-03-29 20:19:57 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:19:57 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:19:57 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00#\x1fO\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x03\\\x00#\x15?\x00\x00\x00\x00'
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65bf02110>
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d15d962-11e6-5ca7-b539-a53b24167352/0d15d962-11e6-5ca7-b539-a53b24167352_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8545%252F13628545%252Finterior_boot-1774722094586.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8545/13628545/interior_boot-1774722094586.jpeg saved to cache
2026-03-29 20:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0d15d962-11e6-5ca7-b539-a53b24167352
2026-03-29 20:19:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8015/9188015/docs_service_history-1774714351149.jpg?ixlib=js-3.8.0&auto=format&s=aa6a7120dda3e43e1279dc763437d953> (referer: None)
2026-03-29 20:19:57 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:19:57 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:19:57 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00)\xa2\x85\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01o\xaf\x00)\x98u\x00\x00\x00\x00'
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d14810>
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d15d962-11e6-5ca7-b539-a53b24167352/0d15d962-11e6-5ca7-b539-a53b24167352_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8545%252F13628545%252Finterior_rear_seats-1774722043725.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8545/13628545/interior_rear_seats-1774722043725.jpeg saved to cache
2026-03-29 20:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0d15d962-11e6-5ca7-b539-a53b24167352
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf4cc90>
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd71f959-30f2-5b99-92b1-1d2b2bc5e929/bd71f959-30f2-5b99-92b1-1d2b2bc5e929_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8015%252F9188015%252Fdocs_service_history-1774714351149.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Daa6a7120dda3e43e1279dc763437d953') HTTP/1.1" 204 0
2026-03-29 20:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8015/9188015/docs_service_history-1774714351149.jpg?ixlib=js-3.8.0&auto=format&s=aa6a7120dda3e43e1279dc763437d953 saved to cache
2026-03-29 20:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bd71f959-30f2-5b99-92b1-1d2b2bc5e929
2026-03-29 20:19:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8015/9188015/exterior_front_passenger-1774713880007.jpg> (referer: None)
2026-03-29 20:19:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8545/13628545/interior_front_seats-1774722148886.jpeg> (referer: None)
2026-03-29 20:19:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4522/19974522/exterior_rear_passenger-1774626462946.jpeg> (referer: None)
2026-03-29 20:19:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8015/9188015/interior_dashboard-1774714230159.jpg> (referer: None)
2026-03-29 20:19:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8015/9188015/interior_boot-1774714264783.jpg> (referer: None)
2026-03-29 20:19:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4522/19974522/exterior_front_driver-1774626436781.jpeg> (referer: None)
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659bdb910>
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd71f959-30f2-5b99-92b1-1d2b2bc5e929/bd71f959-30f2-5b99-92b1-1d2b2bc5e929_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8015%252F9188015%252Fexterior_front_passenger-1774713880007.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8015/9188015/exterior_front_passenger-1774713880007.jpg saved to cache
2026-03-29 20:19:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bd71f959-30f2-5b99-92b1-1d2b2bc5e929
2026-03-29 20:19:57 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:19:57 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:19:57 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00:\xc3(\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xde\xcf\x00:\xb9\x18\x00\x00\x00\x00'
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d17d10>
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d15d962-11e6-5ca7-b539-a53b24167352/0d15d962-11e6-5ca7-b539-a53b24167352_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8545%252F13628545%252Finterior_front_seats-1774722148886.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8545/13628545/interior_front_seats-1774722148886.jpeg saved to cache
2026-03-29 20:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d15d962-11e6-5ca7-b539-a53b24167352
2026-03-29 20:19:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf4d290>
2026-03-29 20:19:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f401d3a3-52fd-5857-b14d-bebf6eda8275/f401d3a3-52fd-5857-b14d-bebf6eda8275_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4522%252F19974522%252Fexterior_rear_passenger-1774626462946.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4522/19974522/exterior_rear_passenger-1774626462946.jpeg saved to cache
2026-03-29 20:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f401d3a3-52fd-5857-b14d-bebf6eda8275
2026-03-29 20:19:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658b396d0>
2026-03-29 20:19:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd71f959-30f2-5b99-92b1-1d2b2bc5e929/bd71f959-30f2-5b99-92b1-1d2b2bc5e929_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8015%252F9188015%252Finterior_dashboard-1774714230159.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8015/9188015/interior_dashboard-1774714230159.jpg saved to cache
2026-03-29 20:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bd71f959-30f2-5b99-92b1-1d2b2bc5e929
2026-03-29 20:19:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d171d0>
2026-03-29 20:19:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd71f959-30f2-5b99-92b1-1d2b2bc5e929/bd71f959-30f2-5b99-92b1-1d2b2bc5e929_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8015%252F9188015%252Finterior_boot-1774714264783.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8015/9188015/interior_boot-1774714264783.jpg saved to cache
2026-03-29 20:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bd71f959-30f2-5b99-92b1-1d2b2bc5e929
2026-03-29 20:19:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659cdb8d0>
2026-03-29 20:19:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f401d3a3-52fd-5857-b14d-bebf6eda8275/f401d3a3-52fd-5857-b14d-bebf6eda8275_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4522%252F19974522%252Fexterior_front_driver-1774626436781.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4522/19974522/exterior_front_driver-1774626436781.jpeg saved to cache
2026-03-29 20:19:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f401d3a3-52fd-5857-b14d-bebf6eda8275
2026-03-29 20:19:58 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/4522/19974522/interior_front_seats-1774626055885.jpeg>.
2026-03-29 20:19:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1936/20481936/wheels_front_driver-1774707628108.jpg> (referer: None)
2026-03-29 20:19:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8015/9188015/instrument_cluster-1774714287037.jpg> (referer: None)
2026-03-29 20:19:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8015/9188015/exterior_rear_passenger-1774713869173.jpg> (referer: None)
2026-03-29 20:19:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1936/20481936/damage_scratches-1774707580232.jpg> (referer: None)
2026-03-29 20:19:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4522/19974522/interior_front_seats-1774626055885.jpeg> (referer: None)
2026-03-29 20:19:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8015/9188015/interior_front_seats-1774714187884.jpg> (referer: None)
2026-03-29 20:19:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8015/9188015/interior_rear_seats-1774714204275.jpg> (referer: None)
2026-03-29 20:19:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fed450>
2026-03-29 20:19:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e343718a-5566-5afb-bd95-38d4aa939e84/e343718a-5566-5afb-bd95-38d4aa939e84_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1936%252F20481936%252Fwheels_front_driver-1774707628108.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1936/20481936/wheels_front_driver-1774707628108.jpg saved to cache
2026-03-29 20:19:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e343718a-5566-5afb-bd95-38d4aa939e84
2026-03-29 20:19:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4522/19974522/docs_service_history-1774637162133.jpeg?ixlib=js-3.8.0&auto=format&s=84f5114cc91d241f283b00cd711d38c0> (referer: None)
2026-03-29 20:19:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658b5c790>
2026-03-29 20:19:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd71f959-30f2-5b99-92b1-1d2b2bc5e929/bd71f959-30f2-5b99-92b1-1d2b2bc5e929_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8015%252F9188015%252Finstrument_cluster-1774714287037.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8015/9188015/instrument_cluster-1774714287037.jpg saved to cache
2026-03-29 20:19:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bd71f959-30f2-5b99-92b1-1d2b2bc5e929
2026-03-29 20:19:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659eb3310>
2026-03-29 20:19:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd71f959-30f2-5b99-92b1-1d2b2bc5e929/bd71f959-30f2-5b99-92b1-1d2b2bc5e929_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8015%252F9188015%252Fexterior_rear_passenger-1774713869173.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8015/9188015/exterior_rear_passenger-1774713869173.jpg saved to cache
2026-03-29 20:19:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bd71f959-30f2-5b99-92b1-1d2b2bc5e929
2026-03-29 20:19:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf13e10>
2026-03-29 20:19:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e343718a-5566-5afb-bd95-38d4aa939e84/e343718a-5566-5afb-bd95-38d4aa939e84_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1936%252F20481936%252Fdamage_scratches-1774707580232.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1936/20481936/damage_scratches-1774707580232.jpg saved to cache
2026-03-29 20:19:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e343718a-5566-5afb-bd95-38d4aa939e84
2026-03-29 20:19:59 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:19:59 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:19:59 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xcdH\xd3\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\tF\xe0\x00\xcd>C\x00\x00\x00\x00'
2026-03-29 20:19:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b85b90>
2026-03-29 20:19:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f401d3a3-52fd-5857-b14d-bebf6eda8275/f401d3a3-52fd-5857-b14d-bebf6eda8275_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4522%252F19974522%252Finterior_front_seats-1774626055885.jpeg') HTTP/1.1" 204 0
2026-03-29 20:19:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4522/19974522/interior_front_seats-1774626055885.jpeg saved to cache
2026-03-29 20:19:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f401d3a3-52fd-5857-b14d-bebf6eda8275
2026-03-29 20:19:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658109b50>
2026-03-29 20:19:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:19:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd71f959-30f2-5b99-92b1-1d2b2bc5e929/bd71f959-30f2-5b99-92b1-1d2b2bc5e929_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:19:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8015%252F9188015%252Finterior_front_seats-1774714187884.jpg') HTTP/1.1" 204 0
2026-03-29 20:19:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8015/9188015/interior_front_seats-1774714187884.jpg saved to cache
2026-03-29 20:19:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bd71f959-30f2-5b99-92b1-1d2b2bc5e929
2026-03-29 20:19:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:19:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:19:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:19:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:19:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:19:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b85450>
2026-03-29 20:19:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:19:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:19:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd71f959-30f2-5b99-92b1-1d2b2bc5e929/bd71f959-30f2-5b99-92b1-1d2b2bc5e929_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8015%252F9188015%252Finterior_rear_seats-1774714204275.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8015/9188015/interior_rear_seats-1774714204275.jpg saved to cache
2026-03-29 20:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bd71f959-30f2-5b99-92b1-1d2b2bc5e929
2026-03-29 20:20:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4522/19974522/docs_service_history-1774637162131.jpeg?ixlib=js-3.8.0&auto=format&s=7780952bd3e4bf8c3163df18e9bf15e1> (referer: None)
2026-03-29 20:20:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658816310>
2026-03-29 20:20:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f401d3a3-52fd-5857-b14d-bebf6eda8275/f401d3a3-52fd-5857-b14d-bebf6eda8275_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4522%252F19974522%252Fdocs_service_history-1774637162133.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D84f5114cc91d241f283b00cd711d38c0') HTTP/1.1" 204 0
2026-03-29 20:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4522/19974522/docs_service_history-1774637162133.jpeg?ixlib=js-3.8.0&auto=format&s=84f5114cc91d241f283b00cd711d38c0 saved to cache
2026-03-29 20:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f401d3a3-52fd-5857-b14d-bebf6eda8275
2026-03-29 20:20:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1936/20481936/interior_dashboard-1774708976890.jpg> (referer: None)
2026-03-29 20:20:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8015/9188015/exterior_front_driver-1774713830169.jpg> (referer: None)
2026-03-29 20:20:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8015/9188015/exterior_rear_driver-1774713860998.jpg> (referer: None)
2026-03-29 20:20:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1936/20481936/interior_boot-1774707938741.jpg> (referer: None)
2026-03-29 20:20:00 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (14576140) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/4522/19974522/interior_rear_seats-1774625802557.jpeg>.
2026-03-29 20:20:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a75410>
2026-03-29 20:20:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f401d3a3-52fd-5857-b14d-bebf6eda8275/f401d3a3-52fd-5857-b14d-bebf6eda8275_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4522%252F19974522%252Fdocs_service_history-1774637162131.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7780952bd3e4bf8c3163df18e9bf15e1') HTTP/1.1" 204 0
2026-03-29 20:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4522/19974522/docs_service_history-1774637162131.jpeg?ixlib=js-3.8.0&auto=format&s=7780952bd3e4bf8c3163df18e9bf15e1 saved to cache
2026-03-29 20:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f401d3a3-52fd-5857-b14d-bebf6eda8275
2026-03-29 20:20:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a82e50>
2026-03-29 20:20:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e343718a-5566-5afb-bd95-38d4aa939e84/e343718a-5566-5afb-bd95-38d4aa939e84_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1936%252F20481936%252Finterior_dashboard-1774708976890.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1936/20481936/interior_dashboard-1774708976890.jpg saved to cache
2026-03-29 20:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e343718a-5566-5afb-bd95-38d4aa939e84
2026-03-29 20:20:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584d5f50>
2026-03-29 20:20:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd71f959-30f2-5b99-92b1-1d2b2bc5e929/bd71f959-30f2-5b99-92b1-1d2b2bc5e929_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8015%252F9188015%252Fexterior_front_driver-1774713830169.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8015/9188015/exterior_front_driver-1774713830169.jpg saved to cache
2026-03-29 20:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd71f959-30f2-5b99-92b1-1d2b2bc5e929
2026-03-29 20:20:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d16710>
2026-03-29 20:20:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd71f959-30f2-5b99-92b1-1d2b2bc5e929/bd71f959-30f2-5b99-92b1-1d2b2bc5e929_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8015%252F9188015%252Fexterior_rear_driver-1774713860998.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8015/9188015/exterior_rear_driver-1774713860998.jpg saved to cache
2026-03-29 20:20:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bd71f959-30f2-5b99-92b1-1d2b2bc5e929
2026-03-29 20:20:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd71f959-30f2-5b99-92b1-1d2b2bc5e929, skipping ID generation
2026-03-29 20:20:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd71f959-30f2-5b99-92b1-1d2b2bc5e929 with scrape type 1
2026-03-29 20:20:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd71f959-30f2-5b99-92b1-1d2b2bc5e929 sending to next pipeline
2026-03-29 20:20:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: bd71f959-30f2-5b99-92b1-1d2b2bc5e929, identifier: 9188015
2026-03-29 20:20:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ce62d0>
2026-03-29 20:20:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e343718a-5566-5afb-bd95-38d4aa939e84/e343718a-5566-5afb-bd95-38d4aa939e84_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1936%252F20481936%252Finterior_boot-1774707938741.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1936/20481936/interior_boot-1774707938741.jpg saved to cache
2026-03-29 20:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e343718a-5566-5afb-bd95-38d4aa939e84
2026-03-29 20:20:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: bd71f959-30f2-5b99-92b1-1d2b2bc5e929 with identifier: 9188015
2026-03-29 20:20:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: bd71f959-30f2-5b99-92b1-1d2b2bc5e929 with identifier: 9188015
2026-03-29 20:20:01 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: bd71f959-30f2-5b99-92b1-1d2b2bc5e929 with identifier: 9188015 to the API
2026-03-29 20:20:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8015/9188015/exterior_rear_driver-1774713860998.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'bd71f959-30f2-5b99-92b1-1d2b2bc5e929',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WT15 EWJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/9188015',
'listing': 'auction',
'location': 'South Gloucestershire Bristol',
'make': 'Fiat',
'model': '500',
'odometer': 62337,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd71f959-30f2-5b99-92b1-1d2b2bc5e929/bd71f959-30f2-5b99-92b1-1d2b2bc5e929_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1742385,
'Height': 2581,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8015/9188015/exterior_front_driver-1774713830169.jpg',
'Width': 3441},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd71f959-30f2-5b99-92b1-1d2b2bc5e929/bd71f959-30f2-5b99-92b1-1d2b2bc5e929_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1922959,
'Height': 2602,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8015/9188015/exterior_rear_driver-1774713860998.jpg',
'Width': 3469},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd71f959-30f2-5b99-92b1-1d2b2bc5e929/bd71f959-30f2-5b99-92b1-1d2b2bc5e929_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2059901,
'Height': 2785,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8015/9188015/exterior_front_passenger-1774713880007.jpg',
'Width': 3713},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd71f959-30f2-5b99-92b1-1d2b2bc5e929/bd71f959-30f2-5b99-92b1-1d2b2bc5e929_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2458024,
'Height': 2926,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8015/9188015/exterior_rear_passenger-1774713869173.jpg',
'Width': 3901},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd71f959-30f2-5b99-92b1-1d2b2bc5e929/bd71f959-30f2-5b99-92b1-1d2b2bc5e929_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4145099,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8015/9188015/interior_front_seats-1774714187884.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd71f959-30f2-5b99-92b1-1d2b2bc5e929/bd71f959-30f2-5b99-92b1-1d2b2bc5e929_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5021071,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8015/9188015/interior_rear_seats-1774714204275.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd71f959-30f2-5b99-92b1-1d2b2bc5e929/bd71f959-30f2-5b99-92b1-1d2b2bc5e929_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3832646,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8015/9188015/interior_dashboard-1774714230159.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd71f959-30f2-5b99-92b1-1d2b2bc5e929/bd71f959-30f2-5b99-92b1-1d2b2bc5e929_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2261486,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8015/9188015/instrument_cluster-1774714287037.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd71f959-30f2-5b99-92b1-1d2b2bc5e929/bd71f959-30f2-5b99-92b1-1d2b2bc5e929_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3744340,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8015/9188015/interior_boot-1774714264783.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd71f959-30f2-5b99-92b1-1d2b2bc5e929/bd71f959-30f2-5b99-92b1-1d2b2bc5e929_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288116,
'Height': 1582,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8015/9188015/docs_service_history-1774714351149.jpg?ixlib=js-3.8.0&auto=format&s=aa6a7120dda3e43e1279dc763437d953',
'Width': 2130}],
'price': 2625,
'price_includes_vat': False,
'registration_date': '2015-07-30',
'seats_number': None,
'seller_name': None,
'title': 'Fiat 500 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'vin': 'ZFA3120000J408509',
'year': 2015}
2026-03-29 20:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279188015%27 HTTP/1.1" 200 None
2026-03-29 20:20:01 [motorway.uk] INFO: Saving data for 9188015: {'created_time': 1774815601.436049, 'last_price_update_time': 1774815601.43606, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='9188015') HTTP/1.1" 204 0
2026-03-29 20:20:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1936/20481936/exterior_front_driver-1774707453657.jpg> (referer: None)
2026-03-29 20:20:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1936/20481936/exterior_rear_driver-1774707263101.jpg> (referer: None)
2026-03-29 20:20:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8545/13628545/13628545-exterior_rear_driver-modified-1774781815218.jpeg> (referer: None)
2026-03-29 20:20:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1936/20481936/interior_rear_seats-1774707880645.jpg> (referer: None)
2026-03-29 20:20:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1936/20481936/interior_front_seats-1774707862556.jpg> (referer: None)
2026-03-29 20:20:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4522/19974522/exterior_front_passenger-1774626445607.jpeg> (referer: None)
2026-03-29 20:20:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8545/13628545/exterior_front_driver-1774721804986.jpeg> (referer: None)
2026-03-29 20:20:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4522/19974522/interior_dashboard-1774626131939.jpeg> (referer: None)
2026-03-29 20:20:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659bdb790>
2026-03-29 20:20:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e343718a-5566-5afb-bd95-38d4aa939e84/e343718a-5566-5afb-bd95-38d4aa939e84_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1936%252F20481936%252Fexterior_front_driver-1774707453657.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1936/20481936/exterior_front_driver-1774707453657.jpg saved to cache
2026-03-29 20:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e343718a-5566-5afb-bd95-38d4aa939e84
2026-03-29 20:20:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f04410>
2026-03-29 20:20:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e343718a-5566-5afb-bd95-38d4aa939e84/e343718a-5566-5afb-bd95-38d4aa939e84_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1936%252F20481936%252Fexterior_rear_driver-1774707263101.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1936/20481936/exterior_rear_driver-1774707263101.jpg saved to cache
2026-03-29 20:20:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e343718a-5566-5afb-bd95-38d4aa939e84
2026-03-29 20:20:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a90350>
2026-03-29 20:20:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d15d962-11e6-5ca7-b539-a53b24167352/0d15d962-11e6-5ca7-b539-a53b24167352_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8545%252F13628545%252F13628545-exterior_rear_driver-modified-1774781815218.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8545/13628545/13628545-exterior_rear_driver-modified-1774781815218.jpeg saved to cache
2026-03-29 20:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d15d962-11e6-5ca7-b539-a53b24167352
2026-03-29 20:20:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583c4bd0>
2026-03-29 20:20:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e343718a-5566-5afb-bd95-38d4aa939e84/e343718a-5566-5afb-bd95-38d4aa939e84_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1936%252F20481936%252Finterior_rear_seats-1774707880645.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1936/20481936/interior_rear_seats-1774707880645.jpg saved to cache
2026-03-29 20:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e343718a-5566-5afb-bd95-38d4aa939e84
2026-03-29 20:20:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f074d0>
2026-03-29 20:20:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e343718a-5566-5afb-bd95-38d4aa939e84/e343718a-5566-5afb-bd95-38d4aa939e84_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1936%252F20481936%252Finterior_front_seats-1774707862556.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1936/20481936/interior_front_seats-1774707862556.jpg saved to cache
2026-03-29 20:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e343718a-5566-5afb-bd95-38d4aa939e84
2026-03-29 20:20:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e343718a-5566-5afb-bd95-38d4aa939e84, skipping ID generation
2026-03-29 20:20:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e343718a-5566-5afb-bd95-38d4aa939e84 with scrape type 1
2026-03-29 20:20:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e343718a-5566-5afb-bd95-38d4aa939e84 sending to next pipeline
2026-03-29 20:20:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e343718a-5566-5afb-bd95-38d4aa939e84, identifier: 20481936
2026-03-29 20:20:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659bd9890>
2026-03-29 20:20:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f401d3a3-52fd-5857-b14d-bebf6eda8275/f401d3a3-52fd-5857-b14d-bebf6eda8275_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4522%252F19974522%252Fexterior_front_passenger-1774626445607.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4522/19974522/exterior_front_passenger-1774626445607.jpeg saved to cache
2026-03-29 20:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f401d3a3-52fd-5857-b14d-bebf6eda8275
2026-03-29 20:20:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be535d0>
2026-03-29 20:20:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d15d962-11e6-5ca7-b539-a53b24167352/0d15d962-11e6-5ca7-b539-a53b24167352_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8545%252F13628545%252Fexterior_front_driver-1774721804986.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8545/13628545/exterior_front_driver-1774721804986.jpeg saved to cache
2026-03-29 20:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d15d962-11e6-5ca7-b539-a53b24167352
2026-03-29 20:20:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d15d962-11e6-5ca7-b539-a53b24167352, skipping ID generation
2026-03-29 20:20:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d15d962-11e6-5ca7-b539-a53b24167352 with scrape type 1
2026-03-29 20:20:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d15d962-11e6-5ca7-b539-a53b24167352 sending to next pipeline
2026-03-29 20:20:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 0d15d962-11e6-5ca7-b539-a53b24167352, identifier: 13628545
2026-03-29 20:20:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ff8b10>
2026-03-29 20:20:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f401d3a3-52fd-5857-b14d-bebf6eda8275/f401d3a3-52fd-5857-b14d-bebf6eda8275_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4522%252F19974522%252Finterior_dashboard-1774626131939.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4522/19974522/interior_dashboard-1774626131939.jpeg saved to cache
2026-03-29 20:20:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f401d3a3-52fd-5857-b14d-bebf6eda8275
2026-03-29 20:20:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e343718a-5566-5afb-bd95-38d4aa939e84 with identifier: 20481936
2026-03-29 20:20:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e343718a-5566-5afb-bd95-38d4aa939e84 with identifier: 20481936
2026-03-29 20:20:03 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e343718a-5566-5afb-bd95-38d4aa939e84 with identifier: 20481936 to the API
2026-03-29 20:20:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/1936/20481936/interior_front_seats-1774707862556.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'e343718a-5566-5afb-bd95-38d4aa939e84',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LJ25 YPS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20481936',
'listing': 'auction',
'location': 'Greater London Mitcham',
'make': 'Nissan',
'model': 'Juke',
'odometer': 1651,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e343718a-5566-5afb-bd95-38d4aa939e84/e343718a-5566-5afb-bd95-38d4aa939e84_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1347502,
'Height': 2612,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1936/20481936/exterior_front_driver-1774707453657.jpg',
'Width': 3483},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e343718a-5566-5afb-bd95-38d4aa939e84/e343718a-5566-5afb-bd95-38d4aa939e84_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1540581,
'Height': 2596,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1936/20481936/exterior_rear_driver-1774707263101.jpg',
'Width': 3461},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e343718a-5566-5afb-bd95-38d4aa939e84/e343718a-5566-5afb-bd95-38d4aa939e84_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1481961,
'Height': 2615,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1936/20481936/exterior_front_passenger-1774707436909.jpg',
'Width': 3486},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e343718a-5566-5afb-bd95-38d4aa939e84/e343718a-5566-5afb-bd95-38d4aa939e84_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 785524,
'Height': 1954,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1936/20481936/exterior_rear_passenger-1774707286862.jpg',
'Width': 2605},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e343718a-5566-5afb-bd95-38d4aa939e84/e343718a-5566-5afb-bd95-38d4aa939e84_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3163734,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1936/20481936/interior_front_seats-1774707862556.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e343718a-5566-5afb-bd95-38d4aa939e84/e343718a-5566-5afb-bd95-38d4aa939e84_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2440449,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1936/20481936/interior_rear_seats-1774707880645.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e343718a-5566-5afb-bd95-38d4aa939e84/e343718a-5566-5afb-bd95-38d4aa939e84_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2479158,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1936/20481936/interior_dashboard-1774708976890.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e343718a-5566-5afb-bd95-38d4aa939e84/e343718a-5566-5afb-bd95-38d4aa939e84_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3035968,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1936/20481936/interior_boot-1774707938741.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e343718a-5566-5afb-bd95-38d4aa939e84/e343718a-5566-5afb-bd95-38d4aa939e84_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2390816,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1936/20481936/damage_scratches-1774707580232.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e343718a-5566-5afb-bd95-38d4aa939e84/e343718a-5566-5afb-bd95-38d4aa939e84_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1017542,
'Height': 2221,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1936/20481936/wheels_front_driver-1774707628108.jpg',
'Width': 2961}],
'price': 16351,
'price_includes_vat': False,
'registration_date': '2025-06-26',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Juke N-Connecta DiG-T S-A',
'transmission': 'automatic',
'trim': 'N-Connecta DiG-T S-A',
'vin': 'SJNF16FA3U2126132',
'year': 2025}
2026-03-29 20:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720481936%27 HTTP/1.1" 200 None
2026-03-29 20:20:03 [motorway.uk] INFO: Saving data for 20481936: {'created_time': 1774815603.369185, 'last_price_update_time': 1774815603.369195, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20481936') HTTP/1.1" 204 0
2026-03-29 20:20:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 0d15d962-11e6-5ca7-b539-a53b24167352 with identifier: 13628545
2026-03-29 20:20:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 0d15d962-11e6-5ca7-b539-a53b24167352 with identifier: 13628545
2026-03-29 20:20:03 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 0d15d962-11e6-5ca7-b539-a53b24167352 with identifier: 13628545 to the API
2026-03-29 20:20:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8545/13628545/exterior_front_driver-1774721804986.jpeg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '0d15d962-11e6-5ca7-b539-a53b24167352',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RF67 MLX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/13628545',
'listing': 'auction',
'location': 'West Midlands Wolverhampton',
'make': 'BMW',
'model': '1 Series',
'odometer': 56180,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d15d962-11e6-5ca7-b539-a53b24167352/0d15d962-11e6-5ca7-b539-a53b24167352_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1684034,
'Height': 2443,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8545/13628545/exterior_front_driver-1774721804986.jpeg',
'Width': 3257},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d15d962-11e6-5ca7-b539-a53b24167352/0d15d962-11e6-5ca7-b539-a53b24167352_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2553250,
'Height': 2841,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8545/13628545/13628545-exterior_rear_driver-modified-1774781815218.jpeg',
'Width': 3788},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d15d962-11e6-5ca7-b539-a53b24167352/0d15d962-11e6-5ca7-b539-a53b24167352_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1768568,
'Height': 2615,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8545/13628545/exterior_front_passenger-1774721814981.jpeg',
'Width': 3487},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d15d962-11e6-5ca7-b539-a53b24167352/0d15d962-11e6-5ca7-b539-a53b24167352_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1797868,
'Height': 2514,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8545/13628545/13628545-exterior_rear_passenger-modified-1774781837236.jpeg',
'Width': 3352},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d15d962-11e6-5ca7-b539-a53b24167352/0d15d962-11e6-5ca7-b539-a53b24167352_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3973623,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8545/13628545/interior_front_seats-1774722148886.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d15d962-11e6-5ca7-b539-a53b24167352/0d15d962-11e6-5ca7-b539-a53b24167352_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2822708,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8545/13628545/interior_rear_seats-1774722043725.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d15d962-11e6-5ca7-b539-a53b24167352/0d15d962-11e6-5ca7-b539-a53b24167352_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2192347,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8545/13628545/13628545-interior_dashboard-modified-1774781909652.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d15d962-11e6-5ca7-b539-a53b24167352/0d15d962-11e6-5ca7-b539-a53b24167352_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2281068,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8545/13628545/13628545-instrument_cluster-modified-1774781949542.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d15d962-11e6-5ca7-b539-a53b24167352/0d15d962-11e6-5ca7-b539-a53b24167352_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2433707,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8545/13628545/interior_boot-1774722094586.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d15d962-11e6-5ca7-b539-a53b24167352/0d15d962-11e6-5ca7-b539-a53b24167352_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1753491,
'Height': 2815,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/8545/13628545/13628545-docs_service_history-modified-1774782120721.jpeg?ixlib=js-3.8.0&auto=format&s=a88acb976392271e94c046996f875906',
'Width': 3753}],
'price': 7496,
'price_includes_vat': False,
'registration_date': '2018-01-31',
'seats_number': None,
'seller_name': None,
'title': 'BMW 118I Sport',
'transmission': 'manual',
'trim': '118I Sport',
'vin': 'WBA1R520705K94744',
'year': 2018}
2026-03-29 20:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713628545%27 HTTP/1.1" 200 None
2026-03-29 20:20:03 [motorway.uk] INFO: Saving data for 13628545: {'created_time': 1774815603.816132, 'last_price_update_time': 1774815603.816143, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='13628545') HTTP/1.1" 204 0
2026-03-29 20:20:03 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.594(s), this was the 1st time calling it.
2026-03-29 20:20:03 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.564561570310449 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:20:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4522/19974522/exterior_rear_driver-1774626476509.jpeg> (referer: None)
2026-03-29 20:20:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2217/20492217/exterior_rear_driver-1774720295077.jpg> (referer: None)
2026-03-29 20:20:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4522/19974522/interior_boot-1774625733358.jpeg> (referer: None)
2026-03-29 20:20:03 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/4522/19974522/interior_rear_seats-1774625802557.jpeg>.
2026-03-29 20:20:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659eaa550>
2026-03-29 20:20:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f401d3a3-52fd-5857-b14d-bebf6eda8275/f401d3a3-52fd-5857-b14d-bebf6eda8275_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4522%252F19974522%252Fexterior_rear_driver-1774626476509.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4522/19974522/exterior_rear_driver-1774626476509.jpeg saved to cache
2026-03-29 20:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f401d3a3-52fd-5857-b14d-bebf6eda8275
2026-03-29 20:20:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ffb810>
2026-03-29 20:20:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a73baf94-6acc-558d-9e97-8756297fc494/a73baf94-6acc-558d-9e97-8756297fc494_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2217%252F20492217%252Fexterior_rear_driver-1774720295077.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2217/20492217/exterior_rear_driver-1774720295077.jpg saved to cache
2026-03-29 20:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a73baf94-6acc-558d-9e97-8756297fc494
2026-03-29 20:20:04 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:20:04 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:20:04 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x92m\x07\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x05ex\x00\x92bw\x00\x00\x00\x00'
2026-03-29 20:20:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589f4550>
2026-03-29 20:20:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f401d3a3-52fd-5857-b14d-bebf6eda8275/f401d3a3-52fd-5857-b14d-bebf6eda8275_image_7.mpo HTTP/1.1" 201 0
2026-03-29 20:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4522%252F19974522%252Finterior_boot-1774625733358.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4522/19974522/interior_boot-1774625733358.jpeg saved to cache
2026-03-29 20:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f401d3a3-52fd-5857-b14d-bebf6eda8275
2026-03-29 20:20:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8251/7888251/exterior_front_driver-1774699940540.jpeg> (referer: None)
2026-03-29 20:20:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2217/20492217/exterior_front_driver-1774720342821.jpg> (referer: None)
2026-03-29 20:20:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8251/7888251/exterior_front_passenger-1774699965420.jpeg> (referer: None)
2026-03-29 20:20:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8251/7888251/exterior_rear_driver-1774700023777.jpeg> (referer: None)
2026-03-29 20:20:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4522/19974522/interior_rear_seats-1774625802557.jpeg> (referer: None)
2026-03-29 20:20:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8251/7888251/exterior_rear_passenger-1774700066350.jpeg> (referer: None)
2026-03-29 20:20:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8251/7888251/interior_front_seats-1774700112069.jpeg> (referer: None)
2026-03-29 20:20:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582f0590>
2026-03-29 20:20:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c6281-088f-534c-a5d6-61577ca62f7f/137c6281-088f-534c-a5d6-61577ca62f7f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8251%252F7888251%252Fexterior_front_driver-1774699940540.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8251/7888251/exterior_front_driver-1774699940540.jpeg saved to cache
2026-03-29 20:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 137c6281-088f-534c-a5d6-61577ca62f7f
2026-03-29 20:20:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658537dd0>
2026-03-29 20:20:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a73baf94-6acc-558d-9e97-8756297fc494/a73baf94-6acc-558d-9e97-8756297fc494_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2217%252F20492217%252Fexterior_front_driver-1774720342821.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2217/20492217/exterior_front_driver-1774720342821.jpg saved to cache
2026-03-29 20:20:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a73baf94-6acc-558d-9e97-8756297fc494
2026-03-29 20:20:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a73baf94-6acc-558d-9e97-8756297fc494, skipping ID generation
2026-03-29 20:20:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a73baf94-6acc-558d-9e97-8756297fc494 with scrape type 1
2026-03-29 20:20:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a73baf94-6acc-558d-9e97-8756297fc494 sending to next pipeline
2026-03-29 20:20:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a73baf94-6acc-558d-9e97-8756297fc494, identifier: 20492217
2026-03-29 20:20:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589f7490>
2026-03-29 20:20:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c6281-088f-534c-a5d6-61577ca62f7f/137c6281-088f-534c-a5d6-61577ca62f7f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8251%252F7888251%252Fexterior_front_passenger-1774699965420.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8251/7888251/exterior_front_passenger-1774699965420.jpeg saved to cache
2026-03-29 20:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 137c6281-088f-534c-a5d6-61577ca62f7f
2026-03-29 20:20:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ea9150>
2026-03-29 20:20:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c6281-088f-534c-a5d6-61577ca62f7f/137c6281-088f-534c-a5d6-61577ca62f7f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8251%252F7888251%252Fexterior_rear_driver-1774700023777.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8251/7888251/exterior_rear_driver-1774700023777.jpeg saved to cache
2026-03-29 20:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 137c6281-088f-534c-a5d6-61577ca62f7f
2026-03-29 20:20:05 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:20:05 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:20:05 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xd5\xb1\xb4\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x08\xb8X\x00\xd5\xa7$\x00\x00\x00\x00'
2026-03-29 20:20:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584d56d0>
2026-03-29 20:20:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f401d3a3-52fd-5857-b14d-bebf6eda8275/f401d3a3-52fd-5857-b14d-bebf6eda8275_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4522%252F19974522%252Finterior_rear_seats-1774625802557.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4522/19974522/interior_rear_seats-1774625802557.jpeg saved to cache
2026-03-29 20:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f401d3a3-52fd-5857-b14d-bebf6eda8275
2026-03-29 20:20:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f401d3a3-52fd-5857-b14d-bebf6eda8275, skipping ID generation
2026-03-29 20:20:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f401d3a3-52fd-5857-b14d-bebf6eda8275 with scrape type 1
2026-03-29 20:20:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f401d3a3-52fd-5857-b14d-bebf6eda8275 sending to next pipeline
2026-03-29 20:20:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f401d3a3-52fd-5857-b14d-bebf6eda8275, identifier: 19974522
2026-03-29 20:20:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ea8a90>
2026-03-29 20:20:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c6281-088f-534c-a5d6-61577ca62f7f/137c6281-088f-534c-a5d6-61577ca62f7f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8251%252F7888251%252Fexterior_rear_passenger-1774700066350.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8251/7888251/exterior_rear_passenger-1774700066350.jpeg saved to cache
2026-03-29 20:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 137c6281-088f-534c-a5d6-61577ca62f7f
2026-03-29 20:20:05 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:20:05 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:20:05 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x000\x0bQ\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\r\xfb\x000\x01_\x00\x00\x00\x00'
2026-03-29 20:20:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be922d0>
2026-03-29 20:20:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_137c6281-088f-534c-a5d6-61577ca62f7f/137c6281-088f-534c-a5d6-61577ca62f7f_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8251%252F7888251%252Finterior_front_seats-1774700112069.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8251/7888251/interior_front_seats-1774700112069.jpeg saved to cache
2026-03-29 20:20:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 137c6281-088f-534c-a5d6-61577ca62f7f
2026-03-29 20:20:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 137c6281-088f-534c-a5d6-61577ca62f7f, skipping ID generation
2026-03-29 20:20:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 137c6281-088f-534c-a5d6-61577ca62f7f with scrape type 1
2026-03-29 20:20:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 137c6281-088f-534c-a5d6-61577ca62f7f sending to next pipeline
2026-03-29 20:20:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 137c6281-088f-534c-a5d6-61577ca62f7f, identifier: 7888251
2026-03-29 20:20:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a73baf94-6acc-558d-9e97-8756297fc494 with identifier: 20492217
2026-03-29 20:20:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a73baf94-6acc-558d-9e97-8756297fc494 with identifier: 20492217
2026-03-29 20:20:06 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a73baf94-6acc-558d-9e97-8756297fc494 with identifier: 20492217 to the API
2026-03-29 20:20:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2217/20492217/exterior_front_driver-1774720342821.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'a73baf94-6acc-558d-9e97-8756297fc494',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LL67 EDF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20492217',
'listing': 'auction',
'location': 'Lancashire Skelmersdale',
'make': 'BMW',
'model': '4 Series',
'odometer': 82231,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73baf94-6acc-558d-9e97-8756297fc494/a73baf94-6acc-558d-9e97-8756297fc494_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1631019,
'Height': 2660,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2217/20492217/exterior_front_driver-1774720342821.jpg',
'Width': 3547},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73baf94-6acc-558d-9e97-8756297fc494/a73baf94-6acc-558d-9e97-8756297fc494_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1119854,
'Height': 2320,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2217/20492217/exterior_rear_driver-1774720295077.jpg',
'Width': 3093},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73baf94-6acc-558d-9e97-8756297fc494/a73baf94-6acc-558d-9e97-8756297fc494_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1322490,
'Height': 2387,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2217/20492217/exterior_front_passenger-1774720321429.jpg',
'Width': 3183},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73baf94-6acc-558d-9e97-8756297fc494/a73baf94-6acc-558d-9e97-8756297fc494_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1431072,
'Height': 2549,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2217/20492217/exterior_rear_passenger-1774720308301.jpg',
'Width': 3399},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73baf94-6acc-558d-9e97-8756297fc494/a73baf94-6acc-558d-9e97-8756297fc494_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3708040,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2217/20492217/interior_front_seats-1774720759199.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73baf94-6acc-558d-9e97-8756297fc494/a73baf94-6acc-558d-9e97-8756297fc494_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2791297,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2217/20492217/interior_rear_seats-1774720777825.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73baf94-6acc-558d-9e97-8756297fc494/a73baf94-6acc-558d-9e97-8756297fc494_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3421271,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2217/20492217/interior_dashboard-1774720822006.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73baf94-6acc-558d-9e97-8756297fc494/a73baf94-6acc-558d-9e97-8756297fc494_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2455772,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2217/20492217/instrument_cluster-1774720843541.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73baf94-6acc-558d-9e97-8756297fc494/a73baf94-6acc-558d-9e97-8756297fc494_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4250361,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2217/20492217/interior_boot-1774720891112.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a73baf94-6acc-558d-9e97-8756297fc494/a73baf94-6acc-558d-9e97-8756297fc494_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7486078,
'Height': 4284,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2217/20492217/docs_service_history-1774722606693.jpg?ixlib=js-3.8.0&auto=format&s=baf90942c3760e69a3aeaefdd4068fe4',
'Width': 5712}],
'price': 9936,
'price_includes_vat': False,
'registration_date': '2017-11-30',
'seats_number': None,
'seller_name': None,
'title': 'BMW 420I M Sport Auto',
'transmission': 'automatic',
'trim': '420I M Sport Auto',
'vin': 'WBA4S32070AC38142',
'year': 2017}
2026-03-29 20:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720492217%27 HTTP/1.1" 200 None
2026-03-29 20:20:06 [motorway.uk] INFO: Saving data for 20492217: {'created_time': 1774815606.358783, 'last_price_update_time': 1774815606.358794, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20492217') HTTP/1.1" 204 0
2026-03-29 20:20:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f401d3a3-52fd-5857-b14d-bebf6eda8275 with identifier: 19974522
2026-03-29 20:20:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f401d3a3-52fd-5857-b14d-bebf6eda8275 with identifier: 19974522
2026-03-29 20:20:06 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f401d3a3-52fd-5857-b14d-bebf6eda8275 with identifier: 19974522 to the API
2026-03-29 20:20:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/4522/19974522/interior_rear_seats-1774625802557.jpeg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'f401d3a3-52fd-5857-b14d-bebf6eda8275',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AV70 WRE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19974522',
'listing': 'auction',
'location': 'Leicestershire Leicester',
'make': 'Volkswagen',
'model': 'Golf',
'odometer': 82000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f401d3a3-52fd-5857-b14d-bebf6eda8275/f401d3a3-52fd-5857-b14d-bebf6eda8275_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7183473,
'Height': 5900,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4522/19974522/exterior_front_driver-1774626436781.jpeg',
'Width': 7866},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f401d3a3-52fd-5857-b14d-bebf6eda8275/f401d3a3-52fd-5857-b14d-bebf6eda8275_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7113283,
'Height': 5380,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4522/19974522/exterior_rear_driver-1774626476509.jpeg',
'Width': 7173},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f401d3a3-52fd-5857-b14d-bebf6eda8275/f401d3a3-52fd-5857-b14d-bebf6eda8275_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5218385,
'Height': 5036,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4522/19974522/exterior_front_passenger-1774626445607.jpeg',
'Width': 6714},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f401d3a3-52fd-5857-b14d-bebf6eda8275/f401d3a3-52fd-5857-b14d-bebf6eda8275_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5420166,
'Height': 4840,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4522/19974522/exterior_rear_passenger-1774626462946.jpeg',
'Width': 6453},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f401d3a3-52fd-5857-b14d-bebf6eda8275/f401d3a3-52fd-5857-b14d-bebf6eda8275_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 14061491,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/4522/19974522/interior_front_seats-1774626055885.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f401d3a3-52fd-5857-b14d-bebf6eda8275/f401d3a3-52fd-5857-b14d-bebf6eda8275_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 14576140,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/4522/19974522/interior_rear_seats-1774625802557.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f401d3a3-52fd-5857-b14d-bebf6eda8275/f401d3a3-52fd-5857-b14d-bebf6eda8275_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5650391,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4522/19974522/interior_dashboard-1774626131939.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f401d3a3-52fd-5857-b14d-bebf6eda8275/f401d3a3-52fd-5857-b14d-bebf6eda8275_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 9949823,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/4522/19974522/interior_boot-1774625733358.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f401d3a3-52fd-5857-b14d-bebf6eda8275/f401d3a3-52fd-5857-b14d-bebf6eda8275_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 222848,
'Height': 1908,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4522/19974522/docs_service_history-1774637162133.jpeg?ixlib=js-3.8.0&auto=format&s=84f5114cc91d241f283b00cd711d38c0',
'Width': 1290},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f401d3a3-52fd-5857-b14d-bebf6eda8275/f401d3a3-52fd-5857-b14d-bebf6eda8275_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 267357,
'Height': 2193,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4522/19974522/docs_service_history-1774637162131.jpeg?ixlib=js-3.8.0&auto=format&s=7780952bd3e4bf8c3163df18e9bf15e1',
'Width': 1290}],
'price': 11867,
'price_includes_vat': False,
'registration_date': '2020-11-30',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Golf R-LINE TSI',
'transmission': 'manual',
'trim': 'R-LINE TSI',
'vin': 'WVWZZZCDZMW044792',
'year': 2020}
2026-03-29 20:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719974522%27 HTTP/1.1" 200 None
2026-03-29 20:20:06 [motorway.uk] INFO: Saving data for 19974522: {'created_time': 1774815606.766784, 'last_price_update_time': 1774815606.766794, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19974522') HTTP/1.1" 204 0
2026-03-29 20:20:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 137c6281-088f-534c-a5d6-61577ca62f7f with identifier: 7888251
2026-03-29 20:20:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 137c6281-088f-534c-a5d6-61577ca62f7f with identifier: 7888251
2026-03-29 20:20:06 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 137c6281-088f-534c-a5d6-61577ca62f7f with identifier: 7888251 to the API
2026-03-29 20:20:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/8251/7888251/interior_front_seats-1774700112069.jpeg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '137c6281-088f-534c-a5d6-61577ca62f7f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FH22 CXX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/7888251',
'listing': 'auction',
'location': 'Leicestershire Lutterworth',
'make': 'Nissan',
'model': 'Juke',
'odometer': 26000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c6281-088f-534c-a5d6-61577ca62f7f/137c6281-088f-534c-a5d6-61577ca62f7f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1902469,
'Height': 2783,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8251/7888251/exterior_front_driver-1774699940540.jpeg',
'Width': 3710},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c6281-088f-534c-a5d6-61577ca62f7f/137c6281-088f-534c-a5d6-61577ca62f7f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2329099,
'Height': 2971,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8251/7888251/exterior_rear_driver-1774700023777.jpeg',
'Width': 3961},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c6281-088f-534c-a5d6-61577ca62f7f/137c6281-088f-534c-a5d6-61577ca62f7f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2273340,
'Height': 2896,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8251/7888251/exterior_front_passenger-1774699965420.jpeg',
'Width': 3861},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c6281-088f-534c-a5d6-61577ca62f7f/137c6281-088f-534c-a5d6-61577ca62f7f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2488727,
'Height': 2993,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8251/7888251/exterior_rear_passenger-1774700066350.jpeg',
'Width': 3990},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c6281-088f-534c-a5d6-61577ca62f7f/137c6281-088f-534c-a5d6-61577ca62f7f_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3283276,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8251/7888251/interior_front_seats-1774700112069.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c6281-088f-534c-a5d6-61577ca62f7f/137c6281-088f-534c-a5d6-61577ca62f7f_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2346019,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8251/7888251/interior_rear_seats-1774700268770.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c6281-088f-534c-a5d6-61577ca62f7f/137c6281-088f-534c-a5d6-61577ca62f7f_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3580950,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8251/7888251/interior_dashboard-1774700323394.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c6281-088f-534c-a5d6-61577ca62f7f/137c6281-088f-534c-a5d6-61577ca62f7f_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2721692,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8251/7888251/instrument_cluster-1774700352272.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c6281-088f-534c-a5d6-61577ca62f7f/137c6281-088f-534c-a5d6-61577ca62f7f_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4392762,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8251/7888251/interior_boot-1774700340774.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_137c6281-088f-534c-a5d6-61577ca62f7f/137c6281-088f-534c-a5d6-61577ca62f7f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2045581,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8251/7888251/docs_service_history-1774701757610.jpeg?ixlib=js-3.8.0&auto=format&s=eef5f26a1bf11740d5691c21607251ed',
'Width': 4032}],
'price': 12850,
'price_includes_vat': False,
'registration_date': '2022-08-01',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Juke Tekna + DiG-T',
'transmission': 'manual',
'trim': 'Tekna + DiG-T',
'vin': 'SJNFAAF16U1185470',
'year': 2022}
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277888251%27 HTTP/1.1" 200 None
2026-03-29 20:20:07 [motorway.uk] INFO: Saving data for 7888251: {'created_time': 1774815607.152756, 'last_price_update_time': 1774815607.152767, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='7888251') HTTP/1.1" 204 0
2026-03-29 20:20:07 [scrapy.extensions.logstats] INFO: Crawled 335 pages (at 27 pages/min), scraped 184 items (at 24 items/min)
2026-03-29 20:20:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 304MiB
2026-03-29 20:20:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4722/20474722/interior_rear_seats-1774627811890.jpg> (referer: None)
2026-03-29 20:20:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4722/20474722/interior_front_seats-1774627846408.jpg> (referer: None)
2026-03-29 20:20:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4722/20474722/instrument_cluster-1774707811425.jpg> (referer: None)
2026-03-29 20:20:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4722/20474722/exterior_rear_passenger-1774627386970.jpg> (referer: None)
2026-03-29 20:20:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4722/20474722/interior_dashboard-1774627884986.jpg> (referer: None)
2026-03-29 20:20:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589f35d0>
2026-03-29 20:20:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb301e21-5170-5094-8a2d-bf95bdd3f919/bb301e21-5170-5094-8a2d-bf95bdd3f919_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4722%252F20474722%252Finterior_rear_seats-1774627811890.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4722/20474722/interior_rear_seats-1774627811890.jpg saved to cache
2026-03-29 20:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bb301e21-5170-5094-8a2d-bf95bdd3f919
2026-03-29 20:20:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cac3d0>
2026-03-29 20:20:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb301e21-5170-5094-8a2d-bf95bdd3f919/bb301e21-5170-5094-8a2d-bf95bdd3f919_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4722%252F20474722%252Finterior_front_seats-1774627846408.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4722/20474722/interior_front_seats-1774627846408.jpg saved to cache
2026-03-29 20:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb301e21-5170-5094-8a2d-bf95bdd3f919
2026-03-29 20:20:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20114932.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658380490>
2026-03-29 20:20:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb301e21-5170-5094-8a2d-bf95bdd3f919/bb301e21-5170-5094-8a2d-bf95bdd3f919_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4722%252F20474722%252Finstrument_cluster-1774707811425.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4722/20474722/instrument_cluster-1774707811425.jpg saved to cache
2026-03-29 20:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bb301e21-5170-5094-8a2d-bf95bdd3f919
2026-03-29 20:20:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65843ae10>
2026-03-29 20:20:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb301e21-5170-5094-8a2d-bf95bdd3f919/bb301e21-5170-5094-8a2d-bf95bdd3f919_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4722%252F20474722%252Fexterior_rear_passenger-1774627386970.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4722/20474722/exterior_rear_passenger-1774627386970.jpg saved to cache
2026-03-29 20:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bb301e21-5170-5094-8a2d-bf95bdd3f919
2026-03-29 20:20:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65882c350>
2026-03-29 20:20:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb301e21-5170-5094-8a2d-bf95bdd3f919/bb301e21-5170-5094-8a2d-bf95bdd3f919_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4722%252F20474722%252Finterior_dashboard-1774627884986.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4722/20474722/interior_dashboard-1774627884986.jpg saved to cache
2026-03-29 20:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bb301e21-5170-5094-8a2d-bf95bdd3f919
2026-03-29 20:20:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4722/20474722/exterior_front_driver-1774625596670.jpg> (referer: None)
2026-03-29 20:20:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a77c4894-ac51-5a6a-8400-e63dc6eebf13 with identifier: 20114932
2026-03-29 20:20:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a77c4894-ac51-5a6a-8400-e63dc6eebf13 with scrape type 1
2026-03-29 20:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a77c4894-ac51-5a6a-8400-e63dc6eebf13
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4932%252F20114932%252Fexterior_front_driver-1772707093208.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4932/20114932/exterior_front_driver-1772707093208.jpg already downloaded
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4932%252F20114932%252Fexterior_rear_driver-1772707071086.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4932/20114932/exterior_rear_driver-1772707071086.jpg already downloaded
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4932%252F20114932%252Fexterior_front_passenger-1772707086280.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4932/20114932/exterior_front_passenger-1772707086280.jpg already downloaded
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4932%252F20114932%252Fexterior_rear_passenger-1772707078485.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4932/20114932/exterior_rear_passenger-1772707078485.jpg already downloaded
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4932%252F20114932%252Finterior_front_seats-1772709569662.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4932/20114932/interior_front_seats-1772709569662.jpg already downloaded
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4932%252F20114932%252Finterior_rear_seats-1772709576221.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4932/20114932/interior_rear_seats-1772709576221.jpg already downloaded
2026-03-29 20:20:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4932%252F20114932%252Finterior_dashboard-1772709586587.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4932/20114932/interior_dashboard-1772709586587.jpg already downloaded
2026-03-29 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4932%252F20114932%252Finterior_boot-1772709628390.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4932/20114932/interior_boot-1772709628390.jpg already downloaded
2026-03-29 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4932%252F20114932%252Fdocs_service_history-1772709681125.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D604a3907b1b9677838aae8dbe262c274%27 HTTP/1.1" 200 None
2026-03-29 20:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4932/20114932/docs_service_history-1772709681125.jpg?ixlib=js-3.8.0&auto=format&s=604a3907b1b9677838aae8dbe262c274 already downloaded
2026-03-29 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F4932%252F20114932%252Fdocs_service_history-1772709654081.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7acb6198cea19697eb8a39cdcbd4f0f7%27 HTTP/1.1" 200 None
2026-03-29 20:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/4932/20114932/docs_service_history-1772709654081.jpg?ixlib=js-3.8.0&auto=format&s=7acb6198cea19697eb8a39cdcbd4f0f7 already downloaded
2026-03-29 20:20:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a77c4894-ac51-5a6a-8400-e63dc6eebf13, identifier: 20114932
2026-03-29 20:20:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a77c4894-ac51-5a6a-8400-e63dc6eebf13 with identifier: 20114932
2026-03-29 20:20:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a77c4894-ac51-5a6a-8400-e63dc6eebf13 with identifier: 20114932
2026-03-29 20:20:08 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a77c4894-ac51-5a6a-8400-e63dc6eebf13 with identifier: 20114932 to the API
2026-03-29 20:20:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20114932.json>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'a77c4894-ac51-5a6a-8400-e63dc6eebf13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SC22 TVJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20114932',
'listing': 'auction',
'location': 'West Lothian Kirkliston',
'make': 'MG',
'model': 'ZS',
'odometer': 28000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/4932/20114932/exterior_front_driver-1772707093208.jpg',
'https://motorway-photos-redacted.imgix.net/4932/20114932/exterior_rear_driver-1772707071086.jpg',
'https://motorway-photos-redacted.imgix.net/4932/20114932/exterior_front_passenger-1772707086280.jpg',
'https://motorway-photos-redacted.imgix.net/4932/20114932/exterior_rear_passenger-1772707078485.jpg',
'https://motorway-photos-modified.imgix.net/4932/20114932/interior_front_seats-1772709569662.jpg',
'https://motorway-photos-modified.imgix.net/4932/20114932/interior_rear_seats-1772709576221.jpg',
'https://motorway-photos-modified.imgix.net/4932/20114932/interior_dashboard-1772709586587.jpg',
'https://motorway-photos-modified.imgix.net/4932/20114932/interior_boot-1772709628390.jpg',
'https://motorway-service-history-photos.imgix.net/modified/4932/20114932/docs_service_history-1772709681125.jpg?ixlib=js-3.8.0&auto=format&s=604a3907b1b9677838aae8dbe262c274',
'https://motorway-service-history-photos.imgix.net/modified/4932/20114932/docs_service_history-1772709654081.jpg?ixlib=js-3.8.0&auto=format&s=7acb6198cea19697eb8a39cdcbd4f0f7'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b280a937-4f6b-5da6-b612-7b607a55dc37/b280a937-4f6b-5da6-b612-7b607a55dc37_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 518629,
'Height': 1994,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4932/20114932/exterior_front_driver-1772707093208.jpg',
'Width': 2658},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b280a937-4f6b-5da6-b612-7b607a55dc37/b280a937-4f6b-5da6-b612-7b607a55dc37_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 775908,
'Height': 2076,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4932/20114932/exterior_rear_driver-1772707071086.jpg',
'Width': 2768},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b280a937-4f6b-5da6-b612-7b607a55dc37/b280a937-4f6b-5da6-b612-7b607a55dc37_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 829467,
'Height': 1926,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4932/20114932/exterior_front_passenger-1772707086280.jpg',
'Width': 2568},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b280a937-4f6b-5da6-b612-7b607a55dc37/b280a937-4f6b-5da6-b612-7b607a55dc37_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 830056,
'Height': 2005,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4932/20114932/exterior_rear_passenger-1772707078485.jpg',
'Width': 2673},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b280a937-4f6b-5da6-b612-7b607a55dc37/b280a937-4f6b-5da6-b612-7b607a55dc37_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 938999,
'Height': 2180,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4932/20114932/interior_front_seats-1772709569662.jpg',
'Width': 2906},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b280a937-4f6b-5da6-b612-7b607a55dc37/b280a937-4f6b-5da6-b612-7b607a55dc37_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 765524,
'Height': 2201,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4932/20114932/interior_rear_seats-1772709576221.jpg',
'Width': 2935},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b280a937-4f6b-5da6-b612-7b607a55dc37/b280a937-4f6b-5da6-b612-7b607a55dc37_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1098290,
'Height': 2191,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4932/20114932/interior_dashboard-1772709586587.jpg',
'Width': 2921},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b280a937-4f6b-5da6-b612-7b607a55dc37/b280a937-4f6b-5da6-b612-7b607a55dc37_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 539214,
'Height': 1499,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4932/20114932/interior_boot-1772709628390.jpg',
'Width': 1999},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b280a937-4f6b-5da6-b612-7b607a55dc37/b280a937-4f6b-5da6-b612-7b607a55dc37_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1623470,
'Height': 2780,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/4932/20114932/docs_service_history-1772709681125.jpg?ixlib=js-3.8.0&auto=format&s=604a3907b1b9677838aae8dbe262c274',
'Width': 3707},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b280a937-4f6b-5da6-b612-7b607a55dc37/b280a937-4f6b-5da6-b612-7b607a55dc37_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1591403,
'Height': 4000,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/4932/20114932/docs_service_history-1772709654081.jpg?ixlib=js-3.8.0&auto=format&s=7acb6198cea19697eb8a39cdcbd4f0f7',
'Width': 3000}],
'price': 10741,
'price_includes_vat': False,
'registration_date': '2022-03-31',
'seats_number': None,
'seller_name': None,
'title': 'MG ZS Exclusive VTI-TECH',
'transmission': 'manual',
'trim': 'Exclusive VTI-TECH',
'vin': 'LSJW74U98MZ247479',
'year': 2022}
2026-03-29 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720114932%27 HTTP/1.1" 200 None
2026-03-29 20:20:08 [motorway.uk] INFO: Saving data for 20114932: {'created_time': 1774815608.579906, 'last_price_update_time': 1774815608.579917, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20114932') HTTP/1.1" 204 0
2026-03-29 20:20:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658550dd0>
2026-03-29 20:20:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb301e21-5170-5094-8a2d-bf95bdd3f919/bb301e21-5170-5094-8a2d-bf95bdd3f919_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4722%252F20474722%252Fexterior_front_driver-1774625596670.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4722/20474722/exterior_front_driver-1774625596670.jpg saved to cache
2026-03-29 20:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb301e21-5170-5094-8a2d-bf95bdd3f919
2026-03-29 20:20:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4722/20474722/exterior_front_passenger-1774627385385.jpg> (referer: None)
2026-03-29 20:20:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4722/20474722/exterior_rear_driver-1774627383657.jpg> (referer: None)
2026-03-29 20:20:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5412/20485412/interior_dashboard-1774697090002.jpg> (referer: None)
2026-03-29 20:20:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5412/20485412/interior_rear_seats-1774696126285.jpg> (referer: None)
2026-03-29 20:20:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d0a6d0>
2026-03-29 20:20:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb301e21-5170-5094-8a2d-bf95bdd3f919/bb301e21-5170-5094-8a2d-bf95bdd3f919_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4722%252F20474722%252Fexterior_front_passenger-1774627385385.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4722/20474722/exterior_front_passenger-1774627385385.jpg saved to cache
2026-03-29 20:20:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb301e21-5170-5094-8a2d-bf95bdd3f919
2026-03-29 20:20:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf00d90>
2026-03-29 20:20:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb301e21-5170-5094-8a2d-bf95bdd3f919/bb301e21-5170-5094-8a2d-bf95bdd3f919_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4722%252F20474722%252Fexterior_rear_driver-1774627383657.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4722/20474722/exterior_rear_driver-1774627383657.jpg saved to cache
2026-03-29 20:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bb301e21-5170-5094-8a2d-bf95bdd3f919
2026-03-29 20:20:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb301e21-5170-5094-8a2d-bf95bdd3f919, skipping ID generation
2026-03-29 20:20:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb301e21-5170-5094-8a2d-bf95bdd3f919 with scrape type 1
2026-03-29 20:20:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb301e21-5170-5094-8a2d-bf95bdd3f919 sending to next pipeline
2026-03-29 20:20:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: bb301e21-5170-5094-8a2d-bf95bdd3f919, identifier: 20474722
2026-03-29 20:20:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d7ef10>
2026-03-29 20:20:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f72adb02-1a63-5603-8014-b93d7ada819f/f72adb02-1a63-5603-8014-b93d7ada819f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5412%252F20485412%252Finterior_dashboard-1774697090002.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5412/20485412/interior_dashboard-1774697090002.jpg saved to cache
2026-03-29 20:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f72adb02-1a63-5603-8014-b93d7ada819f
2026-03-29 20:20:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582e5c90>
2026-03-29 20:20:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f72adb02-1a63-5603-8014-b93d7ada819f/f72adb02-1a63-5603-8014-b93d7ada819f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5412%252F20485412%252Finterior_rear_seats-1774696126285.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5412/20485412/interior_rear_seats-1774696126285.jpg saved to cache
2026-03-29 20:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f72adb02-1a63-5603-8014-b93d7ada819f
2026-03-29 20:20:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: bb301e21-5170-5094-8a2d-bf95bdd3f919 with identifier: 20474722
2026-03-29 20:20:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: bb301e21-5170-5094-8a2d-bf95bdd3f919 with identifier: 20474722
2026-03-29 20:20:09 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: bb301e21-5170-5094-8a2d-bf95bdd3f919 with identifier: 20474722 to the API
2026-03-29 20:20:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4722/20474722/exterior_rear_driver-1774627383657.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'bb301e21-5170-5094-8a2d-bf95bdd3f919',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'SE23 UXR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20474722',
'listing': 'auction',
'location': 'Argyll and Bute Helensburgh',
'make': 'Cupra',
'model': 'Formentor',
'odometer': 52506,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb301e21-5170-5094-8a2d-bf95bdd3f919/bb301e21-5170-5094-8a2d-bf95bdd3f919_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1157814,
'Height': 2076,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4722/20474722/exterior_front_driver-1774625596670.jpg',
'Width': 2768},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb301e21-5170-5094-8a2d-bf95bdd3f919/bb301e21-5170-5094-8a2d-bf95bdd3f919_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1448678,
'Height': 2464,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4722/20474722/exterior_rear_driver-1774627383657.jpg',
'Width': 3285},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb301e21-5170-5094-8a2d-bf95bdd3f919/bb301e21-5170-5094-8a2d-bf95bdd3f919_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1083994,
'Height': 2213,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4722/20474722/exterior_front_passenger-1774627385385.jpg',
'Width': 2951},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb301e21-5170-5094-8a2d-bf95bdd3f919/bb301e21-5170-5094-8a2d-bf95bdd3f919_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1125557,
'Height': 2428,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4722/20474722/exterior_rear_passenger-1774627386970.jpg',
'Width': 3237},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb301e21-5170-5094-8a2d-bf95bdd3f919/bb301e21-5170-5094-8a2d-bf95bdd3f919_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1594778,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4722/20474722/interior_front_seats-1774627846408.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb301e21-5170-5094-8a2d-bf95bdd3f919/bb301e21-5170-5094-8a2d-bf95bdd3f919_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1628366,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4722/20474722/interior_rear_seats-1774627811890.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb301e21-5170-5094-8a2d-bf95bdd3f919/bb301e21-5170-5094-8a2d-bf95bdd3f919_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1241866,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4722/20474722/interior_dashboard-1774627884986.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb301e21-5170-5094-8a2d-bf95bdd3f919/bb301e21-5170-5094-8a2d-bf95bdd3f919_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422663,
'Height': 1396,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4722/20474722/instrument_cluster-1774707811425.jpg',
'Width': 1862},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb301e21-5170-5094-8a2d-bf95bdd3f919/bb301e21-5170-5094-8a2d-bf95bdd3f919_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1612288,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4722/20474722/interior_boot-1774627815768.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb301e21-5170-5094-8a2d-bf95bdd3f919/bb301e21-5170-5094-8a2d-bf95bdd3f919_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1791939,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4722/20474722/docs_service_history-1774628110972.jpg?ixlib=js-3.8.0&auto=format&s=fff8ee1e9676fcb6aebadaeb03d1e34c',
'Width': 2880}],
'price': 17764,
'price_includes_vat': False,
'registration_date': '2023-06-30',
'seats_number': None,
'seller_name': None,
'title': 'Cupra Formentor V2 TSI S-A',
'transmission': 'automatic',
'trim': 'V2 TSI S-A',
'vin': 'VSSZZZKM9PR071249',
'year': 2023}
2026-03-29 20:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720474722%27 HTTP/1.1" 200 None
2026-03-29 20:20:09 [motorway.uk] INFO: Saving data for 20474722: {'created_time': 1774815609.712795, 'last_price_update_time': 1774815609.712806, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20474722') HTTP/1.1" 204 0
2026-03-29 20:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5412/20485412/exterior_rear_driver-1774695017464.jpg> (referer: None)
2026-03-29 20:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5412/20485412/exterior_front_passenger-1774697101182.jpg> (referer: None)
2026-03-29 20:20:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5412/20485412/interior_front_seats-1774695789280.jpg> (referer: None)
2026-03-29 20:20:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599baf90>
2026-03-29 20:20:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f72adb02-1a63-5603-8014-b93d7ada819f/f72adb02-1a63-5603-8014-b93d7ada819f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5412%252F20485412%252Fexterior_rear_driver-1774695017464.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5412/20485412/exterior_rear_driver-1774695017464.jpg saved to cache
2026-03-29 20:20:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f72adb02-1a63-5603-8014-b93d7ada819f
2026-03-29 20:20:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582dde10>
2026-03-29 20:20:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f72adb02-1a63-5603-8014-b93d7ada819f/f72adb02-1a63-5603-8014-b93d7ada819f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5412%252F20485412%252Fexterior_front_passenger-1774697101182.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5412/20485412/exterior_front_passenger-1774697101182.jpg saved to cache
2026-03-29 20:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f72adb02-1a63-5603-8014-b93d7ada819f
2026-03-29 20:20:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658550f10>
2026-03-29 20:20:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f72adb02-1a63-5603-8014-b93d7ada819f/f72adb02-1a63-5603-8014-b93d7ada819f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5412%252F20485412%252Finterior_front_seats-1774695789280.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5412/20485412/interior_front_seats-1774695789280.jpg saved to cache
2026-03-29 20:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f72adb02-1a63-5603-8014-b93d7ada819f
2026-03-29 20:20:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5412/20485412/exterior_front_driver-1774695015244.jpg> (referer: None)
2026-03-29 20:20:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9183/19449183/exterior_front_driver-1774626161980.jpg> (referer: None)
2026-03-29 20:20:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9183/19449183/exterior_rear_driver-1774370167472.jpg> (referer: None)
2026-03-29 20:20:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65846c6d0>
2026-03-29 20:20:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f72adb02-1a63-5603-8014-b93d7ada819f/f72adb02-1a63-5603-8014-b93d7ada819f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5412%252F20485412%252Fexterior_front_driver-1774695015244.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5412/20485412/exterior_front_driver-1774695015244.jpg saved to cache
2026-03-29 20:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f72adb02-1a63-5603-8014-b93d7ada819f
2026-03-29 20:20:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f72adb02-1a63-5603-8014-b93d7ada819f, skipping ID generation
2026-03-29 20:20:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f72adb02-1a63-5603-8014-b93d7ada819f with scrape type 1
2026-03-29 20:20:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f72adb02-1a63-5603-8014-b93d7ada819f sending to next pipeline
2026-03-29 20:20:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f72adb02-1a63-5603-8014-b93d7ada819f, identifier: 20485412
2026-03-29 20:20:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f72adb02-1a63-5603-8014-b93d7ada819f with identifier: 20485412
2026-03-29 20:20:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f72adb02-1a63-5603-8014-b93d7ada819f with identifier: 20485412
2026-03-29 20:20:10 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f72adb02-1a63-5603-8014-b93d7ada819f with identifier: 20485412 to the API
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/5412/20485412/exterior_front_driver-1774695015244.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'f72adb02-1a63-5603-8014-b93d7ada819f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LT13 VKN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20485412',
'listing': 'auction',
'location': 'Hertfordshire Hemel Hempstead',
'make': 'Vauxhall',
'model': 'Astra',
'odometer': 71324,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f72adb02-1a63-5603-8014-b93d7ada819f/f72adb02-1a63-5603-8014-b93d7ada819f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1261279,
'Height': 2476,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5412/20485412/exterior_front_driver-1774695015244.jpg',
'Width': 3301},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f72adb02-1a63-5603-8014-b93d7ada819f/f72adb02-1a63-5603-8014-b93d7ada819f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1080087,
'Height': 2408,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5412/20485412/exterior_rear_driver-1774695017464.jpg',
'Width': 3211},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f72adb02-1a63-5603-8014-b93d7ada819f/f72adb02-1a63-5603-8014-b93d7ada819f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2004899,
'Height': 2652,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5412/20485412/exterior_front_passenger-1774697101182.jpg',
'Width': 3536},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f72adb02-1a63-5603-8014-b93d7ada819f/f72adb02-1a63-5603-8014-b93d7ada819f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1385416,
'Height': 2388,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5412/20485412/exterior_rear_passenger-1774695013428.jpg',
'Width': 3184},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f72adb02-1a63-5603-8014-b93d7ada819f/f72adb02-1a63-5603-8014-b93d7ada819f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2170955,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5412/20485412/interior_front_seats-1774695789280.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f72adb02-1a63-5603-8014-b93d7ada819f/f72adb02-1a63-5603-8014-b93d7ada819f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2305292,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5412/20485412/interior_rear_seats-1774696126285.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f72adb02-1a63-5603-8014-b93d7ada819f/f72adb02-1a63-5603-8014-b93d7ada819f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2195848,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5412/20485412/interior_dashboard-1774697090002.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f72adb02-1a63-5603-8014-b93d7ada819f/f72adb02-1a63-5603-8014-b93d7ada819f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1994128,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5412/20485412/instrument_cluster-1774695804531.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f72adb02-1a63-5603-8014-b93d7ada819f/f72adb02-1a63-5603-8014-b93d7ada819f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1848036,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/5412/20485412/interior_boot-1774695785898.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f72adb02-1a63-5603-8014-b93d7ada819f/f72adb02-1a63-5603-8014-b93d7ada819f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1903938,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/5412/20485412/docs_service_history-1774696444073.jpg?ixlib=js-3.8.0&auto=format&s=71d07c9da95aa95b22984c97ae5abdd1',
'Width': 3840}],
'price': 1610,
'price_includes_vat': False,
'registration_date': '2013-03-29',
'seats_number': None,
'seller_name': None,
'title': 'Vauxhall Astra Energy',
'transmission': 'manual',
'trim': 'Energy',
'vin': 'W0LPC6EB3DG058165',
'year': 2013}
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720485412%27 HTTP/1.1" 200 None
2026-03-29 20:20:10 [motorway.uk] INFO: Saving data for 20485412: {'created_time': 1774815610.903154, 'last_price_update_time': 1774815610.903168, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20485412') HTTP/1.1" 204 0
2026-03-29 20:20:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658474bd0>
2026-03-29 20:20:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165fab30-47b2-5c74-ad11-21e7d0eabbd4/165fab30-47b2-5c74-ad11-21e7d0eabbd4_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9183%252F19449183%252Fexterior_front_driver-1774626161980.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9183/19449183/exterior_front_driver-1774626161980.jpg saved to cache
2026-03-29 20:20:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 165fab30-47b2-5c74-ad11-21e7d0eabbd4
2026-03-29 20:20:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c38710>
2026-03-29 20:20:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165fab30-47b2-5c74-ad11-21e7d0eabbd4/165fab30-47b2-5c74-ad11-21e7d0eabbd4_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9183%252F19449183%252Fexterior_rear_driver-1774370167472.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9183/19449183/exterior_rear_driver-1774370167472.jpg saved to cache
2026-03-29 20:20:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 165fab30-47b2-5c74-ad11-21e7d0eabbd4
2026-03-29 20:20:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 165fab30-47b2-5c74-ad11-21e7d0eabbd4, skipping ID generation
2026-03-29 20:20:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 165fab30-47b2-5c74-ad11-21e7d0eabbd4 with scrape type 1
2026-03-29 20:20:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 165fab30-47b2-5c74-ad11-21e7d0eabbd4 sending to next pipeline
2026-03-29 20:20:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 165fab30-47b2-5c74-ad11-21e7d0eabbd4, identifier: 19449183
2026-03-29 20:20:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4385/16034385/exterior_front_driver-1773854638031.jpeg> (referer: None)
2026-03-29 20:20:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 165fab30-47b2-5c74-ad11-21e7d0eabbd4 with identifier: 19449183
2026-03-29 20:20:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 165fab30-47b2-5c74-ad11-21e7d0eabbd4 with identifier: 19449183
2026-03-29 20:20:11 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 165fab30-47b2-5c74-ad11-21e7d0eabbd4 with identifier: 19449183 to the API
2026-03-29 20:20:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9183/19449183/exterior_rear_driver-1774370167472.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '165fab30-47b2-5c74-ad11-21e7d0eabbd4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'BW17 YLT',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19449183',
'listing': 'auction',
'location': 'Norfolk Norwich',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 29248,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165fab30-47b2-5c74-ad11-21e7d0eabbd4/165fab30-47b2-5c74-ad11-21e7d0eabbd4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1013415,
'Height': 2280,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9183/19449183/exterior_front_driver-1774626161980.jpg',
'Width': 3040},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165fab30-47b2-5c74-ad11-21e7d0eabbd4/165fab30-47b2-5c74-ad11-21e7d0eabbd4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 766717,
'Height': 2182,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9183/19449183/exterior_rear_driver-1774370167472.jpg',
'Width': 2909},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165fab30-47b2-5c74-ad11-21e7d0eabbd4/165fab30-47b2-5c74-ad11-21e7d0eabbd4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1090294,
'Height': 2693,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9183/19449183/exterior_front_passenger-1774370169891.jpg',
'Width': 3591},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165fab30-47b2-5c74-ad11-21e7d0eabbd4/165fab30-47b2-5c74-ad11-21e7d0eabbd4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 650997,
'Height': 2082,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9183/19449183/exterior_rear_passenger-1774370165314.jpg',
'Width': 2776},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165fab30-47b2-5c74-ad11-21e7d0eabbd4/165fab30-47b2-5c74-ad11-21e7d0eabbd4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1539375,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9183/19449183/interior_front_seats-1774626022018.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165fab30-47b2-5c74-ad11-21e7d0eabbd4/165fab30-47b2-5c74-ad11-21e7d0eabbd4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1702378,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9183/19449183/interior_rear_seats-1774697024243.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165fab30-47b2-5c74-ad11-21e7d0eabbd4/165fab30-47b2-5c74-ad11-21e7d0eabbd4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1314211,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9183/19449183/interior_dashboard-1774626078427.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165fab30-47b2-5c74-ad11-21e7d0eabbd4/165fab30-47b2-5c74-ad11-21e7d0eabbd4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1663338,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9183/19449183/instrument_cluster-1774626061193.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165fab30-47b2-5c74-ad11-21e7d0eabbd4/165fab30-47b2-5c74-ad11-21e7d0eabbd4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1468204,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9183/19449183/interior_boot-1774626027216.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165fab30-47b2-5c74-ad11-21e7d0eabbd4/165fab30-47b2-5c74-ad11-21e7d0eabbd4_image_9.png',
'Extension': 'png',
'FileSizeInBytes': 96586,
'Height': 541,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9183/19449183/docs_service_history-1774627773936.png?ixlib=js-3.8.0&auto=format&s=bd57c4b1c366e0f21493e6bf7172e4c8',
'Width': 606}],
'price': 7006,
'price_includes_vat': False,
'registration_date': '2017-07-19',
'seats_number': None,
'seller_name': None,
'title': 'Ford Fiesta Titanium Turbo',
'transmission': 'manual',
'trim': 'Titanium Turbo',
'vin': 'WF0JXXGAHJHR57305',
'year': 2017}
2026-03-29 20:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719449183%27 HTTP/1.1" 200 None
2026-03-29 20:20:11 [motorway.uk] INFO: Saving data for 19449183: {'created_time': 1774815611.70461, 'last_price_update_time': 1774815611.704623, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19449183') HTTP/1.1" 204 0
2026-03-29 20:20:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20452858.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:20:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ce6090>
2026-03-29 20:20:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d77a75bd-e97f-55ca-8b54-62055524640d/d77a75bd-e97f-55ca-8b54-62055524640d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4385%252F16034385%252Fexterior_front_driver-1773854638031.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4385/16034385/exterior_front_driver-1773854638031.jpeg saved to cache
2026-03-29 20:20:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d77a75bd-e97f-55ca-8b54-62055524640d
2026-03-29 20:20:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d77a75bd-e97f-55ca-8b54-62055524640d, skipping ID generation
2026-03-29 20:20:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d77a75bd-e97f-55ca-8b54-62055524640d with scrape type 1
2026-03-29 20:20:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d77a75bd-e97f-55ca-8b54-62055524640d sending to next pipeline
2026-03-29 20:20:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d77a75bd-e97f-55ca-8b54-62055524640d, identifier: 16034385
2026-03-29 20:20:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d77a75bd-e97f-55ca-8b54-62055524640d with identifier: 16034385
2026-03-29 20:20:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d77a75bd-e97f-55ca-8b54-62055524640d with identifier: 16034385
2026-03-29 20:20:11 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d77a75bd-e97f-55ca-8b54-62055524640d with identifier: 16034385 to the API
2026-03-29 20:20:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4385/16034385/exterior_front_driver-1773854638031.jpeg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.8L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'd77a75bd-e97f-55ca-8b54-62055524640d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WO65 HVD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/16034385',
'listing': 'auction',
'location': 'Greater London Twickenham',
'make': 'Toyota',
'model': 'Verso',
'odometer': 74450,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 52,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d77a75bd-e97f-55ca-8b54-62055524640d/d77a75bd-e97f-55ca-8b54-62055524640d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1229194,
'Height': 2486,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4385/16034385/exterior_front_driver-1773854638031.jpeg',
'Width': 3314},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d77a75bd-e97f-55ca-8b54-62055524640d/d77a75bd-e97f-55ca-8b54-62055524640d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1130459,
'Height': 2222,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4385/16034385/exterior_rear_driver-1773854689441.jpeg',
'Width': 2963},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d77a75bd-e97f-55ca-8b54-62055524640d/d77a75bd-e97f-55ca-8b54-62055524640d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2064923,
'Height': 2838,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4385/16034385/exterior_front_passenger-1773854646771.jpeg',
'Width': 3784},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d77a75bd-e97f-55ca-8b54-62055524640d/d77a75bd-e97f-55ca-8b54-62055524640d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1283021,
'Height': 2336,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4385/16034385/exterior_rear_passenger-1773854678534.jpeg',
'Width': 3114},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d77a75bd-e97f-55ca-8b54-62055524640d/d77a75bd-e97f-55ca-8b54-62055524640d_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3955841,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4385/16034385/interior_front_seats-1773850590078.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d77a75bd-e97f-55ca-8b54-62055524640d/d77a75bd-e97f-55ca-8b54-62055524640d_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3933898,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4385/16034385/interior_rear_seats-1773850830708.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d77a75bd-e97f-55ca-8b54-62055524640d/d77a75bd-e97f-55ca-8b54-62055524640d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1763795,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4385/16034385/interior_dashboard-1773850444279.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d77a75bd-e97f-55ca-8b54-62055524640d/d77a75bd-e97f-55ca-8b54-62055524640d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1342266,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4385/16034385/instrument_cluster-1773850472149.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d77a75bd-e97f-55ca-8b54-62055524640d/d77a75bd-e97f-55ca-8b54-62055524640d_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4061456,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4385/16034385/interior_boot-1773850726141.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d77a75bd-e97f-55ca-8b54-62055524640d/d77a75bd-e97f-55ca-8b54-62055524640d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 190312,
'Height': 1096,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/4385/16034385/16034385-docs_service_history-modified-1774535432155.jpeg?ixlib=js-3.8.0&auto=format&s=47215bf51e6975bcf461486e2cafb897',
'Width': 1461}],
'price': 6888,
'price_includes_vat': False,
'registration_date': '2016-02-13',
'seats_number': None,
'seller_name': None,
'title': 'Toyota Verso Trend Valvematic CVT',
'transmission': 'automatic',
'trim': 'Trend Valvematic CVT',
'vin': 'NMTDG26R70R084053',
'year': 2016}
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716034385%27 HTTP/1.1" 200 None
2026-03-29 20:20:12 [motorway.uk] INFO: Saving data for 16034385: {'created_time': 1774815612.250207, 'last_price_update_time': 1774815612.250217, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='16034385') HTTP/1.1" 204 0
2026-03-29 20:20:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18106884.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a652c8d-4559-51c0-895a-c0d6c4471029 with identifier: 20452858
2026-03-29 20:20:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a652c8d-4559-51c0-895a-c0d6c4471029 with scrape type 1
2026-03-29 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7a652c8d-4559-51c0-895a-c0d6c4471029
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2858%252F20452858%252Fexterior_front_driver-1774702861961.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2858/20452858/exterior_front_driver-1774702861961.jpg not downloaded yet
2026-03-29 20:20:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2858%252F20452858%252Fexterior_rear_driver-1774698880558.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2858/20452858/exterior_rear_driver-1774698880558.jpg not downloaded yet
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2858%252F20452858%252Fexterior_front_passenger-1774696572038.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2858/20452858/exterior_front_passenger-1774696572038.jpg not downloaded yet
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2858%252F20452858%252Fexterior_rear_passenger-1774698898487.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2858/20452858/exterior_rear_passenger-1774698898487.jpg not downloaded yet
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2858%252F20452858%252Finterior_front_seats-1774698814228.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2858/20452858/interior_front_seats-1774698814228.jpg not downloaded yet
2026-03-29 20:20:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 800044b2-37f9-58d3-98fd-2c55f8119112 with identifier: 18106884
2026-03-29 20:20:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 800044b2-37f9-58d3-98fd-2c55f8119112 with scrape type 1
2026-03-29 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 800044b2-37f9-58d3-98fd-2c55f8119112
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6884%252F18106884%252Fexterior_front_driver-1774696840347.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6884/18106884/exterior_front_driver-1774696840347.jpeg not downloaded yet
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2858%252F20452858%252Finterior_rear_seats-1774696857152.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2858/20452858/interior_rear_seats-1774696857152.jpg not downloaded yet
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6884%252F18106884%252Fexterior_rear_driver-1774696759692.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6884/18106884/exterior_rear_driver-1774696759692.jpeg not downloaded yet
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2858%252F20452858%252Finterior_dashboard-1774698780847.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2858/20452858/interior_dashboard-1774698780847.jpg not downloaded yet
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6884%252F18106884%252Fexterior_front_passenger-1774696811111.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6884/18106884/exterior_front_passenger-1774696811111.jpeg not downloaded yet
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2858%252F20452858%252Finterior_boot-1774696902318.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2858/20452858/interior_boot-1774696902318.jpg not downloaded yet
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6884%252F18106884%252Fexterior_rear_passenger-1774696752291.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6884/18106884/exterior_rear_passenger-1774696752291.jpeg not downloaded yet
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2858%252F20452858%252Fdocs_service_history-1774697113142.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D458bfb126ae01743d7989374d1e7364d%27 HTTP/1.1" 200 None
2026-03-29 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2858/20452858/docs_service_history-1774697113142.jpg?ixlib=js-3.8.0&auto=format&s=458bfb126ae01743d7989374d1e7364d not downloaded yet
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6884%252F18106884%252Finterior_front_seats-1774696879741.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6884/18106884/interior_front_seats-1774696879741.jpeg not downloaded yet
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2858%252F20452858%252Fdocs_service_history-1774697121688.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd206b109f75be2aecd35c44b69a20b1d%27 HTTP/1.1" 200 None
2026-03-29 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2858/20452858/docs_service_history-1774697121688.jpg?ixlib=js-3.8.0&auto=format&s=d206b109f75be2aecd35c44b69a20b1d not downloaded yet
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6884%252F18106884%252Finterior_rear_seats-1774696979950.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6884/18106884/interior_rear_seats-1774696979950.jpeg not downloaded yet
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6884%252F18106884%252Finterior_dashboard-1774697005167.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6884/18106884/interior_dashboard-1774697005167.jpeg not downloaded yet
2026-03-29 20:20:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1350/20441350/exterior_front_driver-1774713173245.jpg> (referer: None)
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6884%252F18106884%252F18106884-instrument_cluster-modified-1774698250338.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6884/18106884/18106884-instrument_cluster-modified-1774698250338.jpeg not downloaded yet
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6884%252F18106884%252Finterior_boot-1774697016449.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6884/18106884/interior_boot-1774697016449.jpeg not downloaded yet
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6884%252F18106884%252Fdocs_service_history-1774698020778.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db15d2bee04f8089f50dd36b1529c60e8%27 HTTP/1.1" 200 None
2026-03-29 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6884/18106884/docs_service_history-1774698020778.jpeg?ixlib=js-3.8.0&auto=format&s=b15d2bee04f8089f50dd36b1529c60e8 not downloaded yet
2026-03-29 20:20:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2858/20452858/exterior_front_driver-1774702861961.jpg> (referer: None)
2026-03-29 20:20:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2913/20482913/interior_rear_seats-1774703897473.jpg> (referer: None)
2026-03-29 20:20:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2913/20482913/interior_front_seats-1774703892147.jpg> (referer: None)
2026-03-29 20:20:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c5d450>
2026-03-29 20:20:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_152069bd-a3e6-5883-a516-a9dbc4d50fe9/152069bd-a3e6-5883-a516-a9dbc4d50fe9_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1350%252F20441350%252Fexterior_front_driver-1774713173245.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1350/20441350/exterior_front_driver-1774713173245.jpg saved to cache
2026-03-29 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 152069bd-a3e6-5883-a516-a9dbc4d50fe9
2026-03-29 20:20:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 152069bd-a3e6-5883-a516-a9dbc4d50fe9, skipping ID generation
2026-03-29 20:20:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 152069bd-a3e6-5883-a516-a9dbc4d50fe9 with scrape type 1
2026-03-29 20:20:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 152069bd-a3e6-5883-a516-a9dbc4d50fe9 sending to next pipeline
2026-03-29 20:20:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 152069bd-a3e6-5883-a516-a9dbc4d50fe9, identifier: 20441350
2026-03-29 20:20:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 152069bd-a3e6-5883-a516-a9dbc4d50fe9 with identifier: 20441350
2026-03-29 20:20:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 152069bd-a3e6-5883-a516-a9dbc4d50fe9 with identifier: 20441350
2026-03-29 20:20:13 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 152069bd-a3e6-5883-a516-a9dbc4d50fe9 with identifier: 20441350 to the API
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1350/20441350/exterior_front_driver-1774713173245.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '152069bd-a3e6-5883-a516-a9dbc4d50fe9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'SL69 XKV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20441350',
'listing': 'auction',
'location': 'Midlothian Dalkeith',
'make': 'Volkswagen',
'model': 'T-Cross',
'odometer': 50050,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_152069bd-a3e6-5883-a516-a9dbc4d50fe9/152069bd-a3e6-5883-a516-a9dbc4d50fe9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2225098,
'Height': 2581,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1350/20441350/exterior_front_driver-1774713173245.jpg',
'Width': 3441},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_152069bd-a3e6-5883-a516-a9dbc4d50fe9/152069bd-a3e6-5883-a516-a9dbc4d50fe9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1946490,
'Height': 2603,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1350/20441350/exterior_rear_driver-1774713202669.jpg',
'Width': 3471},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_152069bd-a3e6-5883-a516-a9dbc4d50fe9/152069bd-a3e6-5883-a516-a9dbc4d50fe9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1911540,
'Height': 2323,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1350/20441350/exterior_front_passenger-1774713428513.jpg',
'Width': 3097},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_152069bd-a3e6-5883-a516-a9dbc4d50fe9/152069bd-a3e6-5883-a516-a9dbc4d50fe9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2065125,
'Height': 2685,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1350/20441350/exterior_rear_passenger-1774713233552.jpg',
'Width': 3580},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_152069bd-a3e6-5883-a516-a9dbc4d50fe9/152069bd-a3e6-5883-a516-a9dbc4d50fe9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3247418,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1350/20441350/interior_front_seats-1774714032622.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_152069bd-a3e6-5883-a516-a9dbc4d50fe9/152069bd-a3e6-5883-a516-a9dbc4d50fe9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3743703,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1350/20441350/interior_rear_seats-1774714555204.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_152069bd-a3e6-5883-a516-a9dbc4d50fe9/152069bd-a3e6-5883-a516-a9dbc4d50fe9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1812084,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1350/20441350/interior_dashboard-1774714143400.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_152069bd-a3e6-5883-a516-a9dbc4d50fe9/152069bd-a3e6-5883-a516-a9dbc4d50fe9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2856493,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1350/20441350/instrument_cluster-1774714165436.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_152069bd-a3e6-5883-a516-a9dbc4d50fe9/152069bd-a3e6-5883-a516-a9dbc4d50fe9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5070488,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1350/20441350/interior_boot-1774714559528.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_152069bd-a3e6-5883-a516-a9dbc4d50fe9/152069bd-a3e6-5883-a516-a9dbc4d50fe9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 599340,
'Height': 2712,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1350/20441350/docs_service_history-1774715112146.jpg?ixlib=js-3.8.0&auto=format&s=475ae978abb466f7aafec5a3863cde07',
'Width': 1927}],
'price': 9783,
'price_includes_vat': False,
'registration_date': '2019-12-03',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen T-CROSS S TSI',
'transmission': 'manual',
'trim': 'T-CROSS S TSI',
'vin': 'WVGZZZC1ZLY024988',
'year': 2019}
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720441350%27 HTTP/1.1" 200 None
2026-03-29 20:20:13 [motorway.uk] INFO: Saving data for 20441350: {'created_time': 1774815613.357917, 'last_price_update_time': 1774815613.35793, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20441350') HTTP/1.1" 204 0
2026-03-29 20:20:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e13990>
2026-03-29 20:20:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a652c8d-4559-51c0-895a-c0d6c4471029/7a652c8d-4559-51c0-895a-c0d6c4471029_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2858%252F20452858%252Fexterior_front_driver-1774702861961.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2858/20452858/exterior_front_driver-1774702861961.jpg saved to cache
2026-03-29 20:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7a652c8d-4559-51c0-895a-c0d6c4471029
2026-03-29 20:20:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658da6950>
2026-03-29 20:20:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17eaf36e-8d20-5ec5-9698-9d9c9287651e/17eaf36e-8d20-5ec5-9698-9d9c9287651e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2913%252F20482913%252Finterior_rear_seats-1774703897473.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2913/20482913/interior_rear_seats-1774703897473.jpg saved to cache
2026-03-29 20:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 17eaf36e-8d20-5ec5-9698-9d9c9287651e
2026-03-29 20:20:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65885fd50>
2026-03-29 20:20:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17eaf36e-8d20-5ec5-9698-9d9c9287651e/17eaf36e-8d20-5ec5-9698-9d9c9287651e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2913%252F20482913%252Finterior_front_seats-1774703892147.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2913/20482913/interior_front_seats-1774703892147.jpg saved to cache
2026-03-29 20:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 17eaf36e-8d20-5ec5-9698-9d9c9287651e
2026-03-29 20:20:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18826766.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2913/20482913/exterior_rear_passenger-1774703292235.jpg> (referer: None)
2026-03-29 20:20:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6884/18106884/docs_service_history-1774698020778.jpeg?ixlib=js-3.8.0&auto=format&s=b15d2bee04f8089f50dd36b1529c60e8> (referer: None)
2026-03-29 20:20:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6884/18106884/interior_dashboard-1774697005167.jpeg> (referer: None)
2026-03-29 20:20:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d68dff7-33bc-56e2-872c-e91f74d0ab96 with identifier: 18826766
2026-03-29 20:20:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d68dff7-33bc-56e2-872c-e91f74d0ab96 with scrape type 1
2026-03-29 20:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3d68dff7-33bc-56e2-872c-e91f74d0ab96
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6766%252F18826766%252Fexterior_front_driver-1774637049501.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6766/18826766/exterior_front_driver-1774637049501.jpeg not downloaded yet
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6766%252F18826766%252Fexterior_rear_driver-1774636806424.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6766/18826766/exterior_rear_driver-1774636806424.jpeg not downloaded yet
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6766%252F18826766%252Fexterior_front_passenger-1774637077734.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6766/18826766/exterior_front_passenger-1774637077734.jpeg not downloaded yet
2026-03-29 20:20:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658da5910>
2026-03-29 20:20:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17eaf36e-8d20-5ec5-9698-9d9c9287651e/17eaf36e-8d20-5ec5-9698-9d9c9287651e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2913%252F20482913%252Fexterior_rear_passenger-1774703292235.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2913/20482913/exterior_rear_passenger-1774703292235.jpg saved to cache
2026-03-29 20:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 17eaf36e-8d20-5ec5-9698-9d9c9287651e
2026-03-29 20:20:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:20:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c25c90>
2026-03-29 20:20:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_800044b2-37f9-58d3-98fd-2c55f8119112/800044b2-37f9-58d3-98fd-2c55f8119112_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6884%252F18106884%252Fdocs_service_history-1774698020778.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db15d2bee04f8089f50dd36b1529c60e8') HTTP/1.1" 204 0
2026-03-29 20:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6884/18106884/docs_service_history-1774698020778.jpeg?ixlib=js-3.8.0&auto=format&s=b15d2bee04f8089f50dd36b1529c60e8 saved to cache
2026-03-29 20:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 800044b2-37f9-58d3-98fd-2c55f8119112
2026-03-29 20:20:14 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:20:14 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:20:14 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00*\xc3\xa8\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03!\xa3\x00*\xb9\xb6\x00\x00\x00\x00'
2026-03-29 20:20:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c25090>
2026-03-29 20:20:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_800044b2-37f9-58d3-98fd-2c55f8119112/800044b2-37f9-58d3-98fd-2c55f8119112_image_6.mpo HTTP/1.1" 201 0
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6884%252F18106884%252Finterior_dashboard-1774697005167.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6884/18106884/interior_dashboard-1774697005167.jpeg saved to cache
2026-03-29 20:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 800044b2-37f9-58d3-98fd-2c55f8119112
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6766%252F18826766%252Fexterior_rear_passenger-1774636809299.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6766/18826766/exterior_rear_passenger-1774636809299.jpeg not downloaded yet
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6766%252F18826766%252Finterior_front_seats-1774636535845.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6766/18826766/interior_front_seats-1774636535845.jpeg not downloaded yet
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6766%252F18826766%252Finterior_rear_seats-1774636144144.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6766/18826766/interior_rear_seats-1774636144144.jpeg not downloaded yet
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6766%252F18826766%252F18826766-interior_dashboard-modified-1774698416144.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6766/18826766/18826766-interior_dashboard-modified-1774698416144.jpeg not downloaded yet
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6766%252F18826766%252F18826766-instrument_cluster-modified-1774698430739.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6766/18826766/18826766-instrument_cluster-modified-1774698430739.jpeg not downloaded yet
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6766%252F18826766%252Finterior_boot-1774636042221.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6766/18826766/interior_boot-1774636042221.jpeg not downloaded yet
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6766%252F18826766%252Fdocs_service_history-1774639642075.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfa272ca6f40fae6f4164a92f50f047e4%27 HTTP/1.1" 200 None
2026-03-29 20:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6766/18826766/docs_service_history-1774639642075.jpeg?ixlib=js-3.8.0&auto=format&s=fa272ca6f40fae6f4164a92f50f047e4 not downloaded yet
2026-03-29 20:20:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2858/20452858/docs_service_history-1774697121688.jpg?ixlib=js-3.8.0&auto=format&s=d206b109f75be2aecd35c44b69a20b1d> (referer: None)
2026-03-29 20:20:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6884/18106884/18106884-instrument_cluster-modified-1774698250338.jpeg> (referer: None)
2026-03-29 20:20:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6884/18106884/interior_rear_seats-1774696979950.jpeg> (referer: None)
2026-03-29 20:20:14 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (15109543) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/6766/18826766/interior_boot-1774636042221.jpeg>.
2026-03-29 20:20:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6884/18106884/interior_boot-1774697016449.jpeg> (referer: None)
2026-03-29 20:20:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65843f750>
2026-03-29 20:20:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a652c8d-4559-51c0-895a-c0d6c4471029/7a652c8d-4559-51c0-895a-c0d6c4471029_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2858%252F20452858%252Fdocs_service_history-1774697121688.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd206b109f75be2aecd35c44b69a20b1d') HTTP/1.1" 204 0
2026-03-29 20:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2858/20452858/docs_service_history-1774697121688.jpg?ixlib=js-3.8.0&auto=format&s=d206b109f75be2aecd35c44b69a20b1d saved to cache
2026-03-29 20:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7a652c8d-4559-51c0-895a-c0d6c4471029
2026-03-29 20:20:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659af8810>
2026-03-29 20:20:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_800044b2-37f9-58d3-98fd-2c55f8119112/800044b2-37f9-58d3-98fd-2c55f8119112_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6884%252F18106884%252F18106884-instrument_cluster-modified-1774698250338.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6884/18106884/18106884-instrument_cluster-modified-1774698250338.jpeg saved to cache
2026-03-29 20:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 800044b2-37f9-58d3-98fd-2c55f8119112
2026-03-29 20:20:14 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:20:14 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:20:14 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00.\xa6$\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xd5\xe5\x00.\x9c2\x00\x00\x00\x00'
2026-03-29 20:20:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658acdfd0>
2026-03-29 20:20:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_800044b2-37f9-58d3-98fd-2c55f8119112/800044b2-37f9-58d3-98fd-2c55f8119112_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6884%252F18106884%252Finterior_rear_seats-1774696979950.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6884/18106884/interior_rear_seats-1774696979950.jpeg saved to cache
2026-03-29 20:20:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 800044b2-37f9-58d3-98fd-2c55f8119112
2026-03-29 20:20:14 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:20:14 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:20:14 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00HB\xf6\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\x0c\xb4\x00H9\x04\x00\x00\x00\x00'
2026-03-29 20:20:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e70c10>
2026-03-29 20:20:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_800044b2-37f9-58d3-98fd-2c55f8119112/800044b2-37f9-58d3-98fd-2c55f8119112_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6884%252F18106884%252Finterior_boot-1774697016449.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6884/18106884/interior_boot-1774697016449.jpeg saved to cache
2026-03-29 20:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 800044b2-37f9-58d3-98fd-2c55f8119112
2026-03-29 20:20:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6766/18826766/exterior_front_passenger-1774637077734.jpeg> (referer: None)
2026-03-29 20:20:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6766/18826766/docs_service_history-1774639642075.jpeg?ixlib=js-3.8.0&auto=format&s=fa272ca6f40fae6f4164a92f50f047e4> (referer: None)
2026-03-29 20:20:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6766/18826766/exterior_rear_passenger-1774636809299.jpeg> (referer: None)
2026-03-29 20:20:15 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/6766/18826766/interior_boot-1774636042221.jpeg>.
2026-03-29 20:20:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65beec510>
2026-03-29 20:20:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d68dff7-33bc-56e2-872c-e91f74d0ab96/3d68dff7-33bc-56e2-872c-e91f74d0ab96_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6766%252F18826766%252Fexterior_front_passenger-1774637077734.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6766/18826766/exterior_front_passenger-1774637077734.jpeg saved to cache
2026-03-29 20:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3d68dff7-33bc-56e2-872c-e91f74d0ab96
2026-03-29 20:20:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20298443.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20467557.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:20:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a1ca90>
2026-03-29 20:20:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d68dff7-33bc-56e2-872c-e91f74d0ab96/3d68dff7-33bc-56e2-872c-e91f74d0ab96_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6766%252F18826766%252Fdocs_service_history-1774639642075.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfa272ca6f40fae6f4164a92f50f047e4') HTTP/1.1" 204 0
2026-03-29 20:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6766/18826766/docs_service_history-1774639642075.jpeg?ixlib=js-3.8.0&auto=format&s=fa272ca6f40fae6f4164a92f50f047e4 saved to cache
2026-03-29 20:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3d68dff7-33bc-56e2-872c-e91f74d0ab96
2026-03-29 20:20:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599a4e90>
2026-03-29 20:20:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d68dff7-33bc-56e2-872c-e91f74d0ab96/3d68dff7-33bc-56e2-872c-e91f74d0ab96_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6766%252F18826766%252Fexterior_rear_passenger-1774636809299.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6766/18826766/exterior_rear_passenger-1774636809299.jpeg saved to cache
2026-03-29 20:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3d68dff7-33bc-56e2-872c-e91f74d0ab96
2026-03-29 20:20:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 120a4c4e-1922-58b4-8f81-bf4a19e859a7 with identifier: 20298443
2026-03-29 20:20:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 120a4c4e-1922-58b4-8f81-bf4a19e859a7 with scrape type 1
2026-03-29 20:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 120a4c4e-1922-58b4-8f81-bf4a19e859a7
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8443%252F20298443%252Fexterior_front_driver-1774633333018.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8443/20298443/exterior_front_driver-1774633333018.jpg not downloaded yet
2026-03-29 20:20:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e162cd40-523b-58cc-9282-f1373d12128c with identifier: 20467557
2026-03-29 20:20:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e162cd40-523b-58cc-9282-f1373d12128c with scrape type 1
2026-03-29 20:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e162cd40-523b-58cc-9282-f1373d12128c
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7557%252F20467557%252Fexterior_front_driver-1774778265800.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7557/20467557/exterior_front_driver-1774778265800.jpg not downloaded yet
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8443%252F20298443%252Fexterior_rear_driver-1774633334312.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8443/20298443/exterior_rear_driver-1774633334312.jpg not downloaded yet
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7557%252F20467557%252Fexterior_rear_driver-1774778269294.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7557/20467557/exterior_rear_driver-1774778269294.jpg not downloaded yet
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8443%252F20298443%252Fexterior_front_passenger-1774633377530.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8443/20298443/exterior_front_passenger-1774633377530.jpg not downloaded yet
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7557%252F20467557%252Fexterior_front_passenger-1774778302011.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7557/20467557/exterior_front_passenger-1774778302011.jpg not downloaded yet
2026-03-29 20:20:15 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (11352557) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/6766/18826766/interior_front_seats-1774636535845.jpeg>.
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8443%252F20298443%252Fexterior_rear_passenger-1774633337071.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8443/20298443/exterior_rear_passenger-1774633337071.jpg not downloaded yet
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7557%252F20467557%252Fexterior_rear_passenger-1774778284212.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7557/20467557/exterior_rear_passenger-1774778284212.jpg not downloaded yet
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8443%252F20298443%252Finterior_front_seats-1774533342483.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8443/20298443/interior_front_seats-1774533342483.jpg not downloaded yet
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7557%252F20467557%252Finterior_front_seats-1774780803453.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7557/20467557/interior_front_seats-1774780803453.jpg not downloaded yet
2026-03-29 20:20:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8443%252F20298443%252Finterior_rear_seats-1774533450506.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8443/20298443/interior_rear_seats-1774533450506.jpg not downloaded yet
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7557%252F20467557%252Finterior_rear_seats-1774778863919.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7557/20467557/interior_rear_seats-1774778863919.jpg not downloaded yet
2026-03-29 20:20:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6766/18826766/18826766-instrument_cluster-modified-1774698430739.jpeg> (referer: None)
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8443%252F20298443%252Finterior_dashboard-1774533522213.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8443/20298443/interior_dashboard-1774533522213.jpg not downloaded yet
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7557%252F20467557%252Finterior_dashboard-1774779008042.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7557/20467557/interior_dashboard-1774779008042.jpg not downloaded yet
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8443%252F20298443%252Finstrument_cluster-1774533434866.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8443/20298443/instrument_cluster-1774533434866.jpg not downloaded yet
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7557%252F20467557%252Finstrument_cluster-1774778929977.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7557/20467557/instrument_cluster-1774778929977.jpg not downloaded yet
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8443%252F20298443%252Finterior_boot-1774533409769.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8443/20298443/interior_boot-1774533409769.jpg not downloaded yet
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7557%252F20467557%252Finterior_boot-1774778904041.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7557/20467557/interior_boot-1774778904041.jpg not downloaded yet
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8443%252F20298443%252Fdocs_service_history-1774711986869.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df9e1e0e9f3a9e0896d2aaa54a6f4db59%27 HTTP/1.1" 200 None
2026-03-29 20:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8443/20298443/docs_service_history-1774711986869.jpg?ixlib=js-3.8.0&auto=format&s=f9e1e0e9f3a9e0896d2aaa54a6f4db59 not downloaded yet
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7557%252F20467557%252Fdocs_service_history-1774780485598.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da2cf766b3f117e7291a5d8f62d66cc63%27 HTTP/1.1" 200 None
2026-03-29 20:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7557/20467557/docs_service_history-1774780485598.jpg?ixlib=js-3.8.0&auto=format&s=a2cf766b3f117e7291a5d8f62d66cc63 not downloaded yet
2026-03-29 20:20:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599c22d0>
2026-03-29 20:20:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d68dff7-33bc-56e2-872c-e91f74d0ab96/3d68dff7-33bc-56e2-872c-e91f74d0ab96_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6766%252F18826766%252F18826766-instrument_cluster-modified-1774698430739.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6766/18826766/18826766-instrument_cluster-modified-1774698430739.jpeg saved to cache
2026-03-29 20:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3d68dff7-33bc-56e2-872c-e91f74d0ab96
2026-03-29 20:20:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6766/18826766/18826766-interior_dashboard-modified-1774698416144.jpeg> (referer: None)
2026-03-29 20:20:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19886187.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6766/18826766/interior_rear_seats-1774636144144.jpeg> (referer: None)
2026-03-29 20:20:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6766/18826766/interior_boot-1774636042221.jpeg> (referer: None)
2026-03-29 20:20:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6766/18826766/exterior_front_driver-1774637049501.jpeg> (referer: None)
2026-03-29 20:20:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6766/18826766/exterior_rear_driver-1774636806424.jpeg> (referer: None)
2026-03-29 20:20:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf4cfd0>
2026-03-29 20:20:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d68dff7-33bc-56e2-872c-e91f74d0ab96/3d68dff7-33bc-56e2-872c-e91f74d0ab96_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6766%252F18826766%252F18826766-interior_dashboard-modified-1774698416144.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6766/18826766/18826766-interior_dashboard-modified-1774698416144.jpeg saved to cache
2026-03-29 20:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3d68dff7-33bc-56e2-872c-e91f74d0ab96
2026-03-29 20:20:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b31294e4-0be8-584b-9500-a19d216a8a4e with identifier: 19886187
2026-03-29 20:20:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b31294e4-0be8-584b-9500-a19d216a8a4e with scrape type 1
2026-03-29 20:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b31294e4-0be8-584b-9500-a19d216a8a4e
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6187%252F19886187%252Fexterior_front_driver-1774705220626.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6187/19886187/exterior_front_driver-1774705220626.jpg not downloaded yet
2026-03-29 20:20:16 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:20:16 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:20:16 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00:4{\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\xe4v\x00:*\x9f\x00\x00\x00\x00'
2026-03-29 20:20:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586f8a10>
2026-03-29 20:20:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d68dff7-33bc-56e2-872c-e91f74d0ab96/3d68dff7-33bc-56e2-872c-e91f74d0ab96_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6766%252F18826766%252Finterior_rear_seats-1774636144144.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6766/18826766/interior_rear_seats-1774636144144.jpeg saved to cache
2026-03-29 20:20:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3d68dff7-33bc-56e2-872c-e91f74d0ab96
2026-03-29 20:20:16 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:20:16 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:20:16 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xdd\x12\xe4\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\tz\xc3\x00\xdd\t\x08\x00\x00\x00\x00'
2026-03-29 20:20:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b448d0>
2026-03-29 20:20:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d68dff7-33bc-56e2-872c-e91f74d0ab96/3d68dff7-33bc-56e2-872c-e91f74d0ab96_image_8.mpo HTTP/1.1" 201 0
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6766%252F18826766%252Finterior_boot-1774636042221.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6766/18826766/interior_boot-1774636042221.jpeg saved to cache
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3d68dff7-33bc-56e2-872c-e91f74d0ab96
2026-03-29 20:20:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e3e910>
2026-03-29 20:20:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d68dff7-33bc-56e2-872c-e91f74d0ab96/3d68dff7-33bc-56e2-872c-e91f74d0ab96_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6766%252F18826766%252Fexterior_front_driver-1774637049501.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6766/18826766/exterior_front_driver-1774637049501.jpeg saved to cache
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3d68dff7-33bc-56e2-872c-e91f74d0ab96
2026-03-29 20:20:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586f62d0>
2026-03-29 20:20:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d68dff7-33bc-56e2-872c-e91f74d0ab96/3d68dff7-33bc-56e2-872c-e91f74d0ab96_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6766%252F18826766%252Fexterior_rear_driver-1774636806424.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6766/18826766/exterior_rear_driver-1774636806424.jpeg saved to cache
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3d68dff7-33bc-56e2-872c-e91f74d0ab96
2026-03-29 20:20:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/8443/20298443/docs_service_history-1774711986869.jpg?ixlib=js-3.8.0&auto=format&s=f9e1e0e9f3a9e0896d2aaa54a6f4db59> (referer: None)
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6187%252F19886187%252Fexterior_rear_driver-1774705240815.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6187/19886187/exterior_rear_driver-1774705240815.jpg not downloaded yet
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6187%252F19886187%252Fexterior_front_passenger-1774705282632.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6187/19886187/exterior_front_passenger-1774705282632.jpg not downloaded yet
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6187%252F19886187%252Fexterior_rear_passenger-1774705309891.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6187/19886187/exterior_rear_passenger-1774705309891.jpg not downloaded yet
2026-03-29 20:20:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7557/20467557/docs_service_history-1774780485598.jpg?ixlib=js-3.8.0&auto=format&s=a2cf766b3f117e7291a5d8f62d66cc63> (referer: None)
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6187%252F19886187%252Finterior_front_seats-1774705834937.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6187/19886187/interior_front_seats-1774705834937.jpg not downloaded yet
2026-03-29 20:20:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6884/18106884/interior_front_seats-1774696879741.jpeg> (referer: None)
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6187%252F19886187%252Finterior_rear_seats-1774705854683.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6187/19886187/interior_rear_seats-1774705854683.jpg not downloaded yet
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6187%252F19886187%252Finterior_dashboard-1774705895343.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6187/19886187/interior_dashboard-1774705895343.jpg not downloaded yet
2026-03-29 20:20:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65881dbd0>
2026-03-29 20:20:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120a4c4e-1922-58b4-8f81-bf4a19e859a7/120a4c4e-1922-58b4-8f81-bf4a19e859a7_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8443%252F20298443%252Fdocs_service_history-1774711986869.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df9e1e0e9f3a9e0896d2aaa54a6f4db59') HTTP/1.1" 204 0
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8443/20298443/docs_service_history-1774711986869.jpg?ixlib=js-3.8.0&auto=format&s=f9e1e0e9f3a9e0896d2aaa54a6f4db59 saved to cache
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 120a4c4e-1922-58b4-8f81-bf4a19e859a7
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6187%252F19886187%252Finstrument_cluster-1774706060403.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6187/19886187/instrument_cluster-1774706060403.jpg not downloaded yet
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6187%252F19886187%252Finterior_boot-1774705909240.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6187/19886187/interior_boot-1774705909240.jpg not downloaded yet
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6187%252F19886187%252Fwheels_front_driver-1774705503297.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6187/19886187/wheels_front_driver-1774705503297.jpg not downloaded yet
2026-03-29 20:20:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18170236.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c15a90>
2026-03-29 20:20:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e162cd40-523b-58cc-9282-f1373d12128c/e162cd40-523b-58cc-9282-f1373d12128c_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7557%252F20467557%252Fdocs_service_history-1774780485598.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da2cf766b3f117e7291a5d8f62d66cc63') HTTP/1.1" 204 0
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7557/20467557/docs_service_history-1774780485598.jpg?ixlib=js-3.8.0&auto=format&s=a2cf766b3f117e7291a5d8f62d66cc63 saved to cache
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e162cd40-523b-58cc-9282-f1373d12128c
2026-03-29 20:20:17 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:20:17 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:20:17 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00:\xfa(\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x02\xc0\xf7\x00:\xf06\x00\x00\x00\x00'
2026-03-29 20:20:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ae7590>
2026-03-29 20:20:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_800044b2-37f9-58d3-98fd-2c55f8119112/800044b2-37f9-58d3-98fd-2c55f8119112_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6884%252F18106884%252Finterior_front_seats-1774696879741.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6884/18106884/interior_front_seats-1774696879741.jpeg saved to cache
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 800044b2-37f9-58d3-98fd-2c55f8119112
2026-03-29 20:20:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 504fd101-cca7-5de8-a0d7-ef60b787eb78 with identifier: 18170236
2026-03-29 20:20:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 504fd101-cca7-5de8-a0d7-ef60b787eb78 with scrape type 1
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 504fd101-cca7-5de8-a0d7-ef60b787eb78
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0236%252F18170236%252Fexterior_front_driver-1774776339682.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0236/18170236/exterior_front_driver-1774776339682.jpg not downloaded yet
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0236%252F18170236%252Fexterior_rear_driver-1774776375666.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0236/18170236/exterior_rear_driver-1774776375666.jpg not downloaded yet
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0236%252F18170236%252Fexterior_front_passenger-1774776351990.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0236/18170236/exterior_front_passenger-1774776351990.jpg not downloaded yet
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0236%252F18170236%252Fexterior_rear_passenger-1774776364265.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0236/18170236/exterior_rear_passenger-1774776364265.jpg not downloaded yet
2026-03-29 20:20:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0236%252F18170236%252F18170236-interior_front_seats-modified-1774778273769.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0236/18170236/18170236-interior_front_seats-modified-1774778273769.jpeg not downloaded yet
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0236%252F18170236%252Finterior_rear_seats-1774776290397.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0236/18170236/interior_rear_seats-1774776290397.jpg not downloaded yet
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0236%252F18170236%252F18170236-interior_dashboard-modified-1774778228578.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0236/18170236/18170236-interior_dashboard-modified-1774778228578.jpeg not downloaded yet
2026-03-29 20:20:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6187/19886187/exterior_front_driver-1774705220626.jpg> (referer: None)
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0236%252F18170236%252F18170236-instrument_cluster-modified-1774778255185.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0236/18170236/18170236-instrument_cluster-modified-1774778255185.jpeg not downloaded yet
2026-03-29 20:20:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7557/20467557/instrument_cluster-1774778929977.jpg> (referer: None)
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0236%252F18170236%252Finterior_boot-1774723405016.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0236/18170236/interior_boot-1774723405016.jpg not downloaded yet
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0236%252F18170236%252Fdocs_service_history-1774771041090.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd70e03273381f675cef1ed76ad1cb4ca%27 HTTP/1.1" 200 None
2026-03-29 20:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0236/18170236/docs_service_history-1774771041090.jpg?ixlib=js-3.8.0&auto=format&s=d70e03273381f675cef1ed76ad1cb4ca not downloaded yet
2026-03-29 20:20:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6187/19886187/exterior_rear_driver-1774705240815.jpg> (referer: None)
2026-03-29 20:20:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8443/20298443/interior_boot-1774533409769.jpg> (referer: None)
2026-03-29 20:20:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7557/20467557/interior_front_seats-1774780803453.jpg> (referer: None)
2026-03-29 20:20:18 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/6766/18826766/interior_front_seats-1774636535845.jpeg>.
2026-03-29 20:20:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7557/20467557/interior_boot-1774778904041.jpg> (referer: None)
2026-03-29 20:20:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6766/18826766/interior_front_seats-1774636535845.jpeg> (referer: None)
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c1a4d0>
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b31294e4-0be8-584b-9500-a19d216a8a4e/b31294e4-0be8-584b-9500-a19d216a8a4e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6187%252F19886187%252Fexterior_front_driver-1774705220626.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6187/19886187/exterior_front_driver-1774705220626.jpg saved to cache
2026-03-29 20:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b31294e4-0be8-584b-9500-a19d216a8a4e
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599e0d90>
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e162cd40-523b-58cc-9282-f1373d12128c/e162cd40-523b-58cc-9282-f1373d12128c_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7557%252F20467557%252Finstrument_cluster-1774778929977.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7557/20467557/instrument_cluster-1774778929977.jpg saved to cache
2026-03-29 20:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e162cd40-523b-58cc-9282-f1373d12128c
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c0cc90>
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b31294e4-0be8-584b-9500-a19d216a8a4e/b31294e4-0be8-584b-9500-a19d216a8a4e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6187%252F19886187%252Fexterior_rear_driver-1774705240815.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6187/19886187/exterior_rear_driver-1774705240815.jpg saved to cache
2026-03-29 20:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b31294e4-0be8-584b-9500-a19d216a8a4e
2026-03-29 20:20:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659cd84d0>
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120a4c4e-1922-58b4-8f81-bf4a19e859a7/120a4c4e-1922-58b4-8f81-bf4a19e859a7_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8443%252F20298443%252Finterior_boot-1774533409769.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8443/20298443/interior_boot-1774533409769.jpg saved to cache
2026-03-29 20:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 120a4c4e-1922-58b4-8f81-bf4a19e859a7
2026-03-29 20:20:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659cd8250>
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e162cd40-523b-58cc-9282-f1373d12128c/e162cd40-523b-58cc-9282-f1373d12128c_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7557%252F20467557%252Finterior_front_seats-1774780803453.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7557/20467557/interior_front_seats-1774780803453.jpg saved to cache
2026-03-29 20:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e162cd40-523b-58cc-9282-f1373d12128c
2026-03-29 20:20:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a10e10>
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e162cd40-523b-58cc-9282-f1373d12128c/e162cd40-523b-58cc-9282-f1373d12128c_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7557%252F20467557%252Finterior_boot-1774778904041.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7557/20467557/interior_boot-1774778904041.jpg saved to cache
2026-03-29 20:20:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e162cd40-523b-58cc-9282-f1373d12128c
2026-03-29 20:20:18 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:20:18 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:20:18 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xa8\x8b\xc2\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04\xae+\x00\xa8\x81\xe6\x00\x00\x00\x00'
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a435d0>
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d68dff7-33bc-56e2-872c-e91f74d0ab96/3d68dff7-33bc-56e2-872c-e91f74d0ab96_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6766%252F18826766%252Finterior_front_seats-1774636535845.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6766/18826766/interior_front_seats-1774636535845.jpeg saved to cache
2026-03-29 20:20:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3d68dff7-33bc-56e2-872c-e91f74d0ab96
2026-03-29 20:20:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3d68dff7-33bc-56e2-872c-e91f74d0ab96, skipping ID generation
2026-03-29 20:20:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d68dff7-33bc-56e2-872c-e91f74d0ab96 with scrape type 1
2026-03-29 20:20:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3d68dff7-33bc-56e2-872c-e91f74d0ab96 sending to next pipeline
2026-03-29 20:20:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 3d68dff7-33bc-56e2-872c-e91f74d0ab96, identifier: 18826766
2026-03-29 20:20:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 3d68dff7-33bc-56e2-872c-e91f74d0ab96 with identifier: 18826766
2026-03-29 20:20:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 3d68dff7-33bc-56e2-872c-e91f74d0ab96 with identifier: 18826766
2026-03-29 20:20:19 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 3d68dff7-33bc-56e2-872c-e91f74d0ab96 with identifier: 18826766 to the API
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/6766/18826766/interior_front_seats-1774636535845.jpeg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '3d68dff7-33bc-56e2-872c-e91f74d0ab96',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LO66 LKE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18826766',
'listing': 'auction',
'location': 'Surrey Dorking',
'make': 'Volkswagen',
'model': 'Scirocco',
'odometer': 85227,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d68dff7-33bc-56e2-872c-e91f74d0ab96/3d68dff7-33bc-56e2-872c-e91f74d0ab96_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5381548,
'Height': 5188,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6766/18826766/exterior_front_driver-1774637049501.jpeg',
'Width': 6917},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d68dff7-33bc-56e2-872c-e91f74d0ab96/3d68dff7-33bc-56e2-872c-e91f74d0ab96_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5548753,
'Height': 5285,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6766/18826766/exterior_rear_driver-1774636806424.jpeg',
'Width': 7046},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d68dff7-33bc-56e2-872c-e91f74d0ab96/3d68dff7-33bc-56e2-872c-e91f74d0ab96_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3799481,
'Height': 4539,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6766/18826766/exterior_front_passenger-1774637077734.jpeg',
'Width': 6052},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d68dff7-33bc-56e2-872c-e91f74d0ab96/3d68dff7-33bc-56e2-872c-e91f74d0ab96_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5996256,
'Height': 5342,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6766/18826766/exterior_rear_passenger-1774636809299.jpeg',
'Width': 7123},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d68dff7-33bc-56e2-872c-e91f74d0ab96/3d68dff7-33bc-56e2-872c-e91f74d0ab96_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 11352557,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/6766/18826766/interior_front_seats-1774636535845.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d68dff7-33bc-56e2-872c-e91f74d0ab96/3d68dff7-33bc-56e2-872c-e91f74d0ab96_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3938545,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6766/18826766/interior_rear_seats-1774636144144.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d68dff7-33bc-56e2-872c-e91f74d0ab96/3d68dff7-33bc-56e2-872c-e91f74d0ab96_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2757023,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6766/18826766/18826766-interior_dashboard-modified-1774698416144.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d68dff7-33bc-56e2-872c-e91f74d0ab96/3d68dff7-33bc-56e2-872c-e91f74d0ab96_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1694417,
'Height': 2540,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6766/18826766/18826766-instrument_cluster-modified-1774698430739.jpeg',
'Width': 3386},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d68dff7-33bc-56e2-872c-e91f74d0ab96/3d68dff7-33bc-56e2-872c-e91f74d0ab96_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 15109543,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/6766/18826766/interior_boot-1774636042221.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d68dff7-33bc-56e2-872c-e91f74d0ab96/3d68dff7-33bc-56e2-872c-e91f74d0ab96_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2974649,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6766/18826766/docs_service_history-1774639642075.jpeg?ixlib=js-3.8.0&auto=format&s=fa272ca6f40fae6f4164a92f50f047e4',
'Width': 4032}],
'price': 6137,
'price_includes_vat': False,
'registration_date': '2016-12-08',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Scirocco GT BlueMotion Tech TSI',
'transmission': 'manual',
'trim': 'GT BlueMotion Tech TSI',
'vin': 'WVWZZZ13ZHV004601',
'year': 2016}
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718826766%27 HTTP/1.1" 200 None
2026-03-29 20:20:19 [motorway.uk] INFO: Saving data for 18826766: {'created_time': 1774815619.933974, 'last_price_update_time': 1774815619.933988, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18826766') HTTP/1.1" 204 0
2026-03-29 20:20:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0236/18170236/docs_service_history-1774771041090.jpg?ixlib=js-3.8.0&auto=format&s=d70e03273381f675cef1ed76ad1cb4ca> (referer: None)
2026-03-29 20:20:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0236/18170236/18170236-instrument_cluster-modified-1774778255185.jpeg> (referer: None)
2026-03-29 20:20:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6187/19886187/wheels_front_driver-1774705503297.jpg> (referer: None)
2026-03-29 20:20:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0236/18170236/18170236-interior_dashboard-modified-1774778228578.jpeg> (referer: None)
2026-03-29 20:20:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6187/19886187/instrument_cluster-1774706060403.jpg> (referer: None)
2026-03-29 20:20:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6187/19886187/interior_boot-1774705909240.jpg> (referer: None)
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658da6d50>
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504fd101-cca7-5de8-a0d7-ef60b787eb78/504fd101-cca7-5de8-a0d7-ef60b787eb78_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0236%252F18170236%252Fdocs_service_history-1774771041090.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd70e03273381f675cef1ed76ad1cb4ca') HTTP/1.1" 204 0
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0236/18170236/docs_service_history-1774771041090.jpg?ixlib=js-3.8.0&auto=format&s=d70e03273381f675cef1ed76ad1cb4ca saved to cache
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 504fd101-cca7-5de8-a0d7-ef60b787eb78
2026-03-29 20:20:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0236/18170236/interior_boot-1774723405016.jpg> (referer: None)
2026-03-29 20:20:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0236/18170236/interior_rear_seats-1774776290397.jpg> (referer: None)
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a82a50>
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504fd101-cca7-5de8-a0d7-ef60b787eb78/504fd101-cca7-5de8-a0d7-ef60b787eb78_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0236%252F18170236%252F18170236-instrument_cluster-modified-1774778255185.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0236/18170236/18170236-instrument_cluster-modified-1774778255185.jpeg saved to cache
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 504fd101-cca7-5de8-a0d7-ef60b787eb78
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658422b50>
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b31294e4-0be8-584b-9500-a19d216a8a4e/b31294e4-0be8-584b-9500-a19d216a8a4e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6187%252F19886187%252Fwheels_front_driver-1774705503297.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6187/19886187/wheels_front_driver-1774705503297.jpg saved to cache
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b31294e4-0be8-584b-9500-a19d216a8a4e
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf10210>
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504fd101-cca7-5de8-a0d7-ef60b787eb78/504fd101-cca7-5de8-a0d7-ef60b787eb78_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0236%252F18170236%252F18170236-interior_dashboard-modified-1774778228578.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0236/18170236/18170236-interior_dashboard-modified-1774778228578.jpeg saved to cache
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 504fd101-cca7-5de8-a0d7-ef60b787eb78
2026-03-29 20:20:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658421450>
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b31294e4-0be8-584b-9500-a19d216a8a4e/b31294e4-0be8-584b-9500-a19d216a8a4e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6187%252F19886187%252Finstrument_cluster-1774706060403.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6187/19886187/instrument_cluster-1774706060403.jpg saved to cache
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b31294e4-0be8-584b-9500-a19d216a8a4e
2026-03-29 20:20:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582f2690>
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b31294e4-0be8-584b-9500-a19d216a8a4e/b31294e4-0be8-584b-9500-a19d216a8a4e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6187%252F19886187%252Finterior_boot-1774705909240.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6187/19886187/interior_boot-1774705909240.jpg saved to cache
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b31294e4-0be8-584b-9500-a19d216a8a4e
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584222d0>
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504fd101-cca7-5de8-a0d7-ef60b787eb78/504fd101-cca7-5de8-a0d7-ef60b787eb78_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0236%252F18170236%252Finterior_boot-1774723405016.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0236/18170236/interior_boot-1774723405016.jpg saved to cache
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 504fd101-cca7-5de8-a0d7-ef60b787eb78
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b63f50>
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504fd101-cca7-5de8-a0d7-ef60b787eb78/504fd101-cca7-5de8-a0d7-ef60b787eb78_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0236%252F18170236%252Finterior_rear_seats-1774776290397.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0236/18170236/interior_rear_seats-1774776290397.jpg saved to cache
2026-03-29 20:20:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 504fd101-cca7-5de8-a0d7-ef60b787eb78
2026-03-29 20:20:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0236/18170236/exterior_rear_passenger-1774776364265.jpg> (referer: None)
2026-03-29 20:20:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0236/18170236/exterior_front_passenger-1774776351990.jpg> (referer: None)
2026-03-29 20:20:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0236/18170236/exterior_front_driver-1774776339682.jpg> (referer: None)
2026-03-29 20:20:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0236/18170236/exterior_rear_driver-1774776375666.jpg> (referer: None)
2026-03-29 20:20:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0236/18170236/18170236-interior_front_seats-modified-1774778273769.jpeg> (referer: None)
2026-03-29 20:20:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6187/19886187/interior_dashboard-1774705895343.jpg> (referer: None)
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c18850>
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504fd101-cca7-5de8-a0d7-ef60b787eb78/504fd101-cca7-5de8-a0d7-ef60b787eb78_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0236%252F18170236%252Fexterior_rear_passenger-1774776364265.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0236/18170236/exterior_rear_passenger-1774776364265.jpg saved to cache
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 504fd101-cca7-5de8-a0d7-ef60b787eb78
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583c7d10>
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504fd101-cca7-5de8-a0d7-ef60b787eb78/504fd101-cca7-5de8-a0d7-ef60b787eb78_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0236%252F18170236%252Fexterior_front_passenger-1774776351990.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0236/18170236/exterior_front_passenger-1774776351990.jpg saved to cache
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 504fd101-cca7-5de8-a0d7-ef60b787eb78
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65885d090>
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504fd101-cca7-5de8-a0d7-ef60b787eb78/504fd101-cca7-5de8-a0d7-ef60b787eb78_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0236%252F18170236%252Fexterior_front_driver-1774776339682.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0236/18170236/exterior_front_driver-1774776339682.jpg saved to cache
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 504fd101-cca7-5de8-a0d7-ef60b787eb78
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589f5650>
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504fd101-cca7-5de8-a0d7-ef60b787eb78/504fd101-cca7-5de8-a0d7-ef60b787eb78_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0236%252F18170236%252Fexterior_rear_driver-1774776375666.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0236/18170236/exterior_rear_driver-1774776375666.jpg saved to cache
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 504fd101-cca7-5de8-a0d7-ef60b787eb78
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65bf017d0>
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_504fd101-cca7-5de8-a0d7-ef60b787eb78/504fd101-cca7-5de8-a0d7-ef60b787eb78_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0236%252F18170236%252F18170236-interior_front_seats-modified-1774778273769.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0236/18170236/18170236-interior_front_seats-modified-1774778273769.jpeg saved to cache
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 504fd101-cca7-5de8-a0d7-ef60b787eb78
2026-03-29 20:20:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 504fd101-cca7-5de8-a0d7-ef60b787eb78, skipping ID generation
2026-03-29 20:20:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 504fd101-cca7-5de8-a0d7-ef60b787eb78 with scrape type 1
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 504fd101-cca7-5de8-a0d7-ef60b787eb78 sending to next pipeline
2026-03-29 20:20:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 504fd101-cca7-5de8-a0d7-ef60b787eb78, identifier: 18170236
2026-03-29 20:20:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65bc630d0>
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b31294e4-0be8-584b-9500-a19d216a8a4e/b31294e4-0be8-584b-9500-a19d216a8a4e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6187%252F19886187%252Finterior_dashboard-1774705895343.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6187/19886187/interior_dashboard-1774705895343.jpg saved to cache
2026-03-29 20:20:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b31294e4-0be8-584b-9500-a19d216a8a4e
2026-03-29 20:20:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 504fd101-cca7-5de8-a0d7-ef60b787eb78 with identifier: 18170236
2026-03-29 20:20:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 504fd101-cca7-5de8-a0d7-ef60b787eb78 with identifier: 18170236
2026-03-29 20:20:21 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 504fd101-cca7-5de8-a0d7-ef60b787eb78 with identifier: 18170236 to the API
2026-03-29 20:20:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/0236/18170236/18170236-interior_front_seats-modified-1774778273769.jpeg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '504fd101-cca7-5de8-a0d7-ef60b787eb78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'KW17 KSY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18170236',
'listing': 'auction',
'location': 'Derbyshire Swadlincote',
'make': 'Peugeot',
'model': '3008',
'odometer': 66390,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504fd101-cca7-5de8-a0d7-ef60b787eb78/504fd101-cca7-5de8-a0d7-ef60b787eb78_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1537455,
'Height': 2555,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0236/18170236/exterior_front_driver-1774776339682.jpg',
'Width': 3406},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504fd101-cca7-5de8-a0d7-ef60b787eb78/504fd101-cca7-5de8-a0d7-ef60b787eb78_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1765587,
'Height': 2731,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0236/18170236/exterior_rear_driver-1774776375666.jpg',
'Width': 3641},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504fd101-cca7-5de8-a0d7-ef60b787eb78/504fd101-cca7-5de8-a0d7-ef60b787eb78_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 979877,
'Height': 2167,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0236/18170236/exterior_front_passenger-1774776351990.jpg',
'Width': 2889},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504fd101-cca7-5de8-a0d7-ef60b787eb78/504fd101-cca7-5de8-a0d7-ef60b787eb78_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 884398,
'Height': 2621,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0236/18170236/exterior_rear_passenger-1774776364265.jpg',
'Width': 3494},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504fd101-cca7-5de8-a0d7-ef60b787eb78/504fd101-cca7-5de8-a0d7-ef60b787eb78_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1964445,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0236/18170236/18170236-interior_front_seats-modified-1774778273769.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504fd101-cca7-5de8-a0d7-ef60b787eb78/504fd101-cca7-5de8-a0d7-ef60b787eb78_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2089281,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0236/18170236/interior_rear_seats-1774776290397.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504fd101-cca7-5de8-a0d7-ef60b787eb78/504fd101-cca7-5de8-a0d7-ef60b787eb78_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1272991,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0236/18170236/18170236-interior_dashboard-modified-1774778228578.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504fd101-cca7-5de8-a0d7-ef60b787eb78/504fd101-cca7-5de8-a0d7-ef60b787eb78_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 846283,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0236/18170236/18170236-instrument_cluster-modified-1774778255185.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504fd101-cca7-5de8-a0d7-ef60b787eb78/504fd101-cca7-5de8-a0d7-ef60b787eb78_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2504268,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0236/18170236/interior_boot-1774723405016.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_504fd101-cca7-5de8-a0d7-ef60b787eb78/504fd101-cca7-5de8-a0d7-ef60b787eb78_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 830973,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0236/18170236/docs_service_history-1774771041090.jpg?ixlib=js-3.8.0&auto=format&s=d70e03273381f675cef1ed76ad1cb4ca',
'Width': 4032}],
'price': 6157,
'price_includes_vat': False,
'registration_date': '2017-05-26',
'seats_number': None,
'seller_name': None,
'title': 'Peugeot 3008 Allure S/S',
'transmission': 'manual',
'trim': 'Allure S/S',
'vin': 'VF3MRHNYHHS102363',
'year': 2017}
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718170236%27 HTTP/1.1" 200 None
2026-03-29 20:20:22 [motorway.uk] INFO: Saving data for 18170236: {'created_time': 1774815622.191044, 'last_price_update_time': 1774815622.191056, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18170236') HTTP/1.1" 204 0
2026-03-29 20:20:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8443/20298443/interior_dashboard-1774533522213.jpg> (referer: None)
2026-03-29 20:20:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6187/19886187/exterior_rear_passenger-1774705309891.jpg> (referer: None)
2026-03-29 20:20:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6187/19886187/exterior_front_passenger-1774705282632.jpg> (referer: None)
2026-03-29 20:20:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8443/20298443/instrument_cluster-1774533434866.jpg> (referer: None)
2026-03-29 20:20:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6187/19886187/interior_front_seats-1774705834937.jpg> (referer: None)
2026-03-29 20:20:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6187/19886187/interior_rear_seats-1774705854683.jpg> (referer: None)
2026-03-29 20:20:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7557/20467557/interior_dashboard-1774779008042.jpg> (referer: None)
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658da7d90>
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120a4c4e-1922-58b4-8f81-bf4a19e859a7/120a4c4e-1922-58b4-8f81-bf4a19e859a7_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8443%252F20298443%252Finterior_dashboard-1774533522213.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8443/20298443/interior_dashboard-1774533522213.jpg saved to cache
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 120a4c4e-1922-58b4-8f81-bf4a19e859a7
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65887f390>
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b31294e4-0be8-584b-9500-a19d216a8a4e/b31294e4-0be8-584b-9500-a19d216a8a4e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6187%252F19886187%252Fexterior_rear_passenger-1774705309891.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6187/19886187/exterior_rear_passenger-1774705309891.jpg saved to cache
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b31294e4-0be8-584b-9500-a19d216a8a4e
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598f1dd0>
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b31294e4-0be8-584b-9500-a19d216a8a4e/b31294e4-0be8-584b-9500-a19d216a8a4e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6187%252F19886187%252Fexterior_front_passenger-1774705282632.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6187/19886187/exterior_front_passenger-1774705282632.jpg saved to cache
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b31294e4-0be8-584b-9500-a19d216a8a4e
2026-03-29 20:20:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658309750>
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120a4c4e-1922-58b4-8f81-bf4a19e859a7/120a4c4e-1922-58b4-8f81-bf4a19e859a7_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8443%252F20298443%252Finstrument_cluster-1774533434866.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8443/20298443/instrument_cluster-1774533434866.jpg saved to cache
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 120a4c4e-1922-58b4-8f81-bf4a19e859a7
2026-03-29 20:20:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a02750>
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b31294e4-0be8-584b-9500-a19d216a8a4e/b31294e4-0be8-584b-9500-a19d216a8a4e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6187%252F19886187%252Finterior_front_seats-1774705834937.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6187/19886187/interior_front_seats-1774705834937.jpg saved to cache
2026-03-29 20:20:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b31294e4-0be8-584b-9500-a19d216a8a4e
2026-03-29 20:20:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f26850>
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b31294e4-0be8-584b-9500-a19d216a8a4e/b31294e4-0be8-584b-9500-a19d216a8a4e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6187%252F19886187%252Finterior_rear_seats-1774705854683.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6187/19886187/interior_rear_seats-1774705854683.jpg saved to cache
2026-03-29 20:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b31294e4-0be8-584b-9500-a19d216a8a4e
2026-03-29 20:20:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b31294e4-0be8-584b-9500-a19d216a8a4e, skipping ID generation
2026-03-29 20:20:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b31294e4-0be8-584b-9500-a19d216a8a4e with scrape type 1
2026-03-29 20:20:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b31294e4-0be8-584b-9500-a19d216a8a4e sending to next pipeline
2026-03-29 20:20:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b31294e4-0be8-584b-9500-a19d216a8a4e, identifier: 19886187
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf10dd0>
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e162cd40-523b-58cc-9282-f1373d12128c/e162cd40-523b-58cc-9282-f1373d12128c_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7557%252F20467557%252Finterior_dashboard-1774779008042.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7557/20467557/interior_dashboard-1774779008042.jpg saved to cache
2026-03-29 20:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e162cd40-523b-58cc-9282-f1373d12128c
2026-03-29 20:20:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b31294e4-0be8-584b-9500-a19d216a8a4e with identifier: 19886187
2026-03-29 20:20:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b31294e4-0be8-584b-9500-a19d216a8a4e with identifier: 19886187
2026-03-29 20:20:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b31294e4-0be8-584b-9500-a19d216a8a4e with identifier: 19886187 to the API
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/6187/19886187/interior_rear_seats-1774705854683.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.1L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'b31294e4-0be8-584b-9500-a19d216a8a4e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'H3 LFF',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19886187',
'listing': 'auction',
'location': 'Leicestershire Leicester',
'make': 'Mercedes',
'model': 'A Class',
'odometer': 73538,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b31294e4-0be8-584b-9500-a19d216a8a4e/b31294e4-0be8-584b-9500-a19d216a8a4e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1644813,
'Height': 2601,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6187/19886187/exterior_front_driver-1774705220626.jpg',
'Width': 3468},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b31294e4-0be8-584b-9500-a19d216a8a4e/b31294e4-0be8-584b-9500-a19d216a8a4e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2033166,
'Height': 2963,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6187/19886187/exterior_rear_driver-1774705240815.jpg',
'Width': 3950},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b31294e4-0be8-584b-9500-a19d216a8a4e/b31294e4-0be8-584b-9500-a19d216a8a4e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1837510,
'Height': 2943,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6187/19886187/exterior_front_passenger-1774705282632.jpg',
'Width': 3924},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b31294e4-0be8-584b-9500-a19d216a8a4e/b31294e4-0be8-584b-9500-a19d216a8a4e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1807484,
'Height': 2990,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6187/19886187/exterior_rear_passenger-1774705309891.jpg',
'Width': 3987},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b31294e4-0be8-584b-9500-a19d216a8a4e/b31294e4-0be8-584b-9500-a19d216a8a4e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3398008,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6187/19886187/interior_front_seats-1774705834937.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b31294e4-0be8-584b-9500-a19d216a8a4e/b31294e4-0be8-584b-9500-a19d216a8a4e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3632527,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6187/19886187/interior_rear_seats-1774705854683.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b31294e4-0be8-584b-9500-a19d216a8a4e/b31294e4-0be8-584b-9500-a19d216a8a4e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3600742,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6187/19886187/interior_dashboard-1774705895343.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b31294e4-0be8-584b-9500-a19d216a8a4e/b31294e4-0be8-584b-9500-a19d216a8a4e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2383634,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6187/19886187/instrument_cluster-1774706060403.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b31294e4-0be8-584b-9500-a19d216a8a4e/b31294e4-0be8-584b-9500-a19d216a8a4e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3449988,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6187/19886187/interior_boot-1774705909240.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b31294e4-0be8-584b-9500-a19d216a8a4e/b31294e4-0be8-584b-9500-a19d216a8a4e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1625899,
'Height': 2811,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6187/19886187/wheels_front_driver-1774705503297.jpg',
'Width': 3748}],
'price': 7554,
'price_includes_vat': False,
'registration_date': '2016-06-30',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes A 200 D AMG Line',
'transmission': 'manual',
'trim': 'A 200 D AMG Line',
'vin': 'WDD1760082V151202',
'year': 2016}
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719886187%27 HTTP/1.1" 200 None
2026-03-29 20:20:23 [motorway.uk] INFO: Saving data for 19886187: {'created_time': 1774815623.630813, 'last_price_update_time': 1774815623.630824, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19886187') HTTP/1.1" 204 0
2026-03-29 20:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8443/20298443/interior_rear_seats-1774533450506.jpg> (referer: None)
2026-03-29 20:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8443/20298443/exterior_rear_passenger-1774633337071.jpg> (referer: None)
2026-03-29 20:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8443/20298443/interior_front_seats-1774533342483.jpg> (referer: None)
2026-03-29 20:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7557/20467557/exterior_rear_passenger-1774778284212.jpg> (referer: None)
2026-03-29 20:20:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7557/20467557/interior_rear_seats-1774778863919.jpg> (referer: None)
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658787550>
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120a4c4e-1922-58b4-8f81-bf4a19e859a7/120a4c4e-1922-58b4-8f81-bf4a19e859a7_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8443%252F20298443%252Finterior_rear_seats-1774533450506.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8443/20298443/interior_rear_seats-1774533450506.jpg saved to cache
2026-03-29 20:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 120a4c4e-1922-58b4-8f81-bf4a19e859a7
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c0c810>
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120a4c4e-1922-58b4-8f81-bf4a19e859a7/120a4c4e-1922-58b4-8f81-bf4a19e859a7_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8443%252F20298443%252Fexterior_rear_passenger-1774633337071.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8443/20298443/exterior_rear_passenger-1774633337071.jpg saved to cache
2026-03-29 20:20:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 120a4c4e-1922-58b4-8f81-bf4a19e859a7
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658433b50>
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120a4c4e-1922-58b4-8f81-bf4a19e859a7/120a4c4e-1922-58b4-8f81-bf4a19e859a7_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8443%252F20298443%252Finterior_front_seats-1774533342483.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8443/20298443/interior_front_seats-1774533342483.jpg saved to cache
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 120a4c4e-1922-58b4-8f81-bf4a19e859a7
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f26dd0>
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e162cd40-523b-58cc-9282-f1373d12128c/e162cd40-523b-58cc-9282-f1373d12128c_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7557%252F20467557%252Fexterior_rear_passenger-1774778284212.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7557/20467557/exterior_rear_passenger-1774778284212.jpg saved to cache
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e162cd40-523b-58cc-9282-f1373d12128c
2026-03-29 20:20:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f24d10>
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e162cd40-523b-58cc-9282-f1373d12128c/e162cd40-523b-58cc-9282-f1373d12128c_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7557%252F20467557%252Finterior_rear_seats-1774778863919.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7557/20467557/interior_rear_seats-1774778863919.jpg saved to cache
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e162cd40-523b-58cc-9282-f1373d12128c
2026-03-29 20:20:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/3222560.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8443/20298443/exterior_front_driver-1774633333018.jpg> (referer: None)
2026-03-29 20:20:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7557/20467557/exterior_front_driver-1774778265800.jpg> (referer: None)
2026-03-29 20:20:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7557/20467557/exterior_rear_driver-1774778269294.jpg> (referer: None)
2026-03-29 20:20:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8443/20298443/exterior_front_passenger-1774633377530.jpg> (referer: None)
2026-03-29 20:20:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2858/20452858/docs_service_history-1774697113142.jpg?ixlib=js-3.8.0&auto=format&s=458bfb126ae01743d7989374d1e7364d> (referer: None)
2026-03-29 20:20:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8443/20298443/exterior_rear_driver-1774633334312.jpg> (referer: None)
2026-03-29 20:20:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7557/20467557/exterior_front_passenger-1774778302011.jpg> (referer: None)
2026-03-29 20:20:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5a6d855-03ee-54f0-b662-d5cf3acf3de3 with identifier: 3222560
2026-03-29 20:20:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5a6d855-03ee-54f0-b662-d5cf3acf3de3 with scrape type 1
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b5a6d855-03ee-54f0-b662-d5cf3acf3de3
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2560%252F3222560%252Fexterior_front_driver-1774175881214.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2560/3222560/exterior_front_driver-1774175881214.jpeg already downloaded
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2560%252F3222560%252Fexterior_rear_driver-1774176069817.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2560/3222560/exterior_rear_driver-1774176069817.jpeg not downloaded yet
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2560%252F3222560%252Fexterior_front_passenger-1774176000767.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2560/3222560/exterior_front_passenger-1774176000767.jpeg already downloaded
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2560%252F3222560%252Fexterior_rear_passenger-1774176045424.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2560/3222560/exterior_rear_passenger-1774176045424.jpeg not downloaded yet
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2560%252F3222560%252Finterior_front_seats-1774176118049.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2560/3222560/interior_front_seats-1774176118049.jpeg not downloaded yet
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583c4c90>
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120a4c4e-1922-58b4-8f81-bf4a19e859a7/120a4c4e-1922-58b4-8f81-bf4a19e859a7_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8443%252F20298443%252Fexterior_front_driver-1774633333018.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8443/20298443/exterior_front_driver-1774633333018.jpg saved to cache
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 120a4c4e-1922-58b4-8f81-bf4a19e859a7
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586afdd0>
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e162cd40-523b-58cc-9282-f1373d12128c/e162cd40-523b-58cc-9282-f1373d12128c_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7557%252F20467557%252Fexterior_front_driver-1774778265800.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7557/20467557/exterior_front_driver-1774778265800.jpg saved to cache
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e162cd40-523b-58cc-9282-f1373d12128c
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65bbc6550>
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e162cd40-523b-58cc-9282-f1373d12128c/e162cd40-523b-58cc-9282-f1373d12128c_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7557%252F20467557%252Fexterior_rear_driver-1774778269294.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7557/20467557/exterior_rear_driver-1774778269294.jpg saved to cache
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e162cd40-523b-58cc-9282-f1373d12128c
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a1ae50>
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120a4c4e-1922-58b4-8f81-bf4a19e859a7/120a4c4e-1922-58b4-8f81-bf4a19e859a7_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8443%252F20298443%252Fexterior_front_passenger-1774633377530.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8443/20298443/exterior_front_passenger-1774633377530.jpg saved to cache
2026-03-29 20:20:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 120a4c4e-1922-58b4-8f81-bf4a19e859a7
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65845fe10>
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a652c8d-4559-51c0-895a-c0d6c4471029/7a652c8d-4559-51c0-895a-c0d6c4471029_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:20:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2858%252F20452858%252Fdocs_service_history-1774697113142.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D458bfb126ae01743d7989374d1e7364d') HTTP/1.1" 204 0
2026-03-29 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2858/20452858/docs_service_history-1774697113142.jpg?ixlib=js-3.8.0&auto=format&s=458bfb126ae01743d7989374d1e7364d saved to cache
2026-03-29 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7a652c8d-4559-51c0-895a-c0d6c4471029
2026-03-29 20:20:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658814090>
2026-03-29 20:20:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_120a4c4e-1922-58b4-8f81-bf4a19e859a7/120a4c4e-1922-58b4-8f81-bf4a19e859a7_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8443%252F20298443%252Fexterior_rear_driver-1774633334312.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8443/20298443/exterior_rear_driver-1774633334312.jpg saved to cache
2026-03-29 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 120a4c4e-1922-58b4-8f81-bf4a19e859a7
2026-03-29 20:20:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 120a4c4e-1922-58b4-8f81-bf4a19e859a7, skipping ID generation
2026-03-29 20:20:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 120a4c4e-1922-58b4-8f81-bf4a19e859a7 with scrape type 1
2026-03-29 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 120a4c4e-1922-58b4-8f81-bf4a19e859a7 sending to next pipeline
2026-03-29 20:20:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 120a4c4e-1922-58b4-8f81-bf4a19e859a7, identifier: 20298443
2026-03-29 20:20:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599e0090>
2026-03-29 20:20:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e162cd40-523b-58cc-9282-f1373d12128c/e162cd40-523b-58cc-9282-f1373d12128c_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7557%252F20467557%252Fexterior_front_passenger-1774778302011.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7557/20467557/exterior_front_passenger-1774778302011.jpg saved to cache
2026-03-29 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e162cd40-523b-58cc-9282-f1373d12128c
2026-03-29 20:20:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e162cd40-523b-58cc-9282-f1373d12128c, skipping ID generation
2026-03-29 20:20:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e162cd40-523b-58cc-9282-f1373d12128c with scrape type 1
2026-03-29 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e162cd40-523b-58cc-9282-f1373d12128c sending to next pipeline
2026-03-29 20:20:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e162cd40-523b-58cc-9282-f1373d12128c, identifier: 20467557
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2560%252F3222560%252Finterior_rear_seats-1774176150474.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2560/3222560/interior_rear_seats-1774176150474.jpeg not downloaded yet
2026-03-29 20:20:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 120a4c4e-1922-58b4-8f81-bf4a19e859a7 with identifier: 20298443
2026-03-29 20:20:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 120a4c4e-1922-58b4-8f81-bf4a19e859a7 with identifier: 20298443
2026-03-29 20:20:25 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 120a4c4e-1922-58b4-8f81-bf4a19e859a7 with identifier: 20298443 to the API
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8443/20298443/exterior_rear_driver-1774633334312.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '120a4c4e-1922-58b4-8f81-bf4a19e859a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EU66 AMO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20298443',
'listing': 'auction',
'location': 'Merseyside Liverpool',
'make': 'Volvo',
'model': 'XC60',
'odometer': 80400,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120a4c4e-1922-58b4-8f81-bf4a19e859a7/120a4c4e-1922-58b4-8f81-bf4a19e859a7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1123465,
'Height': 2083,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8443/20298443/exterior_front_driver-1774633333018.jpg',
'Width': 2777},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120a4c4e-1922-58b4-8f81-bf4a19e859a7/120a4c4e-1922-58b4-8f81-bf4a19e859a7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1350931,
'Height': 2250,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8443/20298443/exterior_rear_driver-1774633334312.jpg',
'Width': 3000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120a4c4e-1922-58b4-8f81-bf4a19e859a7/120a4c4e-1922-58b4-8f81-bf4a19e859a7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1159434,
'Height': 2034,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8443/20298443/exterior_front_passenger-1774633377530.jpg',
'Width': 2712},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120a4c4e-1922-58b4-8f81-bf4a19e859a7/120a4c4e-1922-58b4-8f81-bf4a19e859a7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1392933,
'Height': 2219,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8443/20298443/exterior_rear_passenger-1774633337071.jpg',
'Width': 2958},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120a4c4e-1922-58b4-8f81-bf4a19e859a7/120a4c4e-1922-58b4-8f81-bf4a19e859a7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3228114,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8443/20298443/interior_front_seats-1774533342483.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120a4c4e-1922-58b4-8f81-bf4a19e859a7/120a4c4e-1922-58b4-8f81-bf4a19e859a7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2468167,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8443/20298443/interior_rear_seats-1774533450506.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120a4c4e-1922-58b4-8f81-bf4a19e859a7/120a4c4e-1922-58b4-8f81-bf4a19e859a7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1729219,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8443/20298443/interior_dashboard-1774533522213.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120a4c4e-1922-58b4-8f81-bf4a19e859a7/120a4c4e-1922-58b4-8f81-bf4a19e859a7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2256485,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8443/20298443/instrument_cluster-1774533434866.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120a4c4e-1922-58b4-8f81-bf4a19e859a7/120a4c4e-1922-58b4-8f81-bf4a19e859a7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3036253,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8443/20298443/interior_boot-1774533409769.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_120a4c4e-1922-58b4-8f81-bf4a19e859a7/120a4c4e-1922-58b4-8f81-bf4a19e859a7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 228244,
'Height': 1818,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/8443/20298443/docs_service_history-1774711986869.jpg?ixlib=js-3.8.0&auto=format&s=f9e1e0e9f3a9e0896d2aaa54a6f4db59',
'Width': 2423}],
'price': 10275,
'price_includes_vat': False,
'registration_date': '2016-09-05',
'seats_number': None,
'seller_name': None,
'title': 'Volvo XC60 R-DESIGN LUX NAV D5 AWD',
'transmission': 'manual',
'trim': 'R-DESIGN LUX NAV D5 AWD',
'vin': 'YV1DZAJC4H2024686',
'year': 2016}
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720298443%27 HTTP/1.1" 200 None
2026-03-29 20:20:25 [motorway.uk] INFO: Saving data for 20298443: {'created_time': 1774815625.88174, 'last_price_update_time': 1774815625.88175, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20298443') HTTP/1.1" 204 0
2026-03-29 20:20:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e162cd40-523b-58cc-9282-f1373d12128c with identifier: 20467557
2026-03-29 20:20:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e162cd40-523b-58cc-9282-f1373d12128c with identifier: 20467557
2026-03-29 20:20:25 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e162cd40-523b-58cc-9282-f1373d12128c with identifier: 20467557 to the API
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7557/20467557/exterior_front_passenger-1774778302011.jpg>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'e162cd40-523b-58cc-9282-f1373d12128c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LG18 BTZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20467557',
'listing': 'auction',
'location': 'Kingston upon Hull Hull',
'make': 'DS',
'model': 'DS7',
'odometer': 112000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e162cd40-523b-58cc-9282-f1373d12128c/e162cd40-523b-58cc-9282-f1373d12128c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1346268,
'Height': 2155,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7557/20467557/exterior_front_driver-1774778265800.jpg',
'Width': 2873},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e162cd40-523b-58cc-9282-f1373d12128c/e162cd40-523b-58cc-9282-f1373d12128c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 923807,
'Height': 1967,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7557/20467557/exterior_rear_driver-1774778269294.jpg',
'Width': 2623},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e162cd40-523b-58cc-9282-f1373d12128c/e162cd40-523b-58cc-9282-f1373d12128c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2571990,
'Height': 2879,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7557/20467557/exterior_front_passenger-1774778302011.jpg',
'Width': 3838},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e162cd40-523b-58cc-9282-f1373d12128c/e162cd40-523b-58cc-9282-f1373d12128c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2135547,
'Height': 2725,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7557/20467557/exterior_rear_passenger-1774778284212.jpg',
'Width': 3633},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e162cd40-523b-58cc-9282-f1373d12128c/e162cd40-523b-58cc-9282-f1373d12128c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5244669,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7557/20467557/interior_front_seats-1774780803453.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e162cd40-523b-58cc-9282-f1373d12128c/e162cd40-523b-58cc-9282-f1373d12128c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4085260,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7557/20467557/interior_rear_seats-1774778863919.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e162cd40-523b-58cc-9282-f1373d12128c/e162cd40-523b-58cc-9282-f1373d12128c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4002667,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7557/20467557/interior_dashboard-1774779008042.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e162cd40-523b-58cc-9282-f1373d12128c/e162cd40-523b-58cc-9282-f1373d12128c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1207625,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7557/20467557/instrument_cluster-1774778929977.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e162cd40-523b-58cc-9282-f1373d12128c/e162cd40-523b-58cc-9282-f1373d12128c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4658186,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7557/20467557/interior_boot-1774778904041.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e162cd40-523b-58cc-9282-f1373d12128c/e162cd40-523b-58cc-9282-f1373d12128c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 515476,
'Height': 2810,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7557/20467557/docs_service_history-1774780485598.jpg?ixlib=js-3.8.0&auto=format&s=a2cf766b3f117e7291a5d8f62d66cc63',
'Width': 2102}],
'price': 5441,
'price_includes_vat': False,
'registration_date': '2018-05-25',
'seats_number': None,
'seller_name': None,
'title': 'DS DS7 C-BACK Pfrmnc LN B-HDI S/S',
'transmission': 'manual',
'trim': 'C-BACK Pfrmnc LN B-HDI S/S',
'vin': 'VR1JCYHZJJY070826',
'year': 2018}
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720467557%27 HTTP/1.1" 200 None
2026-03-29 20:20:26 [motorway.uk] INFO: Saving data for 20467557: {'created_time': 1774815626.320857, 'last_price_update_time': 1774815626.320871, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20467557') HTTP/1.1" 204 0
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2560%252F3222560%252Finterior_dashboard-1774176232485.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2560/3222560/interior_dashboard-1774176232485.jpeg not downloaded yet
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2560%252F3222560%252F3222560-instrument_cluster-modified-1774179288786.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2560/3222560/3222560-instrument_cluster-modified-1774179288786.jpeg not downloaded yet
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2560%252F3222560%252Finterior_boot-1774176300082.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2560/3222560/interior_boot-1774176300082.jpeg not downloaded yet
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2560%252F3222560%252Fdocs_service_history-1774108617358.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D09c5caa204d19eb78ccb64a35ac8b3fe%27 HTTP/1.1" 200 None
2026-03-29 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2560/3222560/docs_service_history-1774108617358.jpeg?ixlib=js-3.8.0&auto=format&s=09c5caa204d19eb78ccb64a35ac8b3fe already downloaded
2026-03-29 20:20:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6884/18106884/exterior_rear_passenger-1774696752291.jpeg> (referer: None)
2026-03-29 20:20:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6884/18106884/exterior_front_passenger-1774696811111.jpeg> (referer: None)
2026-03-29 20:20:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6884/18106884/exterior_rear_driver-1774696759692.jpeg> (referer: None)
2026-03-29 20:20:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2858/20452858/interior_dashboard-1774698780847.jpg> (referer: None)
2026-03-29 20:20:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6884/18106884/exterior_front_driver-1774696840347.jpeg> (referer: None)
2026-03-29 20:20:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2858/20452858/interior_boot-1774696902318.jpg> (referer: None)
2026-03-29 20:20:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2858/20452858/interior_rear_seats-1774696857152.jpg> (referer: None)
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586f0190>
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_800044b2-37f9-58d3-98fd-2c55f8119112/800044b2-37f9-58d3-98fd-2c55f8119112_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6884%252F18106884%252Fexterior_rear_passenger-1774696752291.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6884/18106884/exterior_rear_passenger-1774696752291.jpeg saved to cache
2026-03-29 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 800044b2-37f9-58d3-98fd-2c55f8119112
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658379110>
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_800044b2-37f9-58d3-98fd-2c55f8119112/800044b2-37f9-58d3-98fd-2c55f8119112_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6884%252F18106884%252Fexterior_front_passenger-1774696811111.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6884/18106884/exterior_front_passenger-1774696811111.jpeg saved to cache
2026-03-29 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 800044b2-37f9-58d3-98fd-2c55f8119112
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658e4fe50>
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_800044b2-37f9-58d3-98fd-2c55f8119112/800044b2-37f9-58d3-98fd-2c55f8119112_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6884%252F18106884%252Fexterior_rear_driver-1774696759692.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6884/18106884/exterior_rear_driver-1774696759692.jpeg saved to cache
2026-03-29 20:20:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 800044b2-37f9-58d3-98fd-2c55f8119112
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e116d0>
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a652c8d-4559-51c0-895a-c0d6c4471029/7a652c8d-4559-51c0-895a-c0d6c4471029_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2858%252F20452858%252Finterior_dashboard-1774698780847.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2858/20452858/interior_dashboard-1774698780847.jpg saved to cache
2026-03-29 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7a652c8d-4559-51c0-895a-c0d6c4471029
2026-03-29 20:20:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65bf141d0>
2026-03-29 20:20:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_800044b2-37f9-58d3-98fd-2c55f8119112/800044b2-37f9-58d3-98fd-2c55f8119112_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6884%252F18106884%252Fexterior_front_driver-1774696840347.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6884/18106884/exterior_front_driver-1774696840347.jpeg saved to cache
2026-03-29 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 800044b2-37f9-58d3-98fd-2c55f8119112
2026-03-29 20:20:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 800044b2-37f9-58d3-98fd-2c55f8119112, skipping ID generation
2026-03-29 20:20:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 800044b2-37f9-58d3-98fd-2c55f8119112 with scrape type 1
2026-03-29 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 800044b2-37f9-58d3-98fd-2c55f8119112 sending to next pipeline
2026-03-29 20:20:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 800044b2-37f9-58d3-98fd-2c55f8119112, identifier: 18106884
2026-03-29 20:20:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658379a50>
2026-03-29 20:20:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a652c8d-4559-51c0-895a-c0d6c4471029/7a652c8d-4559-51c0-895a-c0d6c4471029_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2858%252F20452858%252Finterior_boot-1774696902318.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2858/20452858/interior_boot-1774696902318.jpg saved to cache
2026-03-29 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7a652c8d-4559-51c0-895a-c0d6c4471029
2026-03-29 20:20:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658379f50>
2026-03-29 20:20:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a652c8d-4559-51c0-895a-c0d6c4471029/7a652c8d-4559-51c0-895a-c0d6c4471029_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2858%252F20452858%252Finterior_rear_seats-1774696857152.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2858/20452858/interior_rear_seats-1774696857152.jpg saved to cache
2026-03-29 20:20:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7a652c8d-4559-51c0-895a-c0d6c4471029
2026-03-29 20:20:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 800044b2-37f9-58d3-98fd-2c55f8119112 with identifier: 18106884
2026-03-29 20:20:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 800044b2-37f9-58d3-98fd-2c55f8119112 with identifier: 18106884
2026-03-29 20:20:27 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 800044b2-37f9-58d3-98fd-2c55f8119112 with identifier: 18106884 to the API
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6884/18106884/exterior_front_driver-1774696840347.jpeg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '800044b2-37f9-58d3-98fd-2c55f8119112',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'ST18 YTX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18106884',
'listing': 'auction',
'location': 'Devon Exeter',
'make': 'BMW',
'model': '1 Series',
'odometer': 54361,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_800044b2-37f9-58d3-98fd-2c55f8119112/800044b2-37f9-58d3-98fd-2c55f8119112_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2164616,
'Height': 2945,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6884/18106884/exterior_front_driver-1774696840347.jpeg',
'Width': 3927},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_800044b2-37f9-58d3-98fd-2c55f8119112/800044b2-37f9-58d3-98fd-2c55f8119112_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1546816,
'Height': 2454,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6884/18106884/exterior_rear_driver-1774696759692.jpeg',
'Width': 3272},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_800044b2-37f9-58d3-98fd-2c55f8119112/800044b2-37f9-58d3-98fd-2c55f8119112_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1314423,
'Height': 2309,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6884/18106884/exterior_front_passenger-1774696811111.jpeg',
'Width': 3078},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_800044b2-37f9-58d3-98fd-2c55f8119112/800044b2-37f9-58d3-98fd-2c55f8119112_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1281105,
'Height': 2422,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6884/18106884/exterior_rear_passenger-1774696752291.jpeg',
'Width': 3229},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_800044b2-37f9-58d3-98fd-2c55f8119112/800044b2-37f9-58d3-98fd-2c55f8119112_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4045599,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6884/18106884/interior_front_seats-1774696879741.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_800044b2-37f9-58d3-98fd-2c55f8119112/800044b2-37f9-58d3-98fd-2c55f8119112_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3177481,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6884/18106884/interior_rear_seats-1774696979950.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_800044b2-37f9-58d3-98fd-2c55f8119112/800044b2-37f9-58d3-98fd-2c55f8119112_image_6.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 3007819,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6884/18106884/interior_dashboard-1774697005167.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_800044b2-37f9-58d3-98fd-2c55f8119112/800044b2-37f9-58d3-98fd-2c55f8119112_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2148975,
'Height': 2666,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6884/18106884/18106884-instrument_cluster-modified-1774698250338.jpeg',
'Width': 3555},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_800044b2-37f9-58d3-98fd-2c55f8119112/800044b2-37f9-58d3-98fd-2c55f8119112_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 4870058,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6884/18106884/interior_boot-1774697016449.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_800044b2-37f9-58d3-98fd-2c55f8119112/800044b2-37f9-58d3-98fd-2c55f8119112_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2754012,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6884/18106884/docs_service_history-1774698020778.jpeg?ixlib=js-3.8.0&auto=format&s=b15d2bee04f8089f50dd36b1529c60e8',
'Width': 4032}],
'price': 8877,
'price_includes_vat': False,
'registration_date': '2018-06-25',
'seats_number': None,
'seller_name': None,
'title': 'BMW 118I M Sport',
'transmission': 'manual',
'trim': '118I M Sport',
'vin': 'WBA1P520705K40320',
'year': 2018}
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718106884%27 HTTP/1.1" 200 None
2026-03-29 20:20:27 [motorway.uk] INFO: Saving data for 18106884: {'created_time': 1774815627.95807, 'last_price_update_time': 1774815627.958085, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18106884') HTTP/1.1" 204 0
2026-03-29 20:20:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2560/3222560/3222560-instrument_cluster-modified-1774179288786.jpeg> (referer: None)
2026-03-29 20:20:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2560/3222560/exterior_rear_passenger-1774176045424.jpeg> (referer: None)
2026-03-29 20:20:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2560/3222560/exterior_rear_driver-1774176069817.jpeg> (referer: None)
2026-03-29 20:20:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2560/3222560/interior_boot-1774176300082.jpeg> (referer: None)
2026-03-29 20:20:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2560/3222560/interior_dashboard-1774176232485.jpeg> (referer: None)
2026-03-29 20:20:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2560/3222560/interior_front_seats-1774176118049.jpeg> (referer: None)
2026-03-29 20:20:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2560/3222560/interior_rear_seats-1774176150474.jpeg> (referer: None)
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658439750>
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5a6d855-03ee-54f0-b662-d5cf3acf3de3/b5a6d855-03ee-54f0-b662-d5cf3acf3de3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2560%252F3222560%252F3222560-instrument_cluster-modified-1774179288786.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2560/3222560/3222560-instrument_cluster-modified-1774179288786.jpeg saved to cache
2026-03-29 20:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b5a6d855-03ee-54f0-b662-d5cf3acf3de3
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d78790>
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5a6d855-03ee-54f0-b662-d5cf3acf3de3/b5a6d855-03ee-54f0-b662-d5cf3acf3de3_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2560%252F3222560%252Fexterior_rear_passenger-1774176045424.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2560/3222560/exterior_rear_passenger-1774176045424.jpeg saved to cache
2026-03-29 20:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b5a6d855-03ee-54f0-b662-d5cf3acf3de3
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bf7150>
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5a6d855-03ee-54f0-b662-d5cf3acf3de3/b5a6d855-03ee-54f0-b662-d5cf3acf3de3_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2560%252F3222560%252Fexterior_rear_driver-1774176069817.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2560/3222560/exterior_rear_driver-1774176069817.jpeg saved to cache
2026-03-29 20:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b5a6d855-03ee-54f0-b662-d5cf3acf3de3
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 146 - value: b'Apple\x00'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'iPhone 11\x00'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 162 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 170 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 178 - value: b'18.6.2\x00'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 186 - value: b'2026:03:22 10:44:51\x00'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 206 - value: b'iPhone 11\x00'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xd8'
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a82750>
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5a6d855-03ee-54f0-b662-d5cf3acf3de3/b5a6d855-03ee-54f0-b662-d5cf3acf3de3_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2560%252F3222560%252Finterior_boot-1774176300082.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2560/3222560/interior_boot-1774176300082.jpeg saved to cache
2026-03-29 20:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b5a6d855-03ee-54f0-b662-d5cf3acf3de3
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 146 - value: b'Apple\x00'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'iPhone 11\x00'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 162 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 170 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 178 - value: b'18.6.2\x00'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 186 - value: b'2026:03:22 10:43:31\x00'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 206 - value: b'iPhone 11\x00'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xd8'
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c628d0>
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5a6d855-03ee-54f0-b662-d5cf3acf3de3/b5a6d855-03ee-54f0-b662-d5cf3acf3de3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2560%252F3222560%252Finterior_dashboard-1774176232485.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2560/3222560/interior_dashboard-1774176232485.jpeg saved to cache
2026-03-29 20:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b5a6d855-03ee-54f0-b662-d5cf3acf3de3
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 146 - value: b'Apple\x00'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'iPhone 11\x00'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 162 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 170 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 178 - value: b'18.6.2\x00'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 186 - value: b'2026:03:22 10:41:45\x00'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 206 - value: b'iPhone 11\x00'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xd8'
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d78e90>
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5a6d855-03ee-54f0-b662-d5cf3acf3de3/b5a6d855-03ee-54f0-b662-d5cf3acf3de3_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2560%252F3222560%252Finterior_front_seats-1774176118049.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2560/3222560/interior_front_seats-1774176118049.jpeg saved to cache
2026-03-29 20:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b5a6d855-03ee-54f0-b662-d5cf3acf3de3
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 146 - value: b'Apple\x00'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'iPhone 11\x00'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 162 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 170 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 178 - value: b'18.6.2\x00'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 186 - value: b'2026:03:22 10:42:13\x00'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 206 - value: b'iPhone 11\x00'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xd8'
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d6c7d0>
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5a6d855-03ee-54f0-b662-d5cf3acf3de3/b5a6d855-03ee-54f0-b662-d5cf3acf3de3_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2560%252F3222560%252Finterior_rear_seats-1774176150474.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2560/3222560/interior_rear_seats-1774176150474.jpeg saved to cache
2026-03-29 20:20:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b5a6d855-03ee-54f0-b662-d5cf3acf3de3
2026-03-29 20:20:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5a6d855-03ee-54f0-b662-d5cf3acf3de3, skipping ID generation
2026-03-29 20:20:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5a6d855-03ee-54f0-b662-d5cf3acf3de3 with scrape type 1
2026-03-29 20:20:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b5a6d855-03ee-54f0-b662-d5cf3acf3de3 sending to next pipeline
2026-03-29 20:20:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b5a6d855-03ee-54f0-b662-d5cf3acf3de3, identifier: 3222560
2026-03-29 20:20:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b5a6d855-03ee-54f0-b662-d5cf3acf3de3 with identifier: 3222560
2026-03-29 20:20:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b5a6d855-03ee-54f0-b662-d5cf3acf3de3 with identifier: 3222560
2026-03-29 20:20:29 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b5a6d855-03ee-54f0-b662-d5cf3acf3de3 with identifier: 3222560 to the API
2026-03-29 20:20:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/2560/3222560/interior_rear_seats-1774176150474.jpeg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'b5a6d855-03ee-54f0-b662-d5cf3acf3de3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HG17 SBU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/3222560',
'listing': 'auction',
'location': 'West Yorkshire Sowerby Bridge',
'make': 'Fiat',
'model': '500',
'odometer': 72711,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e4698d2-7aff-54f5-a534-1aca147f0abb/2e4698d2-7aff-54f5-a534-1aca147f0abb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1519396,
'Height': 2552,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2560/3222560/exterior_front_driver-1774175881214.jpeg',
'Width': 3402},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5a6d855-03ee-54f0-b662-d5cf3acf3de3/b5a6d855-03ee-54f0-b662-d5cf3acf3de3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1509681,
'Height': 2499,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2560/3222560/exterior_rear_driver-1774176069817.jpeg',
'Width': 3332},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e4698d2-7aff-54f5-a534-1aca147f0abb/2e4698d2-7aff-54f5-a534-1aca147f0abb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2060257,
'Height': 3011,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2560/3222560/exterior_front_passenger-1774176000767.jpeg',
'Width': 4014},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5a6d855-03ee-54f0-b662-d5cf3acf3de3/b5a6d855-03ee-54f0-b662-d5cf3acf3de3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1493756,
'Height': 2406,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2560/3222560/exterior_rear_passenger-1774176045424.jpeg',
'Width': 3208},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5a6d855-03ee-54f0-b662-d5cf3acf3de3/b5a6d855-03ee-54f0-b662-d5cf3acf3de3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3958366,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2560/3222560/interior_front_seats-1774176118049.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5a6d855-03ee-54f0-b662-d5cf3acf3de3/b5a6d855-03ee-54f0-b662-d5cf3acf3de3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5701339,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2560/3222560/interior_rear_seats-1774176150474.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5a6d855-03ee-54f0-b662-d5cf3acf3de3/b5a6d855-03ee-54f0-b662-d5cf3acf3de3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3214710,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2560/3222560/interior_dashboard-1774176232485.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5a6d855-03ee-54f0-b662-d5cf3acf3de3/b5a6d855-03ee-54f0-b662-d5cf3acf3de3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333638,
'Height': 1502,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2560/3222560/3222560-instrument_cluster-modified-1774179288786.jpeg',
'Width': 2003},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5a6d855-03ee-54f0-b662-d5cf3acf3de3/b5a6d855-03ee-54f0-b662-d5cf3acf3de3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2524479,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2560/3222560/interior_boot-1774176300082.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e4698d2-7aff-54f5-a534-1aca147f0abb/2e4698d2-7aff-54f5-a534-1aca147f0abb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1424817,
'Height': 3024,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2560/3222560/docs_service_history-1774108617358.jpeg?ixlib=js-3.8.0&auto=format&s=09c5caa204d19eb78ccb64a35ac8b3fe',
'Width': 4032}],
'price': 5812,
'price_includes_vat': False,
'registration_date': '2017-07-13',
'seats_number': None,
'seller_name': None,
'title': 'Fiat 500 Lounge S-A',
'transmission': 'automatic',
'trim': 'Lounge S-A',
'vin': 'ZFA3120000J754935',
'year': 2017}
2026-03-29 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273222560%27 HTTP/1.1" 200 None
2026-03-29 20:20:29 [motorway.uk] INFO: Saving data for 3222560: {'created_time': 1774815629.481239, 'last_price_update_time': 1774815629.481251, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='3222560') HTTP/1.1" 204 0
2026-03-29 20:20:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2858/20452858/exterior_front_passenger-1774696572038.jpg> (referer: None)
2026-03-29 20:20:29 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (15261043) larger than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/5319/18975319/interior_front_seats-1766666592168.jpeg>.
2026-03-29 20:20:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2858/20452858/exterior_rear_driver-1774698880558.jpg> (referer: None)
2026-03-29 20:20:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2858/20452858/exterior_rear_passenger-1774698898487.jpg> (referer: None)
2026-03-29 20:20:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2913/20482913/exterior_rear_driver-1774703268495.jpg> (referer: None)
2026-03-29 20:20:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2913/20482913/exterior_front_driver-1774703246456.jpg> (referer: None)
2026-03-29 20:20:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/2858/20452858/interior_front_seats-1774698814228.jpg> (referer: None)
2026-03-29 20:20:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65851a910>
2026-03-29 20:20:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a652c8d-4559-51c0-895a-c0d6c4471029/7a652c8d-4559-51c0-895a-c0d6c4471029_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2858%252F20452858%252Fexterior_front_passenger-1774696572038.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2858/20452858/exterior_front_passenger-1774696572038.jpg saved to cache
2026-03-29 20:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7a652c8d-4559-51c0-895a-c0d6c4471029
2026-03-29 20:20:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a5e950>
2026-03-29 20:20:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a652c8d-4559-51c0-895a-c0d6c4471029/7a652c8d-4559-51c0-895a-c0d6c4471029_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2858%252F20452858%252Fexterior_rear_driver-1774698880558.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2858/20452858/exterior_rear_driver-1774698880558.jpg saved to cache
2026-03-29 20:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7a652c8d-4559-51c0-895a-c0d6c4471029
2026-03-29 20:20:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d46310>
2026-03-29 20:20:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a652c8d-4559-51c0-895a-c0d6c4471029/7a652c8d-4559-51c0-895a-c0d6c4471029_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2858%252F20452858%252Fexterior_rear_passenger-1774698898487.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2858/20452858/exterior_rear_passenger-1774698898487.jpg saved to cache
2026-03-29 20:20:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7a652c8d-4559-51c0-895a-c0d6c4471029
2026-03-29 20:20:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586f06d0>
2026-03-29 20:20:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17eaf36e-8d20-5ec5-9698-9d9c9287651e/17eaf36e-8d20-5ec5-9698-9d9c9287651e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2913%252F20482913%252Fexterior_rear_driver-1774703268495.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2913/20482913/exterior_rear_driver-1774703268495.jpg saved to cache
2026-03-29 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 17eaf36e-8d20-5ec5-9698-9d9c9287651e
2026-03-29 20:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d78910>
2026-03-29 20:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17eaf36e-8d20-5ec5-9698-9d9c9287651e/17eaf36e-8d20-5ec5-9698-9d9c9287651e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2913%252F20482913%252Fexterior_front_driver-1774703246456.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2913/20482913/exterior_front_driver-1774703246456.jpg saved to cache
2026-03-29 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17eaf36e-8d20-5ec5-9698-9d9c9287651e
2026-03-29 20:20:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658476e10>
2026-03-29 20:20:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a652c8d-4559-51c0-895a-c0d6c4471029/7a652c8d-4559-51c0-895a-c0d6c4471029_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F2858%252F20452858%252Finterior_front_seats-1774698814228.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/2858/20452858/interior_front_seats-1774698814228.jpg saved to cache
2026-03-29 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7a652c8d-4559-51c0-895a-c0d6c4471029
2026-03-29 20:20:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7a652c8d-4559-51c0-895a-c0d6c4471029, skipping ID generation
2026-03-29 20:20:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a652c8d-4559-51c0-895a-c0d6c4471029 with scrape type 1
2026-03-29 20:20:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7a652c8d-4559-51c0-895a-c0d6c4471029 sending to next pipeline
2026-03-29 20:20:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 7a652c8d-4559-51c0-895a-c0d6c4471029, identifier: 20452858
2026-03-29 20:20:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7a652c8d-4559-51c0-895a-c0d6c4471029 with identifier: 20452858
2026-03-29 20:20:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7a652c8d-4559-51c0-895a-c0d6c4471029 with identifier: 20452858
2026-03-29 20:20:30 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7a652c8d-4559-51c0-895a-c0d6c4471029 with identifier: 20452858 to the API
2026-03-29 20:20:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/2858/20452858/interior_front_seats-1774698814228.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '7a652c8d-4559-51c0-895a-c0d6c4471029',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'MH19 CTY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20452858',
'listing': 'auction',
'location': 'West Yorkshire Leeds',
'make': 'MINI',
'model': 'Cooper',
'odometer': 41837,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a652c8d-4559-51c0-895a-c0d6c4471029/7a652c8d-4559-51c0-895a-c0d6c4471029_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1458136,
'Height': 2273,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2858/20452858/exterior_front_driver-1774702861961.jpg',
'Width': 3031},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a652c8d-4559-51c0-895a-c0d6c4471029/7a652c8d-4559-51c0-895a-c0d6c4471029_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1653422,
'Height': 2626,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2858/20452858/exterior_rear_driver-1774698880558.jpg',
'Width': 3501},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a652c8d-4559-51c0-895a-c0d6c4471029/7a652c8d-4559-51c0-895a-c0d6c4471029_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 960220,
'Height': 2024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2858/20452858/exterior_front_passenger-1774696572038.jpg',
'Width': 2698},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a652c8d-4559-51c0-895a-c0d6c4471029/7a652c8d-4559-51c0-895a-c0d6c4471029_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1891127,
'Height': 2433,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2858/20452858/exterior_rear_passenger-1774698898487.jpg',
'Width': 3244},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a652c8d-4559-51c0-895a-c0d6c4471029/7a652c8d-4559-51c0-895a-c0d6c4471029_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3971792,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2858/20452858/interior_front_seats-1774698814228.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a652c8d-4559-51c0-895a-c0d6c4471029/7a652c8d-4559-51c0-895a-c0d6c4471029_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3666969,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2858/20452858/interior_rear_seats-1774696857152.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a652c8d-4559-51c0-895a-c0d6c4471029/7a652c8d-4559-51c0-895a-c0d6c4471029_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2056536,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2858/20452858/interior_dashboard-1774698780847.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a652c8d-4559-51c0-895a-c0d6c4471029/7a652c8d-4559-51c0-895a-c0d6c4471029_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2618348,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2858/20452858/interior_boot-1774696902318.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a652c8d-4559-51c0-895a-c0d6c4471029/7a652c8d-4559-51c0-895a-c0d6c4471029_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1236847,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2858/20452858/docs_service_history-1774697113142.jpg?ixlib=js-3.8.0&auto=format&s=458bfb126ae01743d7989374d1e7364d',
'Width': 3024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a652c8d-4559-51c0-895a-c0d6c4471029/7a652c8d-4559-51c0-895a-c0d6c4471029_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1803907,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2858/20452858/docs_service_history-1774697121688.jpg?ixlib=js-3.8.0&auto=format&s=d206b109f75be2aecd35c44b69a20b1d',
'Width': 3024}],
'price': 8833,
'price_includes_vat': False,
'registration_date': '2019-06-22',
'seats_number': None,
'seller_name': None,
'title': 'MINI Cooper Classic',
'transmission': 'manual',
'trim': 'Classic',
'vin': 'WMWXR320202L17749',
'year': 2019}
2026-03-29 20:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720452858%27 HTTP/1.1" 200 None
2026-03-29 20:20:32 [motorway.uk] INFO: Saving data for 20452858: {'created_time': 1774815632.8238, 'last_price_update_time': 1774815632.823814, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20452858') HTTP/1.1" 204 0
2026-03-29 20:20:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2913/20482913/exterior_front_passenger-1774703298876.jpg> (referer: None)
2026-03-29 20:20:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5319/18975319/exterior_front_passenger-1766666561612.jpeg> (referer: None)
2026-03-29 20:20:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5319/18975319/exterior_rear_passenger-1766666577178.jpeg> (referer: None)
2026-03-29 20:20:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0662/20500662/interior_boot-1774778808471.jpg> (referer: None)
2026-03-29 20:20:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5319/18975319/exterior_rear_driver-1766666576899.jpeg> (referer: None)
2026-03-29 20:20:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5319/18975319/18975319-interior_dashboard-modified-1766841237038.jpeg> (referer: None)
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a39410>
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17eaf36e-8d20-5ec5-9698-9d9c9287651e/17eaf36e-8d20-5ec5-9698-9d9c9287651e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2913%252F20482913%252Fexterior_front_passenger-1774703298876.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2913/20482913/exterior_front_passenger-1774703298876.jpg saved to cache
2026-03-29 20:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 17eaf36e-8d20-5ec5-9698-9d9c9287651e
2026-03-29 20:20:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17eaf36e-8d20-5ec5-9698-9d9c9287651e, skipping ID generation
2026-03-29 20:20:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17eaf36e-8d20-5ec5-9698-9d9c9287651e with scrape type 1
2026-03-29 20:20:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17eaf36e-8d20-5ec5-9698-9d9c9287651e sending to next pipeline
2026-03-29 20:20:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 17eaf36e-8d20-5ec5-9698-9d9c9287651e, identifier: 20482913
2026-03-29 20:20:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 17eaf36e-8d20-5ec5-9698-9d9c9287651e with identifier: 20482913
2026-03-29 20:20:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 17eaf36e-8d20-5ec5-9698-9d9c9287651e with identifier: 20482913
2026-03-29 20:20:33 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 17eaf36e-8d20-5ec5-9698-9d9c9287651e with identifier: 20482913 to the API
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2913/20482913/exterior_front_passenger-1774703298876.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '17eaf36e-8d20-5ec5-9698-9d9c9287651e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GJ67 NDO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20482913',
'listing': 'auction',
'location': 'Kent Ashford',
'make': 'Audi',
'model': 'A5',
'odometer': 59785,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17eaf36e-8d20-5ec5-9698-9d9c9287651e/17eaf36e-8d20-5ec5-9698-9d9c9287651e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3033281,
'Height': 2987,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2913/20482913/exterior_front_driver-1774703246456.jpg',
'Width': 3982},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17eaf36e-8d20-5ec5-9698-9d9c9287651e/17eaf36e-8d20-5ec5-9698-9d9c9287651e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2836798,
'Height': 3013,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2913/20482913/exterior_rear_driver-1774703268495.jpg',
'Width': 4017},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17eaf36e-8d20-5ec5-9698-9d9c9287651e/17eaf36e-8d20-5ec5-9698-9d9c9287651e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3234743,
'Height': 2974,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2913/20482913/exterior_front_passenger-1774703298876.jpg',
'Width': 3965},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17eaf36e-8d20-5ec5-9698-9d9c9287651e/17eaf36e-8d20-5ec5-9698-9d9c9287651e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3130611,
'Height': 2904,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2913/20482913/exterior_rear_passenger-1774703292235.jpg',
'Width': 3872},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17eaf36e-8d20-5ec5-9698-9d9c9287651e/17eaf36e-8d20-5ec5-9698-9d9c9287651e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4928475,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2913/20482913/interior_front_seats-1774703892147.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17eaf36e-8d20-5ec5-9698-9d9c9287651e/17eaf36e-8d20-5ec5-9698-9d9c9287651e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4324699,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2913/20482913/interior_rear_seats-1774703897473.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17eaf36e-8d20-5ec5-9698-9d9c9287651e/17eaf36e-8d20-5ec5-9698-9d9c9287651e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3468346,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2913/20482913/interior_dashboard-1774703930174.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17eaf36e-8d20-5ec5-9698-9d9c9287651e/17eaf36e-8d20-5ec5-9698-9d9c9287651e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1476555,
'Height': 2537,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2913/20482913/20482913-instrument_cluster-modified-1774775127625.jpeg',
'Width': 3382},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17eaf36e-8d20-5ec5-9698-9d9c9287651e/17eaf36e-8d20-5ec5-9698-9d9c9287651e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4005041,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/2913/20482913/interior_boot-1774703940922.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17eaf36e-8d20-5ec5-9698-9d9c9287651e/17eaf36e-8d20-5ec5-9698-9d9c9287651e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73859,
'Height': 478,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/2913/20482913/20482913-damage_missing_trims-modified-1774775188932.jpeg',
'Width': 637}],
'price': 11989,
'price_includes_vat': False,
'registration_date': '2017-09-28',
'seats_number': None,
'seller_name': None,
'title': 'Audi A5 Sport TDI S-A',
'transmission': 'automatic',
'trim': 'Sport TDI S-A',
'vin': 'WAUZZZF54JA028526',
'year': 2017}
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720482913%27 HTTP/1.1" 200 None
2026-03-29 20:20:33 [motorway.uk] INFO: Saving data for 20482913: {'created_time': 1774815633.657051, 'last_price_update_time': 1774815633.657063, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20482913') HTTP/1.1" 204 0
2026-03-29 20:20:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20477842.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65837a2d0>
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec943335-e1ab-52d9-891e-1e096028e790/ec943335-e1ab-52d9-891e-1e096028e790_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5319%252F18975319%252Fexterior_front_passenger-1766666561612.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5319/18975319/exterior_front_passenger-1766666561612.jpeg saved to cache
2026-03-29 20:20:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ec943335-e1ab-52d9-891e-1e096028e790
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658439a50>
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec943335-e1ab-52d9-891e-1e096028e790/ec943335-e1ab-52d9-891e-1e096028e790_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5319%252F18975319%252Fexterior_rear_passenger-1766666577178.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5319/18975319/exterior_rear_passenger-1766666577178.jpeg saved to cache
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ec943335-e1ab-52d9-891e-1e096028e790
2026-03-29 20:20:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b12050>
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28e7e1b2-51a1-5bee-96a0-570115f216b9/28e7e1b2-51a1-5bee-96a0-570115f216b9_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0662%252F20500662%252Finterior_boot-1774778808471.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0662/20500662/interior_boot-1774778808471.jpg saved to cache
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 28e7e1b2-51a1-5bee-96a0-570115f216b9
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a77b90>
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec943335-e1ab-52d9-891e-1e096028e790/ec943335-e1ab-52d9-891e-1e096028e790_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5319%252F18975319%252Fexterior_rear_driver-1766666576899.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5319/18975319/exterior_rear_driver-1766666576899.jpeg saved to cache
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ec943335-e1ab-52d9-891e-1e096028e790
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b135d0>
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec943335-e1ab-52d9-891e-1e096028e790/ec943335-e1ab-52d9-891e-1e096028e790_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5319%252F18975319%252F18975319-interior_dashboard-modified-1766841237038.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5319/18975319/18975319-interior_dashboard-modified-1766841237038.jpeg saved to cache
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ec943335-e1ab-52d9-891e-1e096028e790
2026-03-29 20:20:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da3b98f4-f123-5909-90a5-a913fa121200 with identifier: 20477842
2026-03-29 20:20:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da3b98f4-f123-5909-90a5-a913fa121200 with scrape type 1
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item da3b98f4-f123-5909-90a5-a913fa121200
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7842%252F20477842%252Fexterior_front_driver-1774776796508.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7842/20477842/exterior_front_driver-1774776796508.jpg not downloaded yet
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7842%252F20477842%252Fexterior_rear_driver-1774776441881.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7842/20477842/exterior_rear_driver-1774776441881.jpg not downloaded yet
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7842%252F20477842%252Fexterior_front_passenger-1774776431227.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7842/20477842/exterior_front_passenger-1774776431227.jpg not downloaded yet
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7842%252F20477842%252Fexterior_rear_passenger-1774776430204.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7842/20477842/exterior_rear_passenger-1774776430204.jpg not downloaded yet
2026-03-29 20:20:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5319/18975319/18975319-exterior_front_driver-modified-1766841250609.jpeg> (referer: None)
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7842%252F20477842%252Finterior_front_seats-1774777841210.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7842/20477842/interior_front_seats-1774777841210.jpg not downloaded yet
2026-03-29 20:20:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0662/20500662/exterior_rear_passenger-1774785112778.jpg> (referer: None)
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7842%252F20477842%252Finterior_rear_seats-1774777835375.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7842/20477842/interior_rear_seats-1774777835375.jpg not downloaded yet
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7842%252F20477842%252Finterior_dashboard-1774777848527.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7842/20477842/interior_dashboard-1774777848527.jpg not downloaded yet
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7842%252F20477842%252Finstrument_cluster-1774777879355.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7842/20477842/instrument_cluster-1774777879355.jpg not downloaded yet
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65bc183d0>
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec943335-e1ab-52d9-891e-1e096028e790/ec943335-e1ab-52d9-891e-1e096028e790_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5319%252F18975319%252F18975319-exterior_front_driver-modified-1766841250609.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5319/18975319/18975319-exterior_front_driver-modified-1766841250609.jpeg saved to cache
2026-03-29 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec943335-e1ab-52d9-891e-1e096028e790
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7842%252F20477842%252Finterior_boot-1774777844482.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7842/20477842/interior_boot-1774777844482.jpg not downloaded yet
2026-03-29 20:20:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0662/20500662/interior_front_seats-1774785124828.jpg> (referer: None)
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7842%252F20477842%252Fdocs_service_history-1774778175971.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D90912236b2c95ebb5d1c9ec759637e95%27 HTTP/1.1" 200 None
2026-03-29 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7842/20477842/docs_service_history-1774778175971.jpg?ixlib=js-3.8.0&auto=format&s=90912236b2c95ebb5d1c9ec759637e95 not downloaded yet
2026-03-29 20:20:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0662/20500662/interior_rear_seats-1774785137593.jpg> (referer: None)
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c9fb50>
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28e7e1b2-51a1-5bee-96a0-570115f216b9/28e7e1b2-51a1-5bee-96a0-570115f216b9_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0662%252F20500662%252Fexterior_rear_passenger-1774785112778.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0662/20500662/exterior_rear_passenger-1774785112778.jpg saved to cache
2026-03-29 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 28e7e1b2-51a1-5bee-96a0-570115f216b9
2026-03-29 20:20:35 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://motorway-photos.imgix.net/5319/18975319/interior_front_seats-1766666592168.jpeg>.
2026-03-29 20:20:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0662/20500662/exterior_front_passenger-1774785097421.jpg> (referer: None)
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c9fbd0>
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28e7e1b2-51a1-5bee-96a0-570115f216b9/28e7e1b2-51a1-5bee-96a0-570115f216b9_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0662%252F20500662%252Finterior_front_seats-1774785124828.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0662/20500662/interior_front_seats-1774785124828.jpg saved to cache
2026-03-29 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 28e7e1b2-51a1-5bee-96a0-570115f216b9
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6580f9a90>
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28e7e1b2-51a1-5bee-96a0-570115f216b9/28e7e1b2-51a1-5bee-96a0-570115f216b9_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0662%252F20500662%252Finterior_rear_seats-1774785137593.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0662/20500662/interior_rear_seats-1774785137593.jpg saved to cache
2026-03-29 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 28e7e1b2-51a1-5bee-96a0-570115f216b9
2026-03-29 20:20:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0662/20500662/exterior_front_driver-1774778426954.jpg> (referer: None)
2026-03-29 20:20:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0662/20500662/exterior_rear_driver-1774778443336.jpg> (referer: None)
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a73210>
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28e7e1b2-51a1-5bee-96a0-570115f216b9/28e7e1b2-51a1-5bee-96a0-570115f216b9_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0662%252F20500662%252Fexterior_front_passenger-1774785097421.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0662/20500662/exterior_front_passenger-1774785097421.jpg saved to cache
2026-03-29 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 28e7e1b2-51a1-5bee-96a0-570115f216b9
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c9e790>
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28e7e1b2-51a1-5bee-96a0-570115f216b9/28e7e1b2-51a1-5bee-96a0-570115f216b9_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0662%252F20500662%252Fexterior_front_driver-1774778426954.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0662/20500662/exterior_front_driver-1774778426954.jpg saved to cache
2026-03-29 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 28e7e1b2-51a1-5bee-96a0-570115f216b9
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a22b50>
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28e7e1b2-51a1-5bee-96a0-570115f216b9/28e7e1b2-51a1-5bee-96a0-570115f216b9_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0662%252F20500662%252Fexterior_rear_driver-1774778443336.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0662/20500662/exterior_rear_driver-1774778443336.jpg saved to cache
2026-03-29 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 28e7e1b2-51a1-5bee-96a0-570115f216b9
2026-03-29 20:20:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 28e7e1b2-51a1-5bee-96a0-570115f216b9, skipping ID generation
2026-03-29 20:20:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28e7e1b2-51a1-5bee-96a0-570115f216b9 with scrape type 1
2026-03-29 20:20:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 28e7e1b2-51a1-5bee-96a0-570115f216b9 sending to next pipeline
2026-03-29 20:20:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 28e7e1b2-51a1-5bee-96a0-570115f216b9, identifier: 20500662
2026-03-29 20:20:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2519/20492519/interior_dashboard-1774717298839.jpg> (referer: None)
2026-03-29 20:20:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 28e7e1b2-51a1-5bee-96a0-570115f216b9 with identifier: 20500662
2026-03-29 20:20:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 28e7e1b2-51a1-5bee-96a0-570115f216b9 with identifier: 20500662
2026-03-29 20:20:36 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 28e7e1b2-51a1-5bee-96a0-570115f216b9 with identifier: 20500662 to the API
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0662/20500662/exterior_rear_driver-1774778443336.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '28e7e1b2-51a1-5bee-96a0-570115f216b9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'EA14 DYJ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20500662',
'listing': 'auction',
'location': 'Greater London London',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 59000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28e7e1b2-51a1-5bee-96a0-570115f216b9/28e7e1b2-51a1-5bee-96a0-570115f216b9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1320474,
'Height': 2418,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0662/20500662/exterior_front_driver-1774778426954.jpg',
'Width': 3224},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28e7e1b2-51a1-5bee-96a0-570115f216b9/28e7e1b2-51a1-5bee-96a0-570115f216b9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 916314,
'Height': 2145,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0662/20500662/exterior_rear_driver-1774778443336.jpg',
'Width': 2860},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28e7e1b2-51a1-5bee-96a0-570115f216b9/28e7e1b2-51a1-5bee-96a0-570115f216b9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1558228,
'Height': 2272,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0662/20500662/exterior_front_passenger-1774785097421.jpg',
'Width': 3029},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28e7e1b2-51a1-5bee-96a0-570115f216b9/28e7e1b2-51a1-5bee-96a0-570115f216b9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1967379,
'Height': 2552,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0662/20500662/exterior_rear_passenger-1774785112778.jpg',
'Width': 3403},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28e7e1b2-51a1-5bee-96a0-570115f216b9/28e7e1b2-51a1-5bee-96a0-570115f216b9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2804729,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0662/20500662/interior_front_seats-1774785124828.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28e7e1b2-51a1-5bee-96a0-570115f216b9/28e7e1b2-51a1-5bee-96a0-570115f216b9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2190785,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0662/20500662/interior_rear_seats-1774785137593.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28e7e1b2-51a1-5bee-96a0-570115f216b9/28e7e1b2-51a1-5bee-96a0-570115f216b9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2078193,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0662/20500662/interior_dashboard-1774785173448.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28e7e1b2-51a1-5bee-96a0-570115f216b9/28e7e1b2-51a1-5bee-96a0-570115f216b9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3720062,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0662/20500662/interior_boot-1774778808471.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28e7e1b2-51a1-5bee-96a0-570115f216b9/28e7e1b2-51a1-5bee-96a0-570115f216b9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1931496,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0662/20500662/damage_dents-1774778503593.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28e7e1b2-51a1-5bee-96a0-570115f216b9/28e7e1b2-51a1-5bee-96a0-570115f216b9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 236482,
'Height': 1140,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0662/20500662/damage_missing_trims-1774783978205.jpg',
'Width': 1520}],
'price': 2975,
'price_includes_vat': False,
'registration_date': '2014-05-29',
'seats_number': None,
'seller_name': None,
'title': 'Ford Fiesta Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'vin': 'WF0DXXGAKDEJ41144',
'year': 2014}
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720500662%27 HTTP/1.1" 200 None
2026-03-29 20:20:36 [motorway.uk] INFO: Saving data for 20500662: {'created_time': 1774815636.381362, 'last_price_update_time': 1774815636.381376, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20500662') HTTP/1.1" 204 0
2026-03-29 20:20:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2519/20492519/interior_front_seats-1774717278622.jpg> (referer: None)
2026-03-29 20:20:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2519/20492519/interior_rear_seats-1774717275942.jpg> (referer: None)
2026-03-29 20:20:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65852c790>
2026-03-29 20:20:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32/7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2519%252F20492519%252Finterior_dashboard-1774717298839.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2519/20492519/interior_dashboard-1774717298839.jpg saved to cache
2026-03-29 20:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32
2026-03-29 20:20:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2519/20492519/instrument_cluster-1774717315935.jpg> (referer: None)
2026-03-29 20:20:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584459d0>
2026-03-29 20:20:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32/7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2519%252F20492519%252Finterior_front_seats-1774717278622.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2519/20492519/interior_front_seats-1774717278622.jpg saved to cache
2026-03-29 20:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32
2026-03-29 20:20:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65836e150>
2026-03-29 20:20:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32/7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2519%252F20492519%252Finterior_rear_seats-1774717275942.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2519/20492519/interior_rear_seats-1774717275942.jpg saved to cache
2026-03-29 20:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32
2026-03-29 20:20:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659075450>
2026-03-29 20:20:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32/7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2519%252F20492519%252Finstrument_cluster-1774717315935.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2519/20492519/instrument_cluster-1774717315935.jpg saved to cache
2026-03-29 20:20:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32
2026-03-29 20:20:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7842/20477842/exterior_rear_passenger-1774776430204.jpg> (referer: None)
2026-03-29 20:20:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/7842/20477842/docs_service_history-1774778175971.jpg?ixlib=js-3.8.0&auto=format&s=90912236b2c95ebb5d1c9ec759637e95> (referer: None)
2026-03-29 20:20:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7842/20477842/instrument_cluster-1774777879355.jpg> (referer: None)
2026-03-29 20:20:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7842/20477842/exterior_front_passenger-1774776431227.jpg> (referer: None)
2026-03-29 20:20:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7842/20477842/interior_rear_seats-1774777835375.jpg> (referer: None)
2026-03-29 20:20:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7842/20477842/interior_front_seats-1774777841210.jpg> (referer: None)
2026-03-29 20:20:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7842/20477842/interior_dashboard-1774777848527.jpg> (referer: None)
2026-03-29 20:20:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7842/20477842/exterior_front_driver-1774776796508.jpg> (referer: None)
2026-03-29 20:20:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7842/20477842/interior_boot-1774777844482.jpg> (referer: None)
2026-03-29 20:20:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5319/18975319/interior_front_seats-1766666592168.jpeg> (referer: None)
2026-03-29 20:20:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7842/20477842/exterior_rear_driver-1774776441881.jpg> (referer: None)
2026-03-29 20:20:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2519/20492519/exterior_rear_passenger-1774716648197.jpg> (referer: None)
2026-03-29 20:20:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bcdd50>
2026-03-29 20:20:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da3b98f4-f123-5909-90a5-a913fa121200/da3b98f4-f123-5909-90a5-a913fa121200_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7842%252F20477842%252Fexterior_rear_passenger-1774776430204.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7842/20477842/exterior_rear_passenger-1774776430204.jpg saved to cache
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item da3b98f4-f123-5909-90a5-a913fa121200
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf2ef50>
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da3b98f4-f123-5909-90a5-a913fa121200/da3b98f4-f123-5909-90a5-a913fa121200_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F7842%252F20477842%252Fdocs_service_history-1774778175971.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D90912236b2c95ebb5d1c9ec759637e95') HTTP/1.1" 204 0
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/7842/20477842/docs_service_history-1774778175971.jpg?ixlib=js-3.8.0&auto=format&s=90912236b2c95ebb5d1c9ec759637e95 saved to cache
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item da3b98f4-f123-5909-90a5-a913fa121200
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589c78d0>
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da3b98f4-f123-5909-90a5-a913fa121200/da3b98f4-f123-5909-90a5-a913fa121200_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7842%252F20477842%252Finstrument_cluster-1774777879355.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7842/20477842/instrument_cluster-1774777879355.jpg saved to cache
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item da3b98f4-f123-5909-90a5-a913fa121200
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be406d0>
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da3b98f4-f123-5909-90a5-a913fa121200/da3b98f4-f123-5909-90a5-a913fa121200_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7842%252F20477842%252Fexterior_front_passenger-1774776431227.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7842/20477842/exterior_front_passenger-1774776431227.jpg saved to cache
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item da3b98f4-f123-5909-90a5-a913fa121200
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c48d50>
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da3b98f4-f123-5909-90a5-a913fa121200/da3b98f4-f123-5909-90a5-a913fa121200_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7842%252F20477842%252Finterior_rear_seats-1774777835375.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7842/20477842/interior_rear_seats-1774777835375.jpg saved to cache
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item da3b98f4-f123-5909-90a5-a913fa121200
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589c4350>
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da3b98f4-f123-5909-90a5-a913fa121200/da3b98f4-f123-5909-90a5-a913fa121200_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7842%252F20477842%252Finterior_front_seats-1774777841210.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7842/20477842/interior_front_seats-1774777841210.jpg saved to cache
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item da3b98f4-f123-5909-90a5-a913fa121200
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583ee810>
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da3b98f4-f123-5909-90a5-a913fa121200/da3b98f4-f123-5909-90a5-a913fa121200_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7842%252F20477842%252Finterior_dashboard-1774777848527.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7842/20477842/interior_dashboard-1774777848527.jpg saved to cache
2026-03-29 20:20:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item da3b98f4-f123-5909-90a5-a913fa121200
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be40410>
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da3b98f4-f123-5909-90a5-a913fa121200/da3b98f4-f123-5909-90a5-a913fa121200_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7842%252F20477842%252Fexterior_front_driver-1774776796508.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7842/20477842/exterior_front_driver-1774776796508.jpg saved to cache
2026-03-29 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da3b98f4-f123-5909-90a5-a913fa121200
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be43050>
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da3b98f4-f123-5909-90a5-a913fa121200/da3b98f4-f123-5909-90a5-a913fa121200_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7842%252F20477842%252Finterior_boot-1774777844482.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7842/20477842/interior_boot-1774777844482.jpg saved to cache
2026-03-29 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item da3b98f4-f123-5909-90a5-a913fa121200
2026-03-29 20:20:38 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:20:38 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:20:38 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\xdf\x106\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\t\xcd=\x00\xdf\x06J\x00\x00\x00\x00'
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589c6e10>
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec943335-e1ab-52d9-891e-1e096028e790/ec943335-e1ab-52d9-891e-1e096028e790_image_4.mpo HTTP/1.1" 201 0
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5319%252F18975319%252Finterior_front_seats-1766666592168.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5319/18975319/interior_front_seats-1766666592168.jpeg saved to cache
2026-03-29 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ec943335-e1ab-52d9-891e-1e096028e790
2026-03-29 20:20:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec943335-e1ab-52d9-891e-1e096028e790, skipping ID generation
2026-03-29 20:20:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec943335-e1ab-52d9-891e-1e096028e790 with scrape type 1
2026-03-29 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec943335-e1ab-52d9-891e-1e096028e790 sending to next pipeline
2026-03-29 20:20:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ec943335-e1ab-52d9-891e-1e096028e790, identifier: 18975319
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65836d2d0>
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da3b98f4-f123-5909-90a5-a913fa121200/da3b98f4-f123-5909-90a5-a913fa121200_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7842%252F20477842%252Fexterior_rear_driver-1774776441881.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7842/20477842/exterior_rear_driver-1774776441881.jpg saved to cache
2026-03-29 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item da3b98f4-f123-5909-90a5-a913fa121200
2026-03-29 20:20:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da3b98f4-f123-5909-90a5-a913fa121200, skipping ID generation
2026-03-29 20:20:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da3b98f4-f123-5909-90a5-a913fa121200 with scrape type 1
2026-03-29 20:20:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da3b98f4-f123-5909-90a5-a913fa121200 sending to next pipeline
2026-03-29 20:20:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: da3b98f4-f123-5909-90a5-a913fa121200, identifier: 20477842
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d7c510>
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32/7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2519%252F20492519%252Fexterior_rear_passenger-1774716648197.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2519/20492519/exterior_rear_passenger-1774716648197.jpg saved to cache
2026-03-29 20:20:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32
2026-03-29 20:20:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ec943335-e1ab-52d9-891e-1e096028e790 with identifier: 18975319
2026-03-29 20:20:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ec943335-e1ab-52d9-891e-1e096028e790 with identifier: 18975319
2026-03-29 20:20:39 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ec943335-e1ab-52d9-891e-1e096028e790 with identifier: 18975319 to the API
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/5319/18975319/interior_front_seats-1766666592168.jpeg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'ec943335-e1ab-52d9-891e-1e096028e790',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'H23 UDS',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18975319',
'listing': 'auction',
'location': 'None None',
'make': 'BMW',
'model': '5 Series',
'odometer': 87329,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec943335-e1ab-52d9-891e-1e096028e790/ec943335-e1ab-52d9-891e-1e096028e790_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 9081316,
'Height': 5725,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5319/18975319/18975319-exterior_front_driver-modified-1766841250609.jpeg',
'Width': 7633},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec943335-e1ab-52d9-891e-1e096028e790/ec943335-e1ab-52d9-891e-1e096028e790_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5024974,
'Height': 4909,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5319/18975319/exterior_rear_driver-1766666576899.jpeg',
'Width': 6545},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec943335-e1ab-52d9-891e-1e096028e790/ec943335-e1ab-52d9-891e-1e096028e790_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3726387,
'Height': 5540,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5319/18975319/exterior_front_passenger-1766666561612.jpeg',
'Width': 7387},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec943335-e1ab-52d9-891e-1e096028e790/ec943335-e1ab-52d9-891e-1e096028e790_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4026859,
'Height': 4672,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5319/18975319/exterior_rear_passenger-1766666577178.jpeg',
'Width': 6229},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec943335-e1ab-52d9-891e-1e096028e790/ec943335-e1ab-52d9-891e-1e096028e790_image_4.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 15261043,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/5319/18975319/interior_front_seats-1766666592168.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec943335-e1ab-52d9-891e-1e096028e790/ec943335-e1ab-52d9-891e-1e096028e790_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 12142745,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/5319/18975319/interior_rear_seats-1766665984684.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec943335-e1ab-52d9-891e-1e096028e790/ec943335-e1ab-52d9-891e-1e096028e790_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7237911,
'Height': 6048,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/5319/18975319/18975319-interior_dashboard-modified-1766841237038.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec943335-e1ab-52d9-891e-1e096028e790/ec943335-e1ab-52d9-891e-1e096028e790_image_7.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 8632850,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/5319/18975319/instrument_cluster-1766666901145.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec943335-e1ab-52d9-891e-1e096028e790/ec943335-e1ab-52d9-891e-1e096028e790_image_8.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 13355884,
'Height': 6048,
'OriginUrl': 'https://motorway-photos.imgix.net/5319/18975319/interior_boot-1766666605701.jpeg',
'Width': 8064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec943335-e1ab-52d9-891e-1e096028e790/ec943335-e1ab-52d9-891e-1e096028e790_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1523801,
'Height': 2383,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/5319/18975319/18975319-docs_service_history-modified-1766841535465.jpeg?ixlib=js-3.8.0&auto=format&s=6253a8760a9620632acd8ec46f4a4a68',
'Width': 3178}],
'price': 14834,
'price_includes_vat': False,
'registration_date': '2018-03-29',
'seats_number': None,
'seller_name': None,
'title': 'BMW 530D xDrive M Sport Auto',
'transmission': 'automatic',
'trim': '530D xDrive M Sport Auto',
'vin': 'WBAJD12000B086102',
'year': 2018}
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718975319%27 HTTP/1.1" 200 None
2026-03-29 20:20:39 [motorway.uk] INFO: Saving data for 18975319: {'created_time': 1774815639.436031, 'last_price_update_time': 1774815639.436044, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18975319') HTTP/1.1" 204 0
2026-03-29 20:20:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: da3b98f4-f123-5909-90a5-a913fa121200 with identifier: 20477842
2026-03-29 20:20:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: da3b98f4-f123-5909-90a5-a913fa121200 with identifier: 20477842
2026-03-29 20:20:39 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: da3b98f4-f123-5909-90a5-a913fa121200 with identifier: 20477842 to the API
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7842/20477842/exterior_rear_driver-1774776441881.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.1L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'da3b98f4-f123-5909-90a5-a913fa121200',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KR65 WDZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20477842',
'listing': 'auction',
'location': 'West Midlands Kingswinford',
'make': 'Mercedes',
'model': 'GLA',
'odometer': 86250,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da3b98f4-f123-5909-90a5-a913fa121200/da3b98f4-f123-5909-90a5-a913fa121200_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1971295,
'Height': 2649,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7842/20477842/exterior_front_driver-1774776796508.jpg',
'Width': 3532},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da3b98f4-f123-5909-90a5-a913fa121200/da3b98f4-f123-5909-90a5-a913fa121200_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1862477,
'Height': 2664,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7842/20477842/exterior_rear_driver-1774776441881.jpg',
'Width': 3552},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da3b98f4-f123-5909-90a5-a913fa121200/da3b98f4-f123-5909-90a5-a913fa121200_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1314073,
'Height': 2436,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7842/20477842/exterior_front_passenger-1774776431227.jpg',
'Width': 3248},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da3b98f4-f123-5909-90a5-a913fa121200/da3b98f4-f123-5909-90a5-a913fa121200_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1170651,
'Height': 2194,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7842/20477842/exterior_rear_passenger-1774776430204.jpg',
'Width': 2925},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da3b98f4-f123-5909-90a5-a913fa121200/da3b98f4-f123-5909-90a5-a913fa121200_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2230800,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7842/20477842/interior_front_seats-1774777841210.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da3b98f4-f123-5909-90a5-a913fa121200/da3b98f4-f123-5909-90a5-a913fa121200_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2042142,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7842/20477842/interior_rear_seats-1774777835375.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da3b98f4-f123-5909-90a5-a913fa121200/da3b98f4-f123-5909-90a5-a913fa121200_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2332429,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7842/20477842/interior_dashboard-1774777848527.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da3b98f4-f123-5909-90a5-a913fa121200/da3b98f4-f123-5909-90a5-a913fa121200_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1817749,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7842/20477842/instrument_cluster-1774777879355.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da3b98f4-f123-5909-90a5-a913fa121200/da3b98f4-f123-5909-90a5-a913fa121200_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2550370,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/7842/20477842/interior_boot-1774777844482.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da3b98f4-f123-5909-90a5-a913fa121200/da3b98f4-f123-5909-90a5-a913fa121200_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1567133,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/7842/20477842/docs_service_history-1774778175971.jpg?ixlib=js-3.8.0&auto=format&s=90912236b2c95ebb5d1c9ec759637e95',
'Width': 3840}],
'price': 8496,
'price_includes_vat': False,
'registration_date': '2015-11-27',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes GLA 220 D 4MAT AMG Line PREM+A',
'transmission': 'automatic',
'trim': '220 D 4MAT AMG Line PREM+A',
'vin': 'WDC1569052J211003',
'year': 2015}
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720477842%27 HTTP/1.1" 200 None
2026-03-29 20:20:39 [motorway.uk] INFO: Saving data for 20477842: {'created_time': 1774815639.837764, 'last_price_update_time': 1774815639.837774, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20477842') HTTP/1.1" 204 0
2026-03-29 20:20:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2519/20492519/exterior_rear_driver-1774716655292.jpg> (referer: None)
2026-03-29 20:20:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2519/20492519/exterior_front_passenger-1774716644137.jpg> (referer: None)
2026-03-29 20:20:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658714950>
2026-03-29 20:20:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32/7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2519%252F20492519%252Fexterior_rear_driver-1774716655292.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2519/20492519/exterior_rear_driver-1774716655292.jpg saved to cache
2026-03-29 20:20:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32
2026-03-29 20:20:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ca6d50>
2026-03-29 20:20:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32/7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2519%252F20492519%252Fexterior_front_passenger-1774716644137.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2519/20492519/exterior_front_passenger-1774716644137.jpg saved to cache
2026-03-29 20:20:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32
2026-03-29 20:20:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3462/5963462/exterior_front_driver-1774631676406.jpg> (referer: None)
2026-03-29 20:20:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2519/20492519/exterior_front_driver-1774716652340.jpg> (referer: None)
2026-03-29 20:20:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3462/5963462/exterior_rear_passenger-1774631674289.jpg> (referer: None)
2026-03-29 20:20:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3462/5963462/interior_dashboard-1774632542791.jpg> (referer: None)
2026-03-29 20:20:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3462/5963462/exterior_front_passenger-1774631672782.jpg> (referer: None)
2026-03-29 20:20:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3462/5963462/interior_front_seats-1774632509656.jpg> (referer: None)
2026-03-29 20:20:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658129b50>
2026-03-29 20:20:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f3972eb-b81b-57dd-bb4c-b112b97d7b48/3f3972eb-b81b-57dd-bb4c-b112b97d7b48_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3462%252F5963462%252Fexterior_front_driver-1774631676406.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3462/5963462/exterior_front_driver-1774631676406.jpg saved to cache
2026-03-29 20:20:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f3972eb-b81b-57dd-bb4c-b112b97d7b48
2026-03-29 20:20:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3462/5963462/instrument_cluster-1774632590425.jpg> (referer: None)
2026-03-29 20:20:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b5b650>
2026-03-29 20:20:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32/7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2519%252F20492519%252Fexterior_front_driver-1774716652340.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2519/20492519/exterior_front_driver-1774716652340.jpg saved to cache
2026-03-29 20:20:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32
2026-03-29 20:20:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32, skipping ID generation
2026-03-29 20:20:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32 with scrape type 1
2026-03-29 20:20:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32 sending to next pipeline
2026-03-29 20:20:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32, identifier: 20492519
2026-03-29 20:20:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658714e10>
2026-03-29 20:20:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f3972eb-b81b-57dd-bb4c-b112b97d7b48/3f3972eb-b81b-57dd-bb4c-b112b97d7b48_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3462%252F5963462%252Fexterior_rear_passenger-1774631674289.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3462/5963462/exterior_rear_passenger-1774631674289.jpg saved to cache
2026-03-29 20:20:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f3972eb-b81b-57dd-bb4c-b112b97d7b48
2026-03-29 20:20:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658dd6dd0>
2026-03-29 20:20:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f3972eb-b81b-57dd-bb4c-b112b97d7b48/3f3972eb-b81b-57dd-bb4c-b112b97d7b48_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3462%252F5963462%252Finterior_dashboard-1774632542791.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3462/5963462/interior_dashboard-1774632542791.jpg saved to cache
2026-03-29 20:20:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3f3972eb-b81b-57dd-bb4c-b112b97d7b48
2026-03-29 20:20:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c27650>
2026-03-29 20:20:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f3972eb-b81b-57dd-bb4c-b112b97d7b48/3f3972eb-b81b-57dd-bb4c-b112b97d7b48_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3462%252F5963462%252Fexterior_front_passenger-1774631672782.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3462/5963462/exterior_front_passenger-1774631672782.jpg saved to cache
2026-03-29 20:20:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f3972eb-b81b-57dd-bb4c-b112b97d7b48
2026-03-29 20:20:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f86d10>
2026-03-29 20:20:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f3972eb-b81b-57dd-bb4c-b112b97d7b48/3f3972eb-b81b-57dd-bb4c-b112b97d7b48_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3462%252F5963462%252Finterior_front_seats-1774632509656.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3462/5963462/interior_front_seats-1774632509656.jpg saved to cache
2026-03-29 20:20:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f3972eb-b81b-57dd-bb4c-b112b97d7b48
2026-03-29 20:20:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32 with identifier: 20492519
2026-03-29 20:20:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32 with identifier: 20492519
2026-03-29 20:20:41 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32 with identifier: 20492519 to the API
2026-03-29 20:20:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2519/20492519/exterior_front_driver-1774716652340.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FG68 FNN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20492519',
'listing': 'auction',
'location': 'Nottinghamshire Mansfield',
'make': 'Hyundai',
'model': 'I10',
'odometer': 85639,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32/7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 985074,
'Height': 2185,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2519/20492519/exterior_front_driver-1774716652340.jpg',
'Width': 2913},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32/7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 770189,
'Height': 2150,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2519/20492519/exterior_rear_driver-1774716655292.jpg',
'Width': 2867},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32/7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 890422,
'Height': 2392,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2519/20492519/exterior_front_passenger-1774716644137.jpg',
'Width': 3189},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32/7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 751518,
'Height': 2231,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2519/20492519/exterior_rear_passenger-1774716648197.jpg',
'Width': 2975},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32/7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1210978,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/2519/20492519/interior_front_seats-1774717278622.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32/7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1267499,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/2519/20492519/interior_rear_seats-1774717275942.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32/7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1073476,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2519/20492519/interior_dashboard-1774717298839.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32/7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1381007,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2519/20492519/instrument_cluster-1774717315935.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32/7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1486724,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/2519/20492519/interior_boot-1774717282196.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32/7dc1e8cd-2bbd-5c92-83a7-0a93f7364d32_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1056483,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2519/20492519/docs_service_history-1774719742585.jpg?ixlib=js-3.8.0&auto=format&s=dae548383dfea88d5d733518cc5c3c37',
'Width': 3840}],
'price': 3489,
'price_includes_vat': False,
'registration_date': '2018-09-28',
'seats_number': None,
'seller_name': None,
'title': 'Hyundai I10 GO SE',
'transmission': 'manual',
'trim': 'GO SE',
'vin': 'NLHA851ALKZ464120',
'year': 2018}
2026-03-29 20:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720492519%27 HTTP/1.1" 200 None
2026-03-29 20:20:41 [motorway.uk] INFO: Saving data for 20492519: {'created_time': 1774815641.427308, 'last_price_update_time': 1774815641.427329, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20492519') HTTP/1.1" 204 0
2026-03-29 20:20:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a265d0>
2026-03-29 20:20:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f3972eb-b81b-57dd-bb4c-b112b97d7b48/3f3972eb-b81b-57dd-bb4c-b112b97d7b48_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3462%252F5963462%252Finstrument_cluster-1774632590425.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3462/5963462/instrument_cluster-1774632590425.jpg saved to cache
2026-03-29 20:20:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3f3972eb-b81b-57dd-bb4c-b112b97d7b48
2026-03-29 20:20:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3462/5963462/exterior_rear_driver-1774631681088.jpg> (referer: None)
2026-03-29 20:20:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9987/20419987/instrument_cluster-1774601153561.jpg> (referer: None)
2026-03-29 20:20:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9987/20419987/interior_dashboard-1774601043825.jpg> (referer: None)
2026-03-29 20:20:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9987/20419987/interior_boot-1774601025674.jpg> (referer: None)
2026-03-29 20:20:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9987/20419987/interior_front_seats-1774601021421.jpg> (referer: None)
2026-03-29 20:20:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9987/20419987/interior_rear_seats-1774601022981.jpg> (referer: None)
2026-03-29 20:20:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6588456d0>
2026-03-29 20:20:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f3972eb-b81b-57dd-bb4c-b112b97d7b48/3f3972eb-b81b-57dd-bb4c-b112b97d7b48_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3462%252F5963462%252Fexterior_rear_driver-1774631681088.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3462/5963462/exterior_rear_driver-1774631681088.jpg saved to cache
2026-03-29 20:20:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f3972eb-b81b-57dd-bb4c-b112b97d7b48
2026-03-29 20:20:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f3972eb-b81b-57dd-bb4c-b112b97d7b48, skipping ID generation
2026-03-29 20:20:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f3972eb-b81b-57dd-bb4c-b112b97d7b48 with scrape type 1
2026-03-29 20:20:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f3972eb-b81b-57dd-bb4c-b112b97d7b48 sending to next pipeline
2026-03-29 20:20:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 3f3972eb-b81b-57dd-bb4c-b112b97d7b48, identifier: 5963462
2026-03-29 20:20:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 3f3972eb-b81b-57dd-bb4c-b112b97d7b48 with identifier: 5963462
2026-03-29 20:20:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 3f3972eb-b81b-57dd-bb4c-b112b97d7b48 with identifier: 5963462
2026-03-29 20:20:41 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 3f3972eb-b81b-57dd-bb4c-b112b97d7b48 with identifier: 5963462 to the API
2026-03-29 20:20:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3462/5963462/exterior_rear_driver-1774631681088.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '3f3972eb-b81b-57dd-bb4c-b112b97d7b48',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YB65 WRN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/5963462',
'listing': 'auction',
'location': 'North Yorkshire York',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 107868,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3972eb-b81b-57dd-bb4c-b112b97d7b48/3f3972eb-b81b-57dd-bb4c-b112b97d7b48_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1383277,
'Height': 2556,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3462/5963462/exterior_front_driver-1774631676406.jpg',
'Width': 3408},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3972eb-b81b-57dd-bb4c-b112b97d7b48/3f3972eb-b81b-57dd-bb4c-b112b97d7b48_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1385643,
'Height': 2779,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3462/5963462/exterior_rear_driver-1774631681088.jpg',
'Width': 3705},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3972eb-b81b-57dd-bb4c-b112b97d7b48/3f3972eb-b81b-57dd-bb4c-b112b97d7b48_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1478707,
'Height': 2720,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3462/5963462/exterior_front_passenger-1774631672782.jpg',
'Width': 3627},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3972eb-b81b-57dd-bb4c-b112b97d7b48/3f3972eb-b81b-57dd-bb4c-b112b97d7b48_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1005779,
'Height': 2732,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3462/5963462/exterior_rear_passenger-1774631674289.jpg',
'Width': 3643},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3972eb-b81b-57dd-bb4c-b112b97d7b48/3f3972eb-b81b-57dd-bb4c-b112b97d7b48_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1665579,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/3462/5963462/interior_front_seats-1774632509656.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3972eb-b81b-57dd-bb4c-b112b97d7b48/3f3972eb-b81b-57dd-bb4c-b112b97d7b48_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1673894,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3462/5963462/interior_dashboard-1774632542791.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3972eb-b81b-57dd-bb4c-b112b97d7b48/3f3972eb-b81b-57dd-bb4c-b112b97d7b48_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1645266,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3462/5963462/instrument_cluster-1774632590425.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3972eb-b81b-57dd-bb4c-b112b97d7b48/3f3972eb-b81b-57dd-bb4c-b112b97d7b48_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1870790,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/3462/5963462/interior_boot-1774635787913.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3972eb-b81b-57dd-bb4c-b112b97d7b48/3f3972eb-b81b-57dd-bb4c-b112b97d7b48_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1581584,
'Height': 2883,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3462/5963462/docs_service_history-1774632802087.jpg?ixlib=js-3.8.0&auto=format&s=89bbd9f13fa5e26449d1daa1b493a866',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f3972eb-b81b-57dd-bb4c-b112b97d7b48/3f3972eb-b81b-57dd-bb4c-b112b97d7b48_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1577608,
'Height': 2883,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3462/5963462/docs_service_history-1774632814864.jpg?ixlib=js-3.8.0&auto=format&s=240a2a286f6fa2e2c62c445ef5cc4961',
'Width': 3840}],
'price': 6155,
'price_includes_vat': False,
'registration_date': '2016-01-08',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Caddy C20 Highline TDI',
'transmission': 'manual',
'trim': 'C20 Highline TDI',
'vin': 'WV1ZZZ2KZGX071752',
'year': 2016}
2026-03-29 20:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%275963462%27 HTTP/1.1" 200 None
2026-03-29 20:20:42 [motorway.uk] INFO: Saving data for 5963462: {'created_time': 1774815642.258576, 'last_price_update_time': 1774815642.25859, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='5963462') HTTP/1.1" 204 0
2026-03-29 20:20:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b62110>
2026-03-29 20:20:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1238faff-06b0-5b59-899a-f2c4a26dbdca/1238faff-06b0-5b59-899a-f2c4a26dbdca_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9987%252F20419987%252Finstrument_cluster-1774601153561.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9987/20419987/instrument_cluster-1774601153561.jpg saved to cache
2026-03-29 20:20:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1238faff-06b0-5b59-899a-f2c4a26dbdca
2026-03-29 20:20:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e3fdd0>
2026-03-29 20:20:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1238faff-06b0-5b59-899a-f2c4a26dbdca/1238faff-06b0-5b59-899a-f2c4a26dbdca_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9987%252F20419987%252Finterior_dashboard-1774601043825.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9987/20419987/interior_dashboard-1774601043825.jpg saved to cache
2026-03-29 20:20:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1238faff-06b0-5b59-899a-f2c4a26dbdca
2026-03-29 20:20:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65812b650>
2026-03-29 20:20:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1238faff-06b0-5b59-899a-f2c4a26dbdca/1238faff-06b0-5b59-899a-f2c4a26dbdca_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9987%252F20419987%252Finterior_boot-1774601025674.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9987/20419987/interior_boot-1774601025674.jpg saved to cache
2026-03-29 20:20:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1238faff-06b0-5b59-899a-f2c4a26dbdca
2026-03-29 20:20:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a25ad0>
2026-03-29 20:20:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1238faff-06b0-5b59-899a-f2c4a26dbdca/1238faff-06b0-5b59-899a-f2c4a26dbdca_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9987%252F20419987%252Finterior_front_seats-1774601021421.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9987/20419987/interior_front_seats-1774601021421.jpg saved to cache
2026-03-29 20:20:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1238faff-06b0-5b59-899a-f2c4a26dbdca
2026-03-29 20:20:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b596d0>
2026-03-29 20:20:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1238faff-06b0-5b59-899a-f2c4a26dbdca/1238faff-06b0-5b59-899a-f2c4a26dbdca_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9987%252F20419987%252Finterior_rear_seats-1774601022981.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9987/20419987/interior_rear_seats-1774601022981.jpg saved to cache
2026-03-29 20:20:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1238faff-06b0-5b59-899a-f2c4a26dbdca
2026-03-29 20:20:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19242613.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20455511.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9987/20419987/exterior_rear_driver-1774601115435.jpg> (referer: None)
2026-03-29 20:20:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9987/20419987/exterior_front_passenger-1774601117623.jpg> (referer: None)
2026-03-29 20:20:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9987/20419987/exterior_rear_passenger-1774601118068.jpg> (referer: None)
2026-03-29 20:20:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3857/20473857/docs_service_history-1774624645310.jpg?ixlib=js-3.8.0&auto=format&s=7401b8786be346cbfe0ab0efcde2111a> (referer: None)
2026-03-29 20:20:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3857/20473857/interior_boot-1774623926053.jpg> (referer: None)
2026-03-29 20:20:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0283e2d-040e-5bc6-9eae-3df2812b73c3 with identifier: 19242613
2026-03-29 20:20:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0283e2d-040e-5bc6-9eae-3df2812b73c3 with scrape type 1
2026-03-29 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d0283e2d-040e-5bc6-9eae-3df2812b73c3
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2613%252F19242613%252Fexterior_front_driver-1774698256291.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2613/19242613/exterior_front_driver-1774698256291.jpg not downloaded yet
2026-03-29 20:20:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5de3339e-7cc6-5d72-b214-40e14e6138d6 with identifier: 20455511
2026-03-29 20:20:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5de3339e-7cc6-5d72-b214-40e14e6138d6 with scrape type 1
2026-03-29 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5de3339e-7cc6-5d72-b214-40e14e6138d6
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5511%252F20455511%252Fexterior_front_driver-1774627955981.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5511/20455511/exterior_front_driver-1774627955981.jpg not downloaded yet
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2613%252F19242613%252Fexterior_rear_driver-1774698224384.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2613/19242613/exterior_rear_driver-1774698224384.jpg not downloaded yet
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5511%252F20455511%252Fexterior_rear_driver-1774627976885.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5511/20455511/exterior_rear_driver-1774627976885.jpg not downloaded yet
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2613%252F19242613%252Fexterior_front_passenger-1774698183348.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2613/19242613/exterior_front_passenger-1774698183348.jpg not downloaded yet
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5511%252F20455511%252Fexterior_front_passenger-1774628028832.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5511/20455511/exterior_front_passenger-1774628028832.jpg not downloaded yet
2026-03-29 20:20:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a7cdd0>
2026-03-29 20:20:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1238faff-06b0-5b59-899a-f2c4a26dbdca/1238faff-06b0-5b59-899a-f2c4a26dbdca_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9987%252F20419987%252Fexterior_rear_driver-1774601115435.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9987/20419987/exterior_rear_driver-1774601115435.jpg saved to cache
2026-03-29 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1238faff-06b0-5b59-899a-f2c4a26dbdca
2026-03-29 20:20:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a7cdd0>
2026-03-29 20:20:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1238faff-06b0-5b59-899a-f2c4a26dbdca/1238faff-06b0-5b59-899a-f2c4a26dbdca_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9987%252F20419987%252Fexterior_front_passenger-1774601117623.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9987/20419987/exterior_front_passenger-1774601117623.jpg saved to cache
2026-03-29 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1238faff-06b0-5b59-899a-f2c4a26dbdca
2026-03-29 20:20:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659aff690>
2026-03-29 20:20:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1238faff-06b0-5b59-899a-f2c4a26dbdca/1238faff-06b0-5b59-899a-f2c4a26dbdca_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9987%252F20419987%252Fexterior_rear_passenger-1774601118068.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9987/20419987/exterior_rear_passenger-1774601118068.jpg saved to cache
2026-03-29 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1238faff-06b0-5b59-899a-f2c4a26dbdca
2026-03-29 20:20:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e6c510>
2026-03-29 20:20:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87da71cb-f8e3-5bf8-b845-0b2cc69d69e3/87da71cb-f8e3-5bf8-b845-0b2cc69d69e3_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3857%252F20473857%252Fdocs_service_history-1774624645310.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D7401b8786be346cbfe0ab0efcde2111a') HTTP/1.1" 204 0
2026-03-29 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3857/20473857/docs_service_history-1774624645310.jpg?ixlib=js-3.8.0&auto=format&s=7401b8786be346cbfe0ab0efcde2111a saved to cache
2026-03-29 20:20:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 87da71cb-f8e3-5bf8-b845-0b2cc69d69e3
2026-03-29 20:20:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659aff410>
2026-03-29 20:20:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87da71cb-f8e3-5bf8-b845-0b2cc69d69e3/87da71cb-f8e3-5bf8-b845-0b2cc69d69e3_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:20:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3857%252F20473857%252Finterior_boot-1774623926053.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3857/20473857/interior_boot-1774623926053.jpg saved to cache
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 87da71cb-f8e3-5bf8-b845-0b2cc69d69e3
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2613%252F19242613%252Fexterior_rear_passenger-1774698202051.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2613/19242613/exterior_rear_passenger-1774698202051.jpg not downloaded yet
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5511%252F20455511%252Fexterior_rear_passenger-1774627997693.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5511/20455511/exterior_rear_passenger-1774627997693.jpg not downloaded yet
2026-03-29 20:20:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9987/20419987/exterior_front_driver-1774601115897.jpg> (referer: None)
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2613%252F19242613%252Finterior_front_seats-1774698480210.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2613/19242613/interior_front_seats-1774698480210.jpg not downloaded yet
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5511%252F20455511%252Finterior_front_seats-1774691555247.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5511/20455511/interior_front_seats-1774691555247.jpg not downloaded yet
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2613%252F19242613%252Finterior_rear_seats-1774698673790.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2613/19242613/interior_rear_seats-1774698673790.jpg not downloaded yet
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5511%252F20455511%252Finterior_rear_seats-1774691603831.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5511/20455511/interior_rear_seats-1774691603831.jpg not downloaded yet
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2613%252F19242613%252Finterior_dashboard-1774698873853.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2613/19242613/interior_dashboard-1774698873853.jpg not downloaded yet
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5511%252F20455511%252Finterior_dashboard-1774691739211.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5511/20455511/interior_dashboard-1774691739211.jpg not downloaded yet
2026-03-29 20:20:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587c2990>
2026-03-29 20:20:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1238faff-06b0-5b59-899a-f2c4a26dbdca/1238faff-06b0-5b59-899a-f2c4a26dbdca_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9987%252F20419987%252Fexterior_front_driver-1774601115897.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9987/20419987/exterior_front_driver-1774601115897.jpg saved to cache
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1238faff-06b0-5b59-899a-f2c4a26dbdca
2026-03-29 20:20:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1238faff-06b0-5b59-899a-f2c4a26dbdca, skipping ID generation
2026-03-29 20:20:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1238faff-06b0-5b59-899a-f2c4a26dbdca with scrape type 1
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1238faff-06b0-5b59-899a-f2c4a26dbdca sending to next pipeline
2026-03-29 20:20:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 1238faff-06b0-5b59-899a-f2c4a26dbdca, identifier: 20419987
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2613%252F19242613%252Finstrument_cluster-1774698655888.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2613/19242613/instrument_cluster-1774698655888.jpg not downloaded yet
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5511%252F20455511%252Finstrument_cluster-1774691613620.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5511/20455511/instrument_cluster-1774691613620.jpg not downloaded yet
2026-03-29 20:20:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 1238faff-06b0-5b59-899a-f2c4a26dbdca with identifier: 20419987
2026-03-29 20:20:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 1238faff-06b0-5b59-899a-f2c4a26dbdca with identifier: 20419987
2026-03-29 20:20:44 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 1238faff-06b0-5b59-899a-f2c4a26dbdca with identifier: 20419987 to the API
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9987/20419987/exterior_front_driver-1774601115897.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '1238faff-06b0-5b59-899a-f2c4a26dbdca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YB65 TSU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20419987',
'listing': 'auction',
'location': 'Lancashire Wigan',
'make': 'Citroen',
'model': 'C1',
'odometer': 57282,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1238faff-06b0-5b59-899a-f2c4a26dbdca/1238faff-06b0-5b59-899a-f2c4a26dbdca_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1490310,
'Height': 2528,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9987/20419987/exterior_front_driver-1774601115897.jpg',
'Width': 3371},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1238faff-06b0-5b59-899a-f2c4a26dbdca/1238faff-06b0-5b59-899a-f2c4a26dbdca_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1929886,
'Height': 2705,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9987/20419987/exterior_rear_driver-1774601115435.jpg',
'Width': 3607},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1238faff-06b0-5b59-899a-f2c4a26dbdca/1238faff-06b0-5b59-899a-f2c4a26dbdca_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2172328,
'Height': 2848,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9987/20419987/exterior_front_passenger-1774601117623.jpg',
'Width': 3797},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1238faff-06b0-5b59-899a-f2c4a26dbdca/1238faff-06b0-5b59-899a-f2c4a26dbdca_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2379505,
'Height': 2951,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9987/20419987/exterior_rear_passenger-1774601118068.jpg',
'Width': 3935},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1238faff-06b0-5b59-899a-f2c4a26dbdca/1238faff-06b0-5b59-899a-f2c4a26dbdca_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4369703,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9987/20419987/interior_front_seats-1774601021421.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1238faff-06b0-5b59-899a-f2c4a26dbdca/1238faff-06b0-5b59-899a-f2c4a26dbdca_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4977476,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9987/20419987/interior_rear_seats-1774601022981.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1238faff-06b0-5b59-899a-f2c4a26dbdca/1238faff-06b0-5b59-899a-f2c4a26dbdca_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1773550,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9987/20419987/interior_dashboard-1774601043825.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1238faff-06b0-5b59-899a-f2c4a26dbdca/1238faff-06b0-5b59-899a-f2c4a26dbdca_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2720880,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9987/20419987/instrument_cluster-1774601153561.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1238faff-06b0-5b59-899a-f2c4a26dbdca/1238faff-06b0-5b59-899a-f2c4a26dbdca_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3811520,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9987/20419987/interior_boot-1774601025674.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1238faff-06b0-5b59-899a-f2c4a26dbdca/1238faff-06b0-5b59-899a-f2c4a26dbdca_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438166,
'Height': 3015,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9987/20419987/docs_service_history-1774711535310.jpg?ixlib=js-3.8.0&auto=format&s=441a622319d970d225b9f61a03e2bc57',
'Width': 2100}],
'price': 2774,
'price_includes_vat': False,
'registration_date': '2015-12-30',
'seats_number': None,
'seller_name': None,
'title': 'Citroen C1 Feel',
'transmission': 'manual',
'trim': 'Feel',
'vin': 'VF7PSCFBCFR579265',
'year': 2015}
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720419987%27 HTTP/1.1" 200 None
2026-03-29 20:20:44 [motorway.uk] INFO: Saving data for 20419987: {'created_time': 1774815644.855208, 'last_price_update_time': 1774815644.855218, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20419987') HTTP/1.1" 204 0
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2613%252F19242613%252Finterior_boot-1774699023514.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2613/19242613/interior_boot-1774699023514.jpg not downloaded yet
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5511%252F20455511%252Finterior_boot-1774691776340.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5511/20455511/interior_boot-1774691776340.jpg not downloaded yet
2026-03-29 20:20:44 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.577(s), this was the 1st time calling it.
2026-03-29 20:20:44 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.917666461407882 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2613%252F19242613%252Fdocs_service_history-1774699286803.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D83ae98677e1d82848b12c4432b7d7c10%27 HTTP/1.1" 200 None
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2613/19242613/docs_service_history-1774699286803.jpg?ixlib=js-3.8.0&auto=format&s=83ae98677e1d82848b12c4432b7d7c10 not downloaded yet
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5511%252F20455511%252Fwheels_front_driver-1774628106015.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5511/20455511/wheels_front_driver-1774628106015.jpg not downloaded yet
2026-03-29 20:20:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2613/19242613/exterior_rear_passenger-1774698202051.jpg> (referer: None)
2026-03-29 20:20:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3857/20473857/exterior_front_passenger-1774623233218.jpg> (referer: None)
2026-03-29 20:20:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3857/20473857/interior_dashboard-1774623972617.jpg> (referer: None)
2026-03-29 20:20:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3857/20473857/exterior_rear_passenger-1774623213896.jpg> (referer: None)
2026-03-29 20:20:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3857/20473857/exterior_rear_driver-1774623191432.jpg> (referer: None)
2026-03-29 20:20:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3857/20473857/instrument_cluster-1774623911188.jpg> (referer: None)
2026-03-29 20:20:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5511/20455511/exterior_rear_passenger-1774627997693.jpg> (referer: None)
2026-03-29 20:20:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3857/20473857/exterior_front_driver-1774623163385.jpg> (referer: None)
2026-03-29 20:20:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3857/20473857/interior_front_seats-1774623818592.jpg> (referer: None)
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584f3650>
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0283e2d-040e-5bc6-9eae-3df2812b73c3/d0283e2d-040e-5bc6-9eae-3df2812b73c3_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2613%252F19242613%252Fexterior_rear_passenger-1774698202051.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2613/19242613/exterior_rear_passenger-1774698202051.jpg saved to cache
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d0283e2d-040e-5bc6-9eae-3df2812b73c3
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b312d0>
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87da71cb-f8e3-5bf8-b845-0b2cc69d69e3/87da71cb-f8e3-5bf8-b845-0b2cc69d69e3_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3857%252F20473857%252Fexterior_front_passenger-1774623233218.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3857/20473857/exterior_front_passenger-1774623233218.jpg saved to cache
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 87da71cb-f8e3-5bf8-b845-0b2cc69d69e3
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598dd690>
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87da71cb-f8e3-5bf8-b845-0b2cc69d69e3/87da71cb-f8e3-5bf8-b845-0b2cc69d69e3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3857%252F20473857%252Finterior_dashboard-1774623972617.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3857/20473857/interior_dashboard-1774623972617.jpg saved to cache
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 87da71cb-f8e3-5bf8-b845-0b2cc69d69e3
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658542b50>
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87da71cb-f8e3-5bf8-b845-0b2cc69d69e3/87da71cb-f8e3-5bf8-b845-0b2cc69d69e3_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3857%252F20473857%252Fexterior_rear_passenger-1774623213896.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3857/20473857/exterior_rear_passenger-1774623213896.jpg saved to cache
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 87da71cb-f8e3-5bf8-b845-0b2cc69d69e3
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a1cc50>
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87da71cb-f8e3-5bf8-b845-0b2cc69d69e3/87da71cb-f8e3-5bf8-b845-0b2cc69d69e3_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3857%252F20473857%252Fexterior_rear_driver-1774623191432.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3857/20473857/exterior_rear_driver-1774623191432.jpg saved to cache
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 87da71cb-f8e3-5bf8-b845-0b2cc69d69e3
2026-03-29 20:20:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a16310>
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87da71cb-f8e3-5bf8-b845-0b2cc69d69e3/87da71cb-f8e3-5bf8-b845-0b2cc69d69e3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3857%252F20473857%252Finstrument_cluster-1774623911188.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3857/20473857/instrument_cluster-1774623911188.jpg saved to cache
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 87da71cb-f8e3-5bf8-b845-0b2cc69d69e3
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c50290>
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5de3339e-7cc6-5d72-b214-40e14e6138d6/5de3339e-7cc6-5d72-b214-40e14e6138d6_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5511%252F20455511%252Fexterior_rear_passenger-1774627997693.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5511/20455511/exterior_rear_passenger-1774627997693.jpg saved to cache
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5de3339e-7cc6-5d72-b214-40e14e6138d6
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b33390>
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87da71cb-f8e3-5bf8-b845-0b2cc69d69e3/87da71cb-f8e3-5bf8-b845-0b2cc69d69e3_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3857%252F20473857%252Fexterior_front_driver-1774623163385.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3857/20473857/exterior_front_driver-1774623163385.jpg saved to cache
2026-03-29 20:20:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 87da71cb-f8e3-5bf8-b845-0b2cc69d69e3
2026-03-29 20:20:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a14c90>
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87da71cb-f8e3-5bf8-b845-0b2cc69d69e3/87da71cb-f8e3-5bf8-b845-0b2cc69d69e3_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3857%252F20473857%252Finterior_front_seats-1774623818592.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3857/20473857/interior_front_seats-1774623818592.jpg saved to cache
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 87da71cb-f8e3-5bf8-b845-0b2cc69d69e3
2026-03-29 20:20:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87da71cb-f8e3-5bf8-b845-0b2cc69d69e3, skipping ID generation
2026-03-29 20:20:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87da71cb-f8e3-5bf8-b845-0b2cc69d69e3 with scrape type 1
2026-03-29 20:20:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 87da71cb-f8e3-5bf8-b845-0b2cc69d69e3 sending to next pipeline
2026-03-29 20:20:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 87da71cb-f8e3-5bf8-b845-0b2cc69d69e3, identifier: 20473857
2026-03-29 20:20:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 87da71cb-f8e3-5bf8-b845-0b2cc69d69e3 with identifier: 20473857
2026-03-29 20:20:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 87da71cb-f8e3-5bf8-b845-0b2cc69d69e3 with identifier: 20473857
2026-03-29 20:20:46 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 87da71cb-f8e3-5bf8-b845-0b2cc69d69e3 with identifier: 20473857 to the API
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/3857/20473857/interior_front_seats-1774623818592.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '87da71cb-f8e3-5bf8-b845-0b2cc69d69e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'GF58 ZBT',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20473857',
'listing': 'auction',
'location': 'Greater London Purley',
'make': 'Ford',
'model': 'Focus',
'odometer': 36000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87da71cb-f8e3-5bf8-b845-0b2cc69d69e3/87da71cb-f8e3-5bf8-b845-0b2cc69d69e3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2660724,
'Height': 2955,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3857/20473857/exterior_front_driver-1774623163385.jpg',
'Width': 3940},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87da71cb-f8e3-5bf8-b845-0b2cc69d69e3/87da71cb-f8e3-5bf8-b845-0b2cc69d69e3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2438263,
'Height': 2872,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3857/20473857/exterior_rear_driver-1774623191432.jpg',
'Width': 3829},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87da71cb-f8e3-5bf8-b845-0b2cc69d69e3/87da71cb-f8e3-5bf8-b845-0b2cc69d69e3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1946391,
'Height': 2746,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3857/20473857/exterior_front_passenger-1774623233218.jpg',
'Width': 3661},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87da71cb-f8e3-5bf8-b845-0b2cc69d69e3/87da71cb-f8e3-5bf8-b845-0b2cc69d69e3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2231633,
'Height': 2951,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3857/20473857/exterior_rear_passenger-1774623213896.jpg',
'Width': 3935},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87da71cb-f8e3-5bf8-b845-0b2cc69d69e3/87da71cb-f8e3-5bf8-b845-0b2cc69d69e3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4980666,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3857/20473857/interior_front_seats-1774623818592.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87da71cb-f8e3-5bf8-b845-0b2cc69d69e3/87da71cb-f8e3-5bf8-b845-0b2cc69d69e3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4881598,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3857/20473857/interior_rear_seats-1774623844436.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87da71cb-f8e3-5bf8-b845-0b2cc69d69e3/87da71cb-f8e3-5bf8-b845-0b2cc69d69e3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2103274,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3857/20473857/interior_dashboard-1774623972617.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87da71cb-f8e3-5bf8-b845-0b2cc69d69e3/87da71cb-f8e3-5bf8-b845-0b2cc69d69e3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2544158,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3857/20473857/instrument_cluster-1774623911188.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87da71cb-f8e3-5bf8-b845-0b2cc69d69e3/87da71cb-f8e3-5bf8-b845-0b2cc69d69e3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3431031,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3857/20473857/interior_boot-1774623926053.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87da71cb-f8e3-5bf8-b845-0b2cc69d69e3/87da71cb-f8e3-5bf8-b845-0b2cc69d69e3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3041616,
'Height': 2989,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3857/20473857/docs_service_history-1774624645310.jpg?ixlib=js-3.8.0&auto=format&s=7401b8786be346cbfe0ab0efcde2111a',
'Width': 2068}],
'price': 3236,
'price_includes_vat': False,
'registration_date': '2008-12-11',
'seats_number': None,
'seller_name': None,
'title': 'Ford Focus Zetec 100 Auto',
'transmission': 'automatic',
'trim': 'Zetec 100 Auto',
'vin': 'WF0PXXWPDP8L77695',
'year': 2008}
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720473857%27 HTTP/1.1" 200 None
2026-03-29 20:20:46 [motorway.uk] INFO: Saving data for 20473857: {'created_time': 1774815646.834406, 'last_price_update_time': 1774815646.834417, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20473857') HTTP/1.1" 204 0
2026-03-29 20:20:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2613/19242613/exterior_front_passenger-1774698183348.jpg> (referer: None)
2026-03-29 20:20:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5511/20455511/wheels_front_driver-1774628106015.jpg> (referer: None)
2026-03-29 20:20:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2613/19242613/docs_service_history-1774699286803.jpg?ixlib=js-3.8.0&auto=format&s=83ae98677e1d82848b12c4432b7d7c10> (referer: None)
2026-03-29 20:20:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5511/20455511/exterior_rear_driver-1774627976885.jpg> (referer: None)
2026-03-29 20:20:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5511/20455511/exterior_front_passenger-1774628028832.jpg> (referer: None)
2026-03-29 20:20:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d375d0>
2026-03-29 20:20:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0283e2d-040e-5bc6-9eae-3df2812b73c3/d0283e2d-040e-5bc6-9eae-3df2812b73c3_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2613%252F19242613%252Fexterior_front_passenger-1774698183348.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2613/19242613/exterior_front_passenger-1774698183348.jpg saved to cache
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d0283e2d-040e-5bc6-9eae-3df2812b73c3
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b34c90>
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5de3339e-7cc6-5d72-b214-40e14e6138d6/5de3339e-7cc6-5d72-b214-40e14e6138d6_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5511%252F20455511%252Fwheels_front_driver-1774628106015.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5511/20455511/wheels_front_driver-1774628106015.jpg saved to cache
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5de3339e-7cc6-5d72-b214-40e14e6138d6
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658355810>
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0283e2d-040e-5bc6-9eae-3df2812b73c3/d0283e2d-040e-5bc6-9eae-3df2812b73c3_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2613%252F19242613%252Fdocs_service_history-1774699286803.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D83ae98677e1d82848b12c4432b7d7c10') HTTP/1.1" 204 0
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2613/19242613/docs_service_history-1774699286803.jpg?ixlib=js-3.8.0&auto=format&s=83ae98677e1d82848b12c4432b7d7c10 saved to cache
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d0283e2d-040e-5bc6-9eae-3df2812b73c3
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599863d0>
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5de3339e-7cc6-5d72-b214-40e14e6138d6/5de3339e-7cc6-5d72-b214-40e14e6138d6_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5511%252F20455511%252Fexterior_rear_driver-1774627976885.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5511/20455511/exterior_rear_driver-1774627976885.jpg saved to cache
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5de3339e-7cc6-5d72-b214-40e14e6138d6
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b356d0>
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5de3339e-7cc6-5d72-b214-40e14e6138d6/5de3339e-7cc6-5d72-b214-40e14e6138d6_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5511%252F20455511%252Fexterior_front_passenger-1774628028832.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5511/20455511/exterior_front_passenger-1774628028832.jpg saved to cache
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5de3339e-7cc6-5d72-b214-40e14e6138d6
2026-03-29 20:20:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2613/19242613/interior_rear_seats-1774698673790.jpg> (referer: None)
2026-03-29 20:20:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2613/19242613/exterior_rear_driver-1774698224384.jpg> (referer: None)
2026-03-29 20:20:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2613/19242613/interior_front_seats-1774698480210.jpg> (referer: None)
2026-03-29 20:20:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2613/19242613/instrument_cluster-1774698655888.jpg> (referer: None)
2026-03-29 20:20:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2613/19242613/interior_boot-1774699023514.jpg> (referer: None)
2026-03-29 20:20:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2613/19242613/interior_dashboard-1774698873853.jpg> (referer: None)
2026-03-29 20:20:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5511/20455511/instrument_cluster-1774691613620.jpg> (referer: None)
2026-03-29 20:20:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5511/20455511/interior_boot-1774691776340.jpg> (referer: None)
2026-03-29 20:20:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5511/20455511/interior_rear_seats-1774691603831.jpg> (referer: None)
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65841cc90>
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0283e2d-040e-5bc6-9eae-3df2812b73c3/d0283e2d-040e-5bc6-9eae-3df2812b73c3_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2613%252F19242613%252Finterior_rear_seats-1774698673790.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2613/19242613/interior_rear_seats-1774698673790.jpg saved to cache
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d0283e2d-040e-5bc6-9eae-3df2812b73c3
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599ede10>
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0283e2d-040e-5bc6-9eae-3df2812b73c3/d0283e2d-040e-5bc6-9eae-3df2812b73c3_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2613%252F19242613%252Fexterior_rear_driver-1774698224384.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2613/19242613/exterior_rear_driver-1774698224384.jpg saved to cache
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d0283e2d-040e-5bc6-9eae-3df2812b73c3
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d02ed0>
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0283e2d-040e-5bc6-9eae-3df2812b73c3/d0283e2d-040e-5bc6-9eae-3df2812b73c3_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2613%252F19242613%252Finterior_front_seats-1774698480210.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2613/19242613/interior_front_seats-1774698480210.jpg saved to cache
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d0283e2d-040e-5bc6-9eae-3df2812b73c3
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b0fb90>
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0283e2d-040e-5bc6-9eae-3df2812b73c3/d0283e2d-040e-5bc6-9eae-3df2812b73c3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2613%252F19242613%252Finstrument_cluster-1774698655888.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2613/19242613/instrument_cluster-1774698655888.jpg saved to cache
2026-03-29 20:20:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d0283e2d-040e-5bc6-9eae-3df2812b73c3
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599eff10>
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0283e2d-040e-5bc6-9eae-3df2812b73c3/d0283e2d-040e-5bc6-9eae-3df2812b73c3_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2613%252F19242613%252Finterior_boot-1774699023514.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2613/19242613/interior_boot-1774699023514.jpg saved to cache
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d0283e2d-040e-5bc6-9eae-3df2812b73c3
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b0f890>
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0283e2d-040e-5bc6-9eae-3df2812b73c3/d0283e2d-040e-5bc6-9eae-3df2812b73c3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2613%252F19242613%252Finterior_dashboard-1774698873853.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2613/19242613/interior_dashboard-1774698873853.jpg saved to cache
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d0283e2d-040e-5bc6-9eae-3df2812b73c3
2026-03-29 20:20:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:20:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65850fd90>
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5de3339e-7cc6-5d72-b214-40e14e6138d6/5de3339e-7cc6-5d72-b214-40e14e6138d6_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5511%252F20455511%252Finstrument_cluster-1774691613620.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5511/20455511/instrument_cluster-1774691613620.jpg saved to cache
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5de3339e-7cc6-5d72-b214-40e14e6138d6
2026-03-29 20:20:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a10ed0>
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5de3339e-7cc6-5d72-b214-40e14e6138d6/5de3339e-7cc6-5d72-b214-40e14e6138d6_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5511%252F20455511%252Finterior_boot-1774691776340.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5511/20455511/interior_boot-1774691776340.jpg saved to cache
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5de3339e-7cc6-5d72-b214-40e14e6138d6
2026-03-29 20:20:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a43390>
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5de3339e-7cc6-5d72-b214-40e14e6138d6/5de3339e-7cc6-5d72-b214-40e14e6138d6_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5511%252F20455511%252Finterior_rear_seats-1774691603831.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5511/20455511/interior_rear_seats-1774691603831.jpg saved to cache
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5de3339e-7cc6-5d72-b214-40e14e6138d6
2026-03-29 20:20:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1404&page=39&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5511/20455511/exterior_front_driver-1774627955981.jpg> (referer: None)
2026-03-29 20:20:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2613/19242613/exterior_front_driver-1774698256291.jpg> (referer: None)
2026-03-29 20:20:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5511/20455511/interior_dashboard-1774691739211.jpg> (referer: None)
2026-03-29 20:20:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5511/20455511/interior_front_seats-1774691555247.jpg> (referer: None)
2026-03-29 20:20:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8823/20438823/interior_front_seats-1774621666896.jpg> (referer: None)
2026-03-29 20:20:48 [motorway.uk] INFO: Found listing with ID: 20113566
2026-03-29 20:20:48 [motorway.uk] INFO: Found listing with ID: 16171790
2026-03-29 20:20:48 [motorway.uk] INFO: Found listing with ID: 20376331
2026-03-29 20:20:48 [motorway.uk] INFO: Found listing with ID: 20386083
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720386083%27 HTTP/1.1" 200 None
2026-03-29 20:20:48 [motorway.uk] INFO: Scrape type for 20386083: 1
2026-03-29 20:20:48 [motorway.uk] INFO: Found listing with ID: 15325780
2026-03-29 20:20:48 [motorway.uk] INFO: Found listing with ID: 20473412
2026-03-29 20:20:48 [motorway.uk] INFO: Found listing with ID: 20404965
2026-03-29 20:20:48 [motorway.uk] INFO: Found listing with ID: 20498910
2026-03-29 20:20:48 [motorway.uk] INFO: Found listing with ID: 20439436
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720439436%27 HTTP/1.1" 200 None
2026-03-29 20:20:48 [motorway.uk] INFO: Scrape type for 20439436: 1
2026-03-29 20:20:48 [motorway.uk] INFO: Found listing with ID: 20476073
2026-03-29 20:20:48 [motorway.uk] INFO: Found listing with ID: 20496195
2026-03-29 20:20:48 [motorway.uk] INFO: Found listing with ID: 20337643
2026-03-29 20:20:48 [motorway.uk] INFO: Found listing with ID: 20098206
2026-03-29 20:20:48 [motorway.uk] INFO: Found listing with ID: 20475098
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720475098%27 HTTP/1.1" 200 None
2026-03-29 20:20:48 [motorway.uk] INFO: Scrape type for 20475098: 1
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658750610>
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5de3339e-7cc6-5d72-b214-40e14e6138d6/5de3339e-7cc6-5d72-b214-40e14e6138d6_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5511%252F20455511%252Fexterior_front_driver-1774627955981.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5511/20455511/exterior_front_driver-1774627955981.jpg saved to cache
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5de3339e-7cc6-5d72-b214-40e14e6138d6
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c032d0>
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0283e2d-040e-5bc6-9eae-3df2812b73c3/d0283e2d-040e-5bc6-9eae-3df2812b73c3_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2613%252F19242613%252Fexterior_front_driver-1774698256291.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2613/19242613/exterior_front_driver-1774698256291.jpg saved to cache
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d0283e2d-040e-5bc6-9eae-3df2812b73c3
2026-03-29 20:20:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d0283e2d-040e-5bc6-9eae-3df2812b73c3, skipping ID generation
2026-03-29 20:20:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0283e2d-040e-5bc6-9eae-3df2812b73c3 with scrape type 1
2026-03-29 20:20:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d0283e2d-040e-5bc6-9eae-3df2812b73c3 sending to next pipeline
2026-03-29 20:20:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d0283e2d-040e-5bc6-9eae-3df2812b73c3, identifier: 19242613
2026-03-29 20:20:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d0283e2d-040e-5bc6-9eae-3df2812b73c3 with identifier: 19242613
2026-03-29 20:20:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d0283e2d-040e-5bc6-9eae-3df2812b73c3 with identifier: 19242613
2026-03-29 20:20:49 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d0283e2d-040e-5bc6-9eae-3df2812b73c3 with identifier: 19242613 to the API
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2613/19242613/exterior_front_driver-1774698256291.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '2.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'd0283e2d-040e-5bc6-9eae-3df2812b73c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'GL69 YJM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19242613',
'listing': 'auction',
'location': 'South Yorkshire Barnsley',
'make': 'Ford',
'model': 'Focus',
'odometer': 33000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0283e2d-040e-5bc6-9eae-3df2812b73c3/d0283e2d-040e-5bc6-9eae-3df2812b73c3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 523896,
'Height': 1493,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2613/19242613/exterior_front_driver-1774698256291.jpg',
'Width': 1990},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0283e2d-040e-5bc6-9eae-3df2812b73c3/d0283e2d-040e-5bc6-9eae-3df2812b73c3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 600318,
'Height': 1628,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2613/19242613/exterior_rear_driver-1774698224384.jpg',
'Width': 2170},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0283e2d-040e-5bc6-9eae-3df2812b73c3/d0283e2d-040e-5bc6-9eae-3df2812b73c3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 646459,
'Height': 1535,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2613/19242613/exterior_front_passenger-1774698183348.jpg',
'Width': 2046},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0283e2d-040e-5bc6-9eae-3df2812b73c3/d0283e2d-040e-5bc6-9eae-3df2812b73c3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1115839,
'Height': 1931,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2613/19242613/exterior_rear_passenger-1774698202051.jpg',
'Width': 2575},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0283e2d-040e-5bc6-9eae-3df2812b73c3/d0283e2d-040e-5bc6-9eae-3df2812b73c3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1891814,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/2613/19242613/interior_front_seats-1774698480210.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0283e2d-040e-5bc6-9eae-3df2812b73c3/d0283e2d-040e-5bc6-9eae-3df2812b73c3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1112050,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/2613/19242613/interior_rear_seats-1774698673790.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0283e2d-040e-5bc6-9eae-3df2812b73c3/d0283e2d-040e-5bc6-9eae-3df2812b73c3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2299404,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2613/19242613/interior_dashboard-1774698873853.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0283e2d-040e-5bc6-9eae-3df2812b73c3/d0283e2d-040e-5bc6-9eae-3df2812b73c3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1965614,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2613/19242613/instrument_cluster-1774698655888.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0283e2d-040e-5bc6-9eae-3df2812b73c3/d0283e2d-040e-5bc6-9eae-3df2812b73c3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1953147,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/2613/19242613/interior_boot-1774699023514.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0283e2d-040e-5bc6-9eae-3df2812b73c3/d0283e2d-040e-5bc6-9eae-3df2812b73c3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1498473,
'Height': 4080,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2613/19242613/docs_service_history-1774699286803.jpg?ixlib=js-3.8.0&auto=format&s=83ae98677e1d82848b12c4432b7d7c10',
'Width': 3060}],
'price': 17113,
'price_includes_vat': False,
'registration_date': '2019-12-13',
'seats_number': None,
'seller_name': None,
'title': 'Ford Focus ST',
'transmission': 'manual',
'trim': 'ST',
'vin': 'WF0NXXGCHNKT07855',
'year': 2019}
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719242613%27 HTTP/1.1" 200 None
2026-03-29 20:20:49 [motorway.uk] INFO: Saving data for 19242613: {'created_time': 1774815649.640964, 'last_price_update_time': 1774815649.640976, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19242613') HTTP/1.1" 204 0
2026-03-29 20:20:49 [motorway.uk] INFO: Found listing with ID: 16172967
2026-03-29 20:20:49 [motorway.uk] INFO: Found listing with ID: 16857916
2026-03-29 20:20:49 [motorway.uk] INFO: Found listing with ID: 20462733
2026-03-29 20:20:49 [motorway.uk] INFO: Found listing with ID: 20490112
2026-03-29 20:20:49 [motorway.uk] INFO: Found listing with ID: 20402109
2026-03-29 20:20:49 [motorway.uk] INFO: Found listing with ID: 20374667
2026-03-29 20:20:49 [motorway.uk] INFO: Found listing with ID: 19899009
2026-03-29 20:20:49 [motorway.uk] INFO: Found listing with ID: 20432177
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720432177%27 HTTP/1.1" 200 None
2026-03-29 20:20:49 [motorway.uk] INFO: Scrape type for 20432177: 1
2026-03-29 20:20:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599df450>
2026-03-29 20:20:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5de3339e-7cc6-5d72-b214-40e14e6138d6/5de3339e-7cc6-5d72-b214-40e14e6138d6_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5511%252F20455511%252Finterior_dashboard-1774691739211.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5511/20455511/interior_dashboard-1774691739211.jpg saved to cache
2026-03-29 20:20:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5de3339e-7cc6-5d72-b214-40e14e6138d6
2026-03-29 20:20:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf9c310>
2026-03-29 20:20:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5de3339e-7cc6-5d72-b214-40e14e6138d6/5de3339e-7cc6-5d72-b214-40e14e6138d6_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5511%252F20455511%252Finterior_front_seats-1774691555247.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5511/20455511/interior_front_seats-1774691555247.jpg saved to cache
2026-03-29 20:20:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5de3339e-7cc6-5d72-b214-40e14e6138d6
2026-03-29 20:20:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5de3339e-7cc6-5d72-b214-40e14e6138d6, skipping ID generation
2026-03-29 20:20:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5de3339e-7cc6-5d72-b214-40e14e6138d6 with scrape type 1
2026-03-29 20:20:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5de3339e-7cc6-5d72-b214-40e14e6138d6 sending to next pipeline
2026-03-29 20:20:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5de3339e-7cc6-5d72-b214-40e14e6138d6, identifier: 20455511
2026-03-29 20:20:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658563dd0>
2026-03-29 20:20:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3553b9ab-51d5-53c8-a15f-fb42400252c2/3553b9ab-51d5-53c8-a15f-fb42400252c2_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8823%252F20438823%252Finterior_front_seats-1774621666896.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8823/20438823/interior_front_seats-1774621666896.jpg saved to cache
2026-03-29 20:20:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3553b9ab-51d5-53c8-a15f-fb42400252c2
2026-03-29 20:20:50 [motorway.uk] INFO: Found listing with ID: 11842898
2026-03-29 20:20:50 [motorway.uk] INFO: Found listing with ID: 20046055
2026-03-29 20:20:50 [motorway.uk] INFO: Found listing with ID: 20386977
2026-03-29 20:20:50 [motorway.uk] INFO: Found listing with ID: 20277874
2026-03-29 20:20:50 [motorway.uk] INFO: Found listing with ID: 14979819
2026-03-29 20:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714979819%27 HTTP/1.1" 200 None
2026-03-29 20:20:50 [motorway.uk] INFO: Scrape type for 14979819: 1
2026-03-29 20:20:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5de3339e-7cc6-5d72-b214-40e14e6138d6 with identifier: 20455511
2026-03-29 20:20:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5de3339e-7cc6-5d72-b214-40e14e6138d6 with identifier: 20455511
2026-03-29 20:20:50 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5de3339e-7cc6-5d72-b214-40e14e6138d6 with identifier: 20455511 to the API
2026-03-29 20:20:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/5511/20455511/interior_front_seats-1774691555247.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '5de3339e-7cc6-5d72-b214-40e14e6138d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'KP12 VDV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20455511',
'listing': 'auction',
'location': 'Milton Keynes Milton Keynes',
'make': 'Ford',
'model': 'Kuga',
'odometer': 69000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5de3339e-7cc6-5d72-b214-40e14e6138d6/5de3339e-7cc6-5d72-b214-40e14e6138d6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1103622,
'Height': 2399,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5511/20455511/exterior_front_driver-1774627955981.jpg',
'Width': 3199},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5de3339e-7cc6-5d72-b214-40e14e6138d6/5de3339e-7cc6-5d72-b214-40e14e6138d6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1595755,
'Height': 2602,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5511/20455511/exterior_rear_driver-1774627976885.jpg',
'Width': 3469},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5de3339e-7cc6-5d72-b214-40e14e6138d6/5de3339e-7cc6-5d72-b214-40e14e6138d6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2090852,
'Height': 2894,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5511/20455511/exterior_front_passenger-1774628028832.jpg',
'Width': 3859},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5de3339e-7cc6-5d72-b214-40e14e6138d6/5de3339e-7cc6-5d72-b214-40e14e6138d6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1658106,
'Height': 2566,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5511/20455511/exterior_rear_passenger-1774627997693.jpg',
'Width': 3421},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5de3339e-7cc6-5d72-b214-40e14e6138d6/5de3339e-7cc6-5d72-b214-40e14e6138d6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5051817,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5511/20455511/interior_front_seats-1774691555247.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5de3339e-7cc6-5d72-b214-40e14e6138d6/5de3339e-7cc6-5d72-b214-40e14e6138d6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4104029,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5511/20455511/interior_rear_seats-1774691603831.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5de3339e-7cc6-5d72-b214-40e14e6138d6/5de3339e-7cc6-5d72-b214-40e14e6138d6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3501819,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5511/20455511/interior_dashboard-1774691739211.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5de3339e-7cc6-5d72-b214-40e14e6138d6/5de3339e-7cc6-5d72-b214-40e14e6138d6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2791150,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5511/20455511/instrument_cluster-1774691613620.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5de3339e-7cc6-5d72-b214-40e14e6138d6/5de3339e-7cc6-5d72-b214-40e14e6138d6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2815078,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/5511/20455511/interior_boot-1774691776340.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5de3339e-7cc6-5d72-b214-40e14e6138d6/5de3339e-7cc6-5d72-b214-40e14e6138d6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 556027,
'Height': 1655,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/5511/20455511/wheels_front_driver-1774628106015.jpg',
'Width': 2207}],
'price': 2435,
'price_includes_vat': False,
'registration_date': '2012-04-28',
'seats_number': None,
'seller_name': None,
'title': 'Ford Kuga Titanium TDCI 140',
'transmission': 'manual',
'trim': 'Titanium TDCI 140',
'vin': 'WF0RXXGCDRBU52512',
'year': 2012}
2026-03-29 20:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720455511%27 HTTP/1.1" 200 None
2026-03-29 20:20:50 [motorway.uk] INFO: Saving data for 20455511: {'created_time': 1774815650.910836, 'last_price_update_time': 1774815650.910847, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20455511') HTTP/1.1" 204 0
2026-03-29 20:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3047/20473047/20473047-instrument_cluster-modified-1774622350658.jpeg> (referer: None)
2026-03-29 20:20:51 [motorway.uk] INFO: Found listing with ID: 20474482
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720474482%27 HTTP/1.1" 200 None
2026-03-29 20:20:51 [motorway.uk] INFO: Scrape type for 20474482: 1
2026-03-29 20:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16691958.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:20:51 [motorway.uk] INFO: Found listing with ID: 20415120
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720415120%27 HTTP/1.1" 200 None
2026-03-29 20:20:51 [motorway.uk] INFO: Scrape type for 20415120: 1
2026-03-29 20:20:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:51 [motorway.uk] INFO: Found listing with ID: 20214345
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720214345%27 HTTP/1.1" 200 None
2026-03-29 20:20:51 [motorway.uk] INFO: Scrape type for 20214345: 1
2026-03-29 20:20:51 [motorway.uk] INFO: Found listing with ID: 19182202
2026-03-29 20:20:51 [motorway.uk] INFO: Found listing with ID: 20334323
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720334323%27 HTTP/1.1" 200 None
2026-03-29 20:20:51 [motorway.uk] INFO: Scrape type for 20334323: 1
2026-03-29 20:20:51 [motorway.uk] INFO: Found listing with ID: 20417464
2026-03-29 20:20:51 [motorway.uk] INFO: Found listing with ID: 18237118
2026-03-29 20:20:51 [motorway.uk] INFO: Found listing with ID: 20502332
2026-03-29 20:20:51 [motorway.uk] INFO: Found listing with ID: 16476900
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658889810>
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dffb452-c67b-5d3d-a184-60af1fc76f79/2dffb452-c67b-5d3d-a184-60af1fc76f79_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3047%252F20473047%252F20473047-instrument_cluster-modified-1774622350658.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3047/20473047/20473047-instrument_cluster-modified-1774622350658.jpeg saved to cache
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2dffb452-c67b-5d3d-a184-60af1fc76f79
2026-03-29 20:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3047/20473047/20473047-interior_dashboard-modified-1774622370059.jpeg> (referer: None)
2026-03-29 20:20:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69acee96-37d6-5128-8151-1d62a112d416 with identifier: 16691958
2026-03-29 20:20:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69acee96-37d6-5128-8151-1d62a112d416 with scrape type 1
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 69acee96-37d6-5128-8151-1d62a112d416
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1958%252F16691958%252Fexterior_front_driver-1774709659768.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1958/16691958/exterior_front_driver-1774709659768.jpg not downloaded yet
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1958%252F16691958%252Fexterior_rear_driver-1774709680577.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1958/16691958/exterior_rear_driver-1774709680577.jpg not downloaded yet
2026-03-29 20:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20175875.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1958%252F16691958%252Fexterior_front_passenger-1774709700234.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1958/16691958/exterior_front_passenger-1774709700234.jpg not downloaded yet
2026-03-29 20:20:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c25f10>
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dffb452-c67b-5d3d-a184-60af1fc76f79/2dffb452-c67b-5d3d-a184-60af1fc76f79_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3047%252F20473047%252F20473047-interior_dashboard-modified-1774622370059.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3047/20473047/20473047-interior_dashboard-modified-1774622370059.jpeg saved to cache
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2dffb452-c67b-5d3d-a184-60af1fc76f79
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1958%252F16691958%252Fexterior_rear_passenger-1774707837293.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1958/16691958/exterior_rear_passenger-1774707837293.jpg not downloaded yet
2026-03-29 20:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8823/20438823/exterior_rear_passenger-1774621185215.jpg> (referer: None)
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1958%252F16691958%252Finterior_front_seats-1774708472045.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1958/16691958/interior_front_seats-1774708472045.jpg not downloaded yet
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1958%252F16691958%252Finterior_rear_seats-1774708507125.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1958/16691958/interior_rear_seats-1774708507125.jpg not downloaded yet
2026-03-29 20:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8823/20438823/exterior_rear_driver-1774621172220.jpg> (referer: None)
2026-03-29 20:20:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2c1cc52-51fe-56ff-9655-bcadaef6dba9 with identifier: 20175875
2026-03-29 20:20:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2c1cc52-51fe-56ff-9655-bcadaef6dba9 with scrape type 1
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c2c1cc52-51fe-56ff-9655-bcadaef6dba9
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5875%252F20175875%252Fexterior_front_driver-1774547865099.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5875/20175875/exterior_front_driver-1774547865099.jpg not downloaded yet
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1958%252F16691958%252Finterior_dashboard-1774709724089.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1958/16691958/interior_dashboard-1774709724089.jpg not downloaded yet
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5875%252F20175875%252Fexterior_rear_driver-1774699318801.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5875/20175875/exterior_rear_driver-1774699318801.jpg not downloaded yet
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1958%252F16691958%252Finterior_boot-1774709289159.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1958/16691958/interior_boot-1774709289159.jpg not downloaded yet
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5875%252F20175875%252Fexterior_front_passenger-1774547978276.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5875/20175875/exterior_front_passenger-1774547978276.jpg not downloaded yet
2026-03-29 20:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8823/20438823/exterior_front_passenger-1774621196698.jpg> (referer: None)
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1958%252F16691958%252Fdamage_scratches-1774707968482.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1958/16691958/damage_scratches-1774707968482.jpg not downloaded yet
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c3d350>
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3553b9ab-51d5-53c8-a15f-fb42400252c2/3553b9ab-51d5-53c8-a15f-fb42400252c2_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8823%252F20438823%252Fexterior_rear_passenger-1774621185215.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8823/20438823/exterior_rear_passenger-1774621185215.jpg saved to cache
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3553b9ab-51d5-53c8-a15f-fb42400252c2
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5875%252F20175875%252Fexterior_rear_passenger-1774547945998.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5875/20175875/exterior_rear_passenger-1774547945998.jpg not downloaded yet
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1958%252F16691958%252Fdamage_scratches-1774709324935.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1958/16691958/damage_scratches-1774709324935.jpg not downloaded yet
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ccd810>
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3553b9ab-51d5-53c8-a15f-fb42400252c2/3553b9ab-51d5-53c8-a15f-fb42400252c2_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8823%252F20438823%252Fexterior_rear_driver-1774621172220.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8823/20438823/exterior_rear_driver-1774621172220.jpg saved to cache
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3553b9ab-51d5-53c8-a15f-fb42400252c2
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5875%252F20175875%252Finterior_front_seats-1774549577690.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5875/20175875/interior_front_seats-1774549577690.jpg not downloaded yet
2026-03-29 20:20:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8823/20438823/exterior_front_driver-1774621147258.jpg> (referer: None)
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5875%252F20175875%252Finterior_rear_seats-1774549604804.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5875/20175875/interior_rear_seats-1774549604804.jpg not downloaded yet
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6580faf50>
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3553b9ab-51d5-53c8-a15f-fb42400252c2/3553b9ab-51d5-53c8-a15f-fb42400252c2_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8823%252F20438823%252Fexterior_front_passenger-1774621196698.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8823/20438823/exterior_front_passenger-1774621196698.jpg saved to cache
2026-03-29 20:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3553b9ab-51d5-53c8-a15f-fb42400252c2
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5875%252F20175875%252Finterior_dashboard-1774549667392.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5875/20175875/interior_dashboard-1774549667392.jpg not downloaded yet
2026-03-29 20:20:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be6a990>
2026-03-29 20:20:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3553b9ab-51d5-53c8-a15f-fb42400252c2/3553b9ab-51d5-53c8-a15f-fb42400252c2_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8823%252F20438823%252Fexterior_front_driver-1774621147258.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8823/20438823/exterior_front_driver-1774621147258.jpg saved to cache
2026-03-29 20:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3553b9ab-51d5-53c8-a15f-fb42400252c2
2026-03-29 20:20:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3553b9ab-51d5-53c8-a15f-fb42400252c2, skipping ID generation
2026-03-29 20:20:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3553b9ab-51d5-53c8-a15f-fb42400252c2 with scrape type 1
2026-03-29 20:20:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3553b9ab-51d5-53c8-a15f-fb42400252c2 sending to next pipeline
2026-03-29 20:20:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 3553b9ab-51d5-53c8-a15f-fb42400252c2, identifier: 20438823
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5875%252F20175875%252Finstrument_cluster-1774549668473.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5875/20175875/instrument_cluster-1774549668473.jpg not downloaded yet
2026-03-29 20:20:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 3553b9ab-51d5-53c8-a15f-fb42400252c2 with identifier: 20438823
2026-03-29 20:20:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 3553b9ab-51d5-53c8-a15f-fb42400252c2 with identifier: 20438823
2026-03-29 20:20:52 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 3553b9ab-51d5-53c8-a15f-fb42400252c2 with identifier: 20438823 to the API
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8823/20438823/exterior_front_driver-1774621147258.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '3553b9ab-51d5-53c8-a15f-fb42400252c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'KV67 YMT',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20438823',
'listing': 'auction',
'location': 'Hertfordshire Rickmansworth',
'make': 'Audi',
'model': 'Q5',
'odometer': 58000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3553b9ab-51d5-53c8-a15f-fb42400252c2/3553b9ab-51d5-53c8-a15f-fb42400252c2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2539688,
'Height': 2765,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8823/20438823/exterior_front_driver-1774621147258.jpg',
'Width': 3686},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3553b9ab-51d5-53c8-a15f-fb42400252c2/3553b9ab-51d5-53c8-a15f-fb42400252c2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1864573,
'Height': 2531,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8823/20438823/exterior_rear_driver-1774621172220.jpg',
'Width': 3375},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3553b9ab-51d5-53c8-a15f-fb42400252c2/3553b9ab-51d5-53c8-a15f-fb42400252c2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2218200,
'Height': 2825,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8823/20438823/exterior_front_passenger-1774621196698.jpg',
'Width': 3767},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3553b9ab-51d5-53c8-a15f-fb42400252c2/3553b9ab-51d5-53c8-a15f-fb42400252c2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1650150,
'Height': 2666,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8823/20438823/exterior_rear_passenger-1774621185215.jpg',
'Width': 3555},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3553b9ab-51d5-53c8-a15f-fb42400252c2/3553b9ab-51d5-53c8-a15f-fb42400252c2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3877400,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8823/20438823/interior_front_seats-1774621666896.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3553b9ab-51d5-53c8-a15f-fb42400252c2/3553b9ab-51d5-53c8-a15f-fb42400252c2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3545394,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8823/20438823/interior_rear_seats-1774621688705.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3553b9ab-51d5-53c8-a15f-fb42400252c2/3553b9ab-51d5-53c8-a15f-fb42400252c2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1645835,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8823/20438823/interior_dashboard-1774779258957.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3553b9ab-51d5-53c8-a15f-fb42400252c2/3553b9ab-51d5-53c8-a15f-fb42400252c2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3010387,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8823/20438823/instrument_cluster-1774621755293.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3553b9ab-51d5-53c8-a15f-fb42400252c2/3553b9ab-51d5-53c8-a15f-fb42400252c2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4008913,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8823/20438823/interior_boot-1774621748170.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3553b9ab-51d5-53c8-a15f-fb42400252c2/3553b9ab-51d5-53c8-a15f-fb42400252c2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2718164,
'Height': 3677,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8823/20438823/docs_service_history-1774713257261.jpg?ixlib=js-3.8.0&auto=format&s=22a21f4169dc52dd41c678a63a05d022',
'Width': 2041}],
'price': 13530,
'price_includes_vat': False,
'registration_date': '2017-09-27',
'seats_number': None,
'seller_name': None,
'title': 'Audi Q5 SE TDI Quattro S-A',
'transmission': 'automatic',
'trim': 'SE TDI Quattro S-A',
'vin': 'WAUZZZFY4J2027798',
'year': 2017}
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720438823%27 HTTP/1.1" 200 None
2026-03-29 20:20:52 [motorway.uk] INFO: Saving data for 20438823: {'created_time': 1774815652.768929, 'last_price_update_time': 1774815652.76894, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20438823') HTTP/1.1" 204 0
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5875%252F20175875%252Finterior_boot-1774699305203.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5875/20175875/interior_boot-1774699305203.jpg not downloaded yet
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5875%252F20175875%252Fdocs_service_history-1774550144494.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1875b0099005931ba1696e2c80b6f9a9%27 HTTP/1.1" 200 None
2026-03-29 20:20:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5875/20175875/docs_service_history-1774550144494.jpg?ixlib=js-3.8.0&auto=format&s=1875b0099005931ba1696e2c80b6f9a9 not downloaded yet
2026-03-29 20:20:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1958/16691958/exterior_rear_passenger-1774707837293.jpg> (referer: None)
2026-03-29 20:20:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3047/20473047/interior_boot-1774620897920.jpeg> (referer: None)
2026-03-29 20:20:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3047/20473047/interior_rear_seats-1774620699283.jpeg> (referer: None)
2026-03-29 20:20:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1958/16691958/exterior_rear_driver-1774709680577.jpg> (referer: None)
2026-03-29 20:20:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1958/16691958/interior_front_seats-1774708472045.jpg> (referer: None)
2026-03-29 20:20:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1440&page=40&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5875/20175875/interior_rear_seats-1774549604804.jpg> (referer: None)
2026-03-29 20:20:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5875/20175875/interior_front_seats-1774549577690.jpg> (referer: None)
2026-03-29 20:20:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b10c50>
2026-03-29 20:20:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69acee96-37d6-5128-8151-1d62a112d416/69acee96-37d6-5128-8151-1d62a112d416_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1958%252F16691958%252Fexterior_rear_passenger-1774707837293.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1958/16691958/exterior_rear_passenger-1774707837293.jpg saved to cache
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 69acee96-37d6-5128-8151-1d62a112d416
2026-03-29 20:20:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5875/20175875/docs_service_history-1774550144494.jpg?ixlib=js-3.8.0&auto=format&s=1875b0099005931ba1696e2c80b6f9a9> (referer: None)
2026-03-29 20:20:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19713905.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 146 - value: b'Apple\x00'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'iPhone SE (3rd generation)\x00'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 180 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 188 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 196 - value: b'26.3.1\x00'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 204 - value: b'2026:03:27 14:14:50\x00'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 224 - value: b'iPhone SE (3rd generation)\x00'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xfc'
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65c421150>
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dffb452-c67b-5d3d-a184-60af1fc76f79/2dffb452-c67b-5d3d-a184-60af1fc76f79_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3047%252F20473047%252Finterior_boot-1774620897920.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3047/20473047/interior_boot-1774620897920.jpeg saved to cache
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2dffb452-c67b-5d3d-a184-60af1fc76f79
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 146 - value: b'Apple\x00'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'iPhone SE (3rd generation)\x00'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 180 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 188 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 196 - value: b'26.3.1\x00'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 204 - value: b'2026:03:27 14:11:26\x00'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 224 - value: b'iPhone SE (3rd generation)\x00'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xfc'
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d92f90>
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dffb452-c67b-5d3d-a184-60af1fc76f79/2dffb452-c67b-5d3d-a184-60af1fc76f79_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3047%252F20473047%252Finterior_rear_seats-1774620699283.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3047/20473047/interior_rear_seats-1774620699283.jpeg saved to cache
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2dffb452-c67b-5d3d-a184-60af1fc76f79
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65999ccd0>
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69acee96-37d6-5128-8151-1d62a112d416/69acee96-37d6-5128-8151-1d62a112d416_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1958%252F16691958%252Fexterior_rear_driver-1774709680577.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1958/16691958/exterior_rear_driver-1774709680577.jpg saved to cache
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 69acee96-37d6-5128-8151-1d62a112d416
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f22b50>
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_69acee96-37d6-5128-8151-1d62a112d416/69acee96-37d6-5128-8151-1d62a112d416_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1958%252F16691958%252Finterior_front_seats-1774708472045.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1958/16691958/interior_front_seats-1774708472045.jpg saved to cache
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 69acee96-37d6-5128-8151-1d62a112d416
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 13194088
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 20307939
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 14034746
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 20338819
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 12525227
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 15408464
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715408464%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [motorway.uk] INFO: Scrape type for 15408464: 1
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfcb490>
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2c1cc52-51fe-56ff-9655-bcadaef6dba9/c2c1cc52-51fe-56ff-9655-bcadaef6dba9_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5875%252F20175875%252Finterior_rear_seats-1774549604804.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5875/20175875/interior_rear_seats-1774549604804.jpg saved to cache
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c2c1cc52-51fe-56ff-9655-bcadaef6dba9
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65999cc50>
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2c1cc52-51fe-56ff-9655-bcadaef6dba9/c2c1cc52-51fe-56ff-9655-bcadaef6dba9_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5875%252F20175875%252Finterior_front_seats-1774549577690.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5875/20175875/interior_front_seats-1774549577690.jpg saved to cache
2026-03-29 20:20:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c2c1cc52-51fe-56ff-9655-bcadaef6dba9
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 19652736
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 19998992
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719998992%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [motorway.uk] INFO: Scrape type for 19998992: 1
2026-03-29 20:20:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3047/20473047/interior_front_seats-1774620526347.jpeg> (referer: None)
2026-03-29 20:20:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20439436.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 16324421
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 20402579
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 15712620
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 19937895
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 20343893
2026-03-29 20:20:53 [motorway.uk] INFO: Found listing with ID: 19863425
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719863425%27 HTTP/1.1" 200 None
2026-03-29 20:20:53 [motorway.uk] INFO: Scrape type for 19863425: 1
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ca1010>
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2c1cc52-51fe-56ff-9655-bcadaef6dba9/c2c1cc52-51fe-56ff-9655-bcadaef6dba9_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5875%252F20175875%252Fdocs_service_history-1774550144494.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D1875b0099005931ba1696e2c80b6f9a9') HTTP/1.1" 204 0
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5875/20175875/docs_service_history-1774550144494.jpg?ixlib=js-3.8.0&auto=format&s=1875b0099005931ba1696e2c80b6f9a9 saved to cache
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c2c1cc52-51fe-56ff-9655-bcadaef6dba9
2026-03-29 20:20:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9778e29-d24e-5ba2-85b3-e018f638889d with identifier: 19713905
2026-03-29 20:20:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9778e29-d24e-5ba2-85b3-e018f638889d with scrape type 1
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d9778e29-d24e-5ba2-85b3-e018f638889d
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3905%252F19713905%252Fexterior_front_driver-1774706041641.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3905/19713905/exterior_front_driver-1774706041641.jpg not downloaded yet
2026-03-29 20:20:54 [motorway.uk] INFO: Found listing with ID: 20374139
2026-03-29 20:20:54 [motorway.uk] INFO: Found listing with ID: 20447541
2026-03-29 20:20:54 [motorway.uk] INFO: Found listing with ID: 20096245
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720096245%27 HTTP/1.1" 200 None
2026-03-29 20:20:54 [motorway.uk] INFO: Scrape type for 20096245: 1
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3905%252F19713905%252Fexterior_rear_driver-1774705975116.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3905/19713905/exterior_rear_driver-1774705975116.jpg not downloaded yet
2026-03-29 20:20:54 [motorway.uk] INFO: Found listing with ID: 8969713
2026-03-29 20:20:54 [motorway.uk] INFO: Found listing with ID: 20187846
2026-03-29 20:20:54 [motorway.uk] INFO: Found listing with ID: 15023759
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715023759%27 HTTP/1.1" 200 None
2026-03-29 20:20:54 [motorway.uk] INFO: Scrape type for 15023759: 1
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3905%252F19713905%252Fexterior_front_passenger-1774704432124.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3905/19713905/exterior_front_passenger-1774704432124.jpg not downloaded yet
2026-03-29 20:20:54 [motorway.uk] INFO: Found listing with ID: 20483861
2026-03-29 20:20:54 [motorway.uk] INFO: Found listing with ID: 20488363
2026-03-29 20:20:54 [motorway.uk] INFO: Found listing with ID: 18488723
2026-03-29 20:20:54 [motorway.uk] INFO: Found listing with ID: 19333728
2026-03-29 20:20:54 [motorway.uk] INFO: Found listing with ID: 20373131
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720373131%27 HTTP/1.1" 200 None
2026-03-29 20:20:54 [motorway.uk] INFO: Scrape type for 20373131: 1
2026-03-29 20:20:54 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 146 - value: b'Apple\x00'
2026-03-29 20:20:54 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'iPhone SE (3rd generation)\x00'
2026-03-29 20:20:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 180 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 188 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:54 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 196 - value: b'26.3.1\x00'
2026-03-29 20:20:54 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 204 - value: b'2026:03:27 14:08:36\x00'
2026-03-29 20:20:54 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 224 - value: b'iPhone SE (3rd generation)\x00'
2026-03-29 20:20:54 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xfc'
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65852a750>
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dffb452-c67b-5d3d-a184-60af1fc76f79/2dffb452-c67b-5d3d-a184-60af1fc76f79_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3047%252F20473047%252Finterior_front_seats-1774620526347.jpeg') HTTP/1.1" 204 0
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3047/20473047/interior_front_seats-1774620526347.jpeg saved to cache
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2dffb452-c67b-5d3d-a184-60af1fc76f79
2026-03-29 20:20:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e with identifier: 20439436
2026-03-29 20:20:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e with scrape type 1
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9436%252F20439436%252Fexterior_front_driver-1774612471139.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9436/20439436/exterior_front_driver-1774612471139.jpg not downloaded yet
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3905%252F19713905%252Fexterior_rear_passenger-1774706092747.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3905/19713905/exterior_rear_passenger-1774706092747.jpg not downloaded yet
2026-03-29 20:20:54 [motorway.uk] INFO: Found listing with ID: 15015635
2026-03-29 20:20:54 [motorway.uk] INFO: Found listing with ID: 19288107
2026-03-29 20:20:54 [motorway.uk] INFO: Found listing with ID: 20487830
2026-03-29 20:20:54 [motorway.uk] INFO: Found listing with ID: 20064722
2026-03-29 20:20:54 [motorway.uk] INFO: Found listing with ID: 17810245
2026-03-29 20:20:54 [motorway.uk] INFO: Found listing with ID: 17844342
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717844342%27 HTTP/1.1" 200 None
2026-03-29 20:20:54 [motorway.uk] INFO: Scrape type for 17844342: 1
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9436%252F20439436%252Fexterior_rear_driver-1774612525385.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9436/20439436/exterior_rear_driver-1774612525385.jpg not downloaded yet
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3905%252F19713905%252Finterior_front_seats-1774700313947.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3905/19713905/interior_front_seats-1774700313947.jpg not downloaded yet
2026-03-29 20:20:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:54 [motorway.uk] INFO: Found listing with ID: 20159342
2026-03-29 20:20:54 [motorway.uk] INFO: Found listing with ID: 20367432
2026-03-29 20:20:54 [motorway.uk] INFO: Found listing with ID: 19709380
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719709380%27 HTTP/1.1" 200 None
2026-03-29 20:20:54 [motorway.uk] INFO: Scrape type for 19709380: 1
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9436%252F20439436%252Fexterior_front_passenger-1774612595980.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9436/20439436/exterior_front_passenger-1774612595980.jpg not downloaded yet
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3905%252F19713905%252Finterior_rear_seats-1774700334449.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3905/19713905/interior_rear_seats-1774700334449.jpg not downloaded yet
2026-03-29 20:20:54 [motorway.uk] INFO: Found listing with ID: 18256517
2026-03-29 20:20:54 [motorway.uk] INFO: Found listing with ID: 20246067
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9436%252F20439436%252Fexterior_rear_passenger-1774612568012.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9436/20439436/exterior_rear_passenger-1774612568012.jpg not downloaded yet
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3905%252F19713905%252Finterior_dashboard-1774702680198.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3905/19713905/interior_dashboard-1774702680198.jpg not downloaded yet
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9436%252F20439436%252Finterior_front_seats-1774613107554.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9436/20439436/interior_front_seats-1774613107554.jpg not downloaded yet
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3905%252F19713905%252Finstrument_cluster-1774700429137.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3905/19713905/instrument_cluster-1774700429137.jpg not downloaded yet
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9436%252F20439436%252Finterior_rear_seats-1774613255403.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9436/20439436/interior_rear_seats-1774613255403.jpg not downloaded yet
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3905%252F19713905%252Finterior_boot-1774700425083.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3905/19713905/interior_boot-1774700425083.jpg not downloaded yet
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9436%252F20439436%252Finterior_dashboard-1774613296867.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9436/20439436/interior_dashboard-1774613296867.jpg not downloaded yet
2026-03-29 20:20:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9436/20439436/exterior_front_driver-1774612471139.jpg> (referer: None)
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3905%252F19713905%252Fdocs_service_history-1774700538513.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4034f7c1914d2c91dd0efe4a409f2d19%27 HTTP/1.1" 200 None
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3905/19713905/docs_service_history-1774700538513.jpg?ixlib=js-3.8.0&auto=format&s=4034f7c1914d2c91dd0efe4a409f2d19 not downloaded yet
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9436%252F20439436%252Finterior_boot-1774613342307.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9436/20439436/interior_boot-1774613342307.jpg not downloaded yet
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9436%252F20439436%252Fdocs_service_history-1774624897804.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da27bdf84367f4010eba12ccb9677eff3%27 HTTP/1.1" 200 None
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9436/20439436/docs_service_history-1774624897804.jpg?ixlib=js-3.8.0&auto=format&s=a27bdf84367f4010eba12ccb9677eff3 not downloaded yet
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9436%252F20439436%252Fdocs_service_history-1774632669951.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5ef8fe205e1aa0c5faed9cc89b024c98%27 HTTP/1.1" 200 None
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9436/20439436/docs_service_history-1774632669951.jpg?ixlib=js-3.8.0&auto=format&s=5ef8fe205e1aa0c5faed9cc89b024c98 not downloaded yet
2026-03-29 20:20:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3905/19713905/exterior_rear_passenger-1774706092747.jpg> (referer: None)
2026-03-29 20:20:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3905/19713905/exterior_front_driver-1774706041641.jpg> (referer: None)
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658acea50>
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e/67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9436%252F20439436%252Fexterior_front_driver-1774612471139.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9436/20439436/exterior_front_driver-1774612471139.jpg saved to cache
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e
2026-03-29 20:20:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3905/19713905/exterior_front_passenger-1774704432124.jpg> (referer: None)
2026-03-29 20:20:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3905/19713905/exterior_rear_driver-1774705975116.jpg> (referer: None)
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d5a410>
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9778e29-d24e-5ba2-85b3-e018f638889d/d9778e29-d24e-5ba2-85b3-e018f638889d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3905%252F19713905%252Fexterior_rear_passenger-1774706092747.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3905/19713905/exterior_rear_passenger-1774706092747.jpg saved to cache
2026-03-29 20:20:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d9778e29-d24e-5ba2-85b3-e018f638889d
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e13490>
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9778e29-d24e-5ba2-85b3-e018f638889d/d9778e29-d24e-5ba2-85b3-e018f638889d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3905%252F19713905%252Fexterior_front_driver-1774706041641.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3905/19713905/exterior_front_driver-1774706041641.jpg saved to cache
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9778e29-d24e-5ba2-85b3-e018f638889d
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ab2cd0>
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9778e29-d24e-5ba2-85b3-e018f638889d/d9778e29-d24e-5ba2-85b3-e018f638889d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3905%252F19713905%252Fexterior_front_passenger-1774704432124.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3905/19713905/exterior_front_passenger-1774704432124.jpg saved to cache
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d9778e29-d24e-5ba2-85b3-e018f638889d
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582bec10>
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9778e29-d24e-5ba2-85b3-e018f638889d/d9778e29-d24e-5ba2-85b3-e018f638889d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3905%252F19713905%252Fexterior_rear_driver-1774705975116.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3905/19713905/exterior_rear_driver-1774705975116.jpg saved to cache
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d9778e29-d24e-5ba2-85b3-e018f638889d
2026-03-29 20:20:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/9436/20439436/docs_service_history-1774632669951.jpg?ixlib=js-3.8.0&auto=format&s=5ef8fe205e1aa0c5faed9cc89b024c98> (referer: None)
2026-03-29 20:20:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9436/20439436/docs_service_history-1774624897804.jpg?ixlib=js-3.8.0&auto=format&s=a27bdf84367f4010eba12ccb9677eff3> (referer: None)
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d00d50>
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e/67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F9436%252F20439436%252Fdocs_service_history-1774632669951.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5ef8fe205e1aa0c5faed9cc89b024c98') HTTP/1.1" 204 0
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/9436/20439436/docs_service_history-1774632669951.jpg?ixlib=js-3.8.0&auto=format&s=5ef8fe205e1aa0c5faed9cc89b024c98 saved to cache
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e
2026-03-29 20:20:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3905/19713905/interior_boot-1774700425083.jpg> (referer: None)
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c09b90>
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e/67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9436%252F20439436%252Fdocs_service_history-1774624897804.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da27bdf84367f4010eba12ccb9677eff3') HTTP/1.1" 204 0
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9436/20439436/docs_service_history-1774624897804.jpg?ixlib=js-3.8.0&auto=format&s=a27bdf84367f4010eba12ccb9677eff3 saved to cache
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659eb2810>
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9778e29-d24e-5ba2-85b3-e018f638889d/d9778e29-d24e-5ba2-85b3-e018f638889d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3905%252F19713905%252Finterior_boot-1774700425083.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3905/19713905/interior_boot-1774700425083.jpg saved to cache
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d9778e29-d24e-5ba2-85b3-e018f638889d
2026-03-29 20:20:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9436/20439436/interior_rear_seats-1774613255403.jpg> (referer: None)
2026-03-29 20:20:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9436/20439436/interior_dashboard-1774613296867.jpg> (referer: None)
2026-03-29 20:20:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3905/19713905/docs_service_history-1774700538513.jpg?ixlib=js-3.8.0&auto=format&s=4034f7c1914d2c91dd0efe4a409f2d19> (referer: None)
2026-03-29 20:20:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9436/20439436/interior_boot-1774613342307.jpg> (referer: None)
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:27 12:07:30\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ede390>
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e/67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9436%252F20439436%252Finterior_rear_seats-1774613255403.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9436/20439436/interior_rear_seats-1774613255403.jpg saved to cache
2026-03-29 20:20:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:27 12:08:01\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:20:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582bca50>
2026-03-29 20:20:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e/67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9436%252F20439436%252Finterior_dashboard-1774613296867.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9436/20439436/interior_dashboard-1774613296867.jpg saved to cache
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d46750>
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9778e29-d24e-5ba2-85b3-e018f638889d/d9778e29-d24e-5ba2-85b3-e018f638889d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3905%252F19713905%252Fdocs_service_history-1774700538513.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4034f7c1914d2c91dd0efe4a409f2d19') HTTP/1.1" 204 0
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3905/19713905/docs_service_history-1774700538513.jpg?ixlib=js-3.8.0&auto=format&s=4034f7c1914d2c91dd0efe4a409f2d19 saved to cache
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d9778e29-d24e-5ba2-85b3-e018f638889d
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:27 12:08:56\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e72b10>
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e/67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9436%252F20439436%252Finterior_boot-1774613342307.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9436/20439436/interior_boot-1774613342307.jpg saved to cache
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e
2026-03-29 20:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9436/20439436/exterior_rear_passenger-1774612568012.jpg> (referer: None)
2026-03-29 20:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9436/20439436/interior_front_seats-1774613107554.jpg> (referer: None)
2026-03-29 20:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3905/19713905/interior_dashboard-1774702680198.jpg> (referer: None)
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b33e10>
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e/67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9436%252F20439436%252Fexterior_rear_passenger-1774612568012.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9436/20439436/exterior_rear_passenger-1774612568012.jpg saved to cache
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'8\x04\x00\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 34 - Data Location: 170 - value: b'samsung\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 58 - Data Location: 202 - value: b'2026:03:27 12:05:02\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 222 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 82 - Data Location: 230 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\xa0\x05\x00\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 106 - Data Location: 238 - value: <table: 36 bytes>
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 118 - Data Location: 274 - value: b'MediaTek Camera Application\x00\x00\x00\x00\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: ImageDescription (270) - type: string (2) Tag Location: 130 - Data Location: 306 - value: b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'R\x01\x00\x00'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658889410>
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e/67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9436%252F20439436%252Finterior_front_seats-1774613107554.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9436/20439436/interior_front_seats-1774613107554.jpg saved to cache
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659eb07d0>
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9778e29-d24e-5ba2-85b3-e018f638889d/d9778e29-d24e-5ba2-85b3-e018f638889d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3905%252F19713905%252Finterior_dashboard-1774702680198.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3905/19713905/interior_dashboard-1774702680198.jpg saved to cache
2026-03-29 20:20:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d9778e29-d24e-5ba2-85b3-e018f638889d
2026-03-29 20:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3905/19713905/instrument_cluster-1774700429137.jpg> (referer: None)
2026-03-29 20:20:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9436/20439436/exterior_front_passenger-1774612595980.jpg> (referer: None)
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d5bb10>
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9778e29-d24e-5ba2-85b3-e018f638889d/d9778e29-d24e-5ba2-85b3-e018f638889d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3905%252F19713905%252Finstrument_cluster-1774700429137.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3905/19713905/instrument_cluster-1774700429137.jpg saved to cache
2026-03-29 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d9778e29-d24e-5ba2-85b3-e018f638889d
2026-03-29 20:20:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20432177.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20474482.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d46650>
2026-03-29 20:20:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e/67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9436%252F20439436%252Fexterior_front_passenger-1774612595980.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9436/20439436/exterior_front_passenger-1774612595980.jpg saved to cache
2026-03-29 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e
2026-03-29 20:20:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9436/20439436/exterior_rear_driver-1774612525385.jpg> (referer: None)
2026-03-29 20:20:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3905/19713905/interior_rear_seats-1774700334449.jpg> (referer: None)
2026-03-29 20:20:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34e6aff2-c73f-5b73-818b-bd646f8f3a89 with identifier: 20432177
2026-03-29 20:20:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34e6aff2-c73f-5b73-818b-bd646f8f3a89 with scrape type 1
2026-03-29 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 34e6aff2-c73f-5b73-818b-bd646f8f3a89
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2177%252F20432177%252Fexterior_front_driver-1774707610213.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2177/20432177/exterior_front_driver-1774707610213.jpg not downloaded yet
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2177%252F20432177%252Fexterior_rear_driver-1774707626160.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2177/20432177/exterior_rear_driver-1774707626160.jpg not downloaded yet
2026-03-29 20:20:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfc72d4a-bea3-5dfb-9df5-6ef78ed097ad with identifier: 20474482
2026-03-29 20:20:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfc72d4a-bea3-5dfb-9df5-6ef78ed097ad with scrape type 1
2026-03-29 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cfc72d4a-bea3-5dfb-9df5-6ef78ed097ad
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4482%252F20474482%252Fexterior_front_driver-1774625016093.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4482/20474482/exterior_front_driver-1774625016093.jpg not downloaded yet
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2177%252F20432177%252Fexterior_front_passenger-1774707657906.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2177/20432177/exterior_front_passenger-1774707657906.jpg not downloaded yet
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4482%252F20474482%252Fexterior_rear_driver-1774625018333.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4482/20474482/exterior_rear_driver-1774625018333.jpg not downloaded yet
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2177%252F20432177%252Fexterior_rear_passenger-1774707643660.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2177/20432177/exterior_rear_passenger-1774707643660.jpg not downloaded yet
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4482%252F20474482%252Fexterior_front_passenger-1774625014376.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4482/20474482/exterior_front_passenger-1774625014376.jpg not downloaded yet
2026-03-29 20:20:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20475098.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f7f850>
2026-03-29 20:20:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e/67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9436%252F20439436%252Fexterior_rear_driver-1774612525385.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9436/20439436/exterior_rear_driver-1774612525385.jpg saved to cache
2026-03-29 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e
2026-03-29 20:20:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e, skipping ID generation
2026-03-29 20:20:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e with scrape type 1
2026-03-29 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e sending to next pipeline
2026-03-29 20:20:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e, identifier: 20439436
2026-03-29 20:20:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658889390>
2026-03-29 20:20:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9778e29-d24e-5ba2-85b3-e018f638889d/d9778e29-d24e-5ba2-85b3-e018f638889d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3905%252F19713905%252Finterior_rear_seats-1774700334449.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3905/19713905/interior_rear_seats-1774700334449.jpg saved to cache
2026-03-29 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d9778e29-d24e-5ba2-85b3-e018f638889d
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2177%252F20432177%252Finterior_front_seats-1774708552342.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2177/20432177/interior_front_seats-1774708552342.jpg not downloaded yet
2026-03-29 20:20:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e with identifier: 20439436
2026-03-29 20:20:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e with identifier: 20439436
2026-03-29 20:20:57 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e with identifier: 20439436 to the API
2026-03-29 20:20:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:20:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9436/20439436/exterior_rear_driver-1774612525385.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'GJ20 XUE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20439436',
'listing': 'auction',
'location': 'Shropshire Lydbury North',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 33468,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e/67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283282,
'Height': 956,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9436/20439436/exterior_front_driver-1774612471139.jpg',
'Width': 1274},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e/67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333925,
'Height': 986,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9436/20439436/exterior_rear_driver-1774612525385.jpg',
'Width': 1315},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e/67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279773,
'Height': 914,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9436/20439436/exterior_front_passenger-1774612595980.jpg',
'Width': 1218},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e/67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359509,
'Height': 1046,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9436/20439436/exterior_rear_passenger-1774612568012.jpg',
'Width': 1394},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e/67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 829659,
'Height': 1080,
'OriginUrl': 'https://motorway-photos.imgix.net/9436/20439436/interior_front_seats-1774613107554.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e/67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 776481,
'Height': 1080,
'OriginUrl': 'https://motorway-photos.imgix.net/9436/20439436/interior_rear_seats-1774613255403.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e/67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 804219,
'Height': 1080,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9436/20439436/interior_dashboard-1774613296867.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e/67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1175674,
'Height': 1080,
'OriginUrl': 'https://motorway-photos.imgix.net/9436/20439436/interior_boot-1774613342307.jpg',
'Width': 1440},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e/67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 972396,
'Height': 4080,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9436/20439436/docs_service_history-1774624897804.jpg?ixlib=js-3.8.0&auto=format&s=a27bdf84367f4010eba12ccb9677eff3',
'Width': 3060},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e/67a4d1f0-6c0e-5f82-9a87-c0f29af0fe2e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 547053,
'Height': 2810,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/9436/20439436/docs_service_history-1774632669951.jpg?ixlib=js-3.8.0&auto=format&s=5ef8fe205e1aa0c5faed9cc89b024c98',
'Width': 2108}],
'price': 12775,
'price_includes_vat': False,
'registration_date': '2020-06-22',
'seats_number': None,
'seller_name': None,
'title': 'Skoda Octavia SE Drive TSI S-A',
'transmission': 'automatic',
'trim': 'SE Drive TSI S-A',
'vin': 'TMBBR7NE7L0097231',
'year': 2020}
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720439436%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [motorway.uk] INFO: Saving data for 20439436: {'created_time': 1774815658.241495, 'last_price_update_time': 1774815658.241507, 'auction_closing_time': 1774884600.0}
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20439436') HTTP/1.1" 204 0
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4482%252F20474482%252Fexterior_rear_passenger-1774625023382.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4482/20474482/exterior_rear_passenger-1774625023382.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2177%252F20432177%252Finterior_rear_seats-1774708590897.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2177/20432177/interior_rear_seats-1774708590897.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4482%252F20474482%252Finterior_front_seats-1774625937657.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4482/20474482/interior_front_seats-1774625937657.jpg not downloaded yet
2026-03-29 20:20:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 612b94ca-a4b9-5d8c-a2ef-8ae7fffc2dd8 with identifier: 20475098
2026-03-29 20:20:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 612b94ca-a4b9-5d8c-a2ef-8ae7fffc2dd8 with scrape type 1
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 612b94ca-a4b9-5d8c-a2ef-8ae7fffc2dd8
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5098%252F20475098%252Fexterior_front_driver-1774691490687.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5098/20475098/exterior_front_driver-1774691490687.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2177%252F20432177%252Finterior_dashboard-1774708676338.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2177/20432177/interior_dashboard-1774708676338.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4482%252F20474482%252Finterior_rear_seats-1774625928876.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4482/20474482/interior_rear_seats-1774625928876.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5098%252F20475098%252Fexterior_rear_driver-1774691568290.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5098/20475098/exterior_rear_driver-1774691568290.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2177%252F20432177%252Finterior_boot-1774708655846.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2177/20432177/interior_boot-1774708655846.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4482%252F20474482%252Finterior_dashboard-1774625943853.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4482/20474482/interior_dashboard-1774625943853.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5098%252F20475098%252Fexterior_front_passenger-1774691531604.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5098/20475098/exterior_front_passenger-1774691531604.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2177%252F20432177%252Fdocs_service_history-1774708952933.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D81096d74437b1e1cf4c9d05413de8bda%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2177/20432177/docs_service_history-1774708952933.jpg?ixlib=js-3.8.0&auto=format&s=81096d74437b1e1cf4c9d05413de8bda not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4482%252F20474482%252Finstrument_cluster-1774625932975.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4482/20474482/instrument_cluster-1774625932975.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5098%252F20475098%252Fexterior_rear_passenger-1774691523897.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5098/20475098/exterior_rear_passenger-1774691523897.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2177%252F20432177%252Fdocs_service_history-1774708953666.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db3d00f3c4f70c1775d8bc0a5f4a333c1%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2177/20432177/docs_service_history-1774708953666.jpg?ixlib=js-3.8.0&auto=format&s=b3d00f3c4f70c1775d8bc0a5f4a333c1 not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4482%252F20474482%252Finterior_boot-1774625934907.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4482/20474482/interior_boot-1774625934907.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5098%252F20475098%252Finterior_front_seats-1774692059456.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5098/20475098/interior_front_seats-1774692059456.jpg not downloaded yet
2026-03-29 20:20:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20435928.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14979819.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4482%252F20474482%252Fdocs_service_history-1774626166343.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc7a6babc7317685c26b1568eb6c18719%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4482/20474482/docs_service_history-1774626166343.jpg?ixlib=js-3.8.0&auto=format&s=c7a6babc7317685c26b1568eb6c18719 not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5098%252F20475098%252Finterior_rear_seats-1774692074939.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5098/20475098/interior_rear_seats-1774692074939.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5098%252F20475098%252Finterior_dashboard-1774692113470.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5098/20475098/interior_dashboard-1774692113470.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5098%252F20475098%252Finterior_boot-1774692117592.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5098/20475098/interior_boot-1774692117592.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5098%252F20475098%252Fdocs_service_history-1774692292535.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D19b0597e00096799856459cd31f3c941%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5098/20475098/docs_service_history-1774692292535.jpg?ixlib=js-3.8.0&auto=format&s=19b0597e00096799856459cd31f3c941 not downloaded yet
2026-03-29 20:20:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6eaba9c3-ee02-5f23-b4bb-fbe112199003 with identifier: 20435928
2026-03-29 20:20:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eaba9c3-ee02-5f23-b4bb-fbe112199003 with scrape type 1
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6eaba9c3-ee02-5f23-b4bb-fbe112199003
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5928%252F20435928%252Fexterior_front_driver-1774692361417.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5928/20435928/exterior_front_driver-1774692361417.jpg not downloaded yet
2026-03-29 20:20:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7140c70b-51c4-5274-a187-68b60fb6b60e with identifier: 14979819
2026-03-29 20:20:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7140c70b-51c4-5274-a187-68b60fb6b60e with scrape type 1
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7140c70b-51c4-5274-a187-68b60fb6b60e
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9819%252F14979819%252Fexterior_front_driver-1774624505895.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9819/14979819/exterior_front_driver-1774624505895.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5098%252F20475098%252Fdamage_scratches-1774691618338.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5098/20475098/damage_scratches-1774691618338.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5928%252F20435928%252Fexterior_rear_driver-1774692543604.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5928/20435928/exterior_rear_driver-1774692543604.jpg not downloaded yet
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9819%252F14979819%252Fexterior_rear_driver-1774624505509.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9819/14979819/exterior_rear_driver-1774624505509.jpg not downloaded yet
2026-03-29 20:20:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20096245.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5928%252F20435928%252Fexterior_front_passenger-1774692609850.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5928/20435928/exterior_front_passenger-1774692609850.jpg not downloaded yet
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9819%252F14979819%252Fexterior_front_passenger-1774624513505.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9819/14979819/exterior_front_passenger-1774624513505.jpg not downloaded yet
2026-03-29 20:20:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5928%252F20435928%252Fexterior_rear_passenger-1774692660131.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5928/20435928/exterior_rear_passenger-1774692660131.jpg not downloaded yet
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9819%252F14979819%252Fexterior_rear_passenger-1774624507915.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9819/14979819/exterior_rear_passenger-1774624507915.jpg not downloaded yet
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5928%252F20435928%252Finterior_front_seats-1774694002424.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5928/20435928/interior_front_seats-1774694002424.jpg not downloaded yet
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9819%252F14979819%252Finterior_front_seats-1774628590895.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9819/14979819/interior_front_seats-1774628590895.jpg not downloaded yet
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5928%252F20435928%252Finterior_rear_seats-1774704105508.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5928/20435928/interior_rear_seats-1774704105508.jpg not downloaded yet
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9819%252F14979819%252Finterior_rear_seats-1774624503375.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9819/14979819/interior_rear_seats-1774624503375.jpg not downloaded yet
2026-03-29 20:20:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2177/20432177/docs_service_history-1774708953666.jpg?ixlib=js-3.8.0&auto=format&s=b3d00f3c4f70c1775d8bc0a5f4a333c1> (referer: None)
2026-03-29 20:20:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0beba8a3-9174-5484-abab-e26c29c10f3a with identifier: 20096245
2026-03-29 20:20:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0beba8a3-9174-5484-abab-e26c29c10f3a with scrape type 1
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0beba8a3-9174-5484-abab-e26c29c10f3a
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6245%252F20096245%252Fexterior_front_driver-1774713221245.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6245/20096245/exterior_front_driver-1774713221245.jpg not downloaded yet
2026-03-29 20:20:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4482/20474482/exterior_front_passenger-1774625014376.jpg> (referer: None)
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5928%252F20435928%252Finterior_dashboard-1774704068119.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5928/20435928/interior_dashboard-1774704068119.jpg not downloaded yet
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9819%252F14979819%252Finterior_dashboard-1774624517339.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9819/14979819/interior_dashboard-1774624517339.jpg not downloaded yet
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6245%252F20096245%252Fexterior_rear_driver-1774713235004.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6245/20096245/exterior_rear_driver-1774713235004.jpg not downloaded yet
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5928%252F20435928%252Finstrument_cluster-1774694045239.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5928/20435928/instrument_cluster-1774694045239.jpg not downloaded yet
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9819%252F14979819%252Finstrument_cluster-1774624633574.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9819/14979819/instrument_cluster-1774624633574.jpg not downloaded yet
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6245%252F20096245%252Fexterior_front_passenger-1774713260510.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6245/20096245/exterior_front_passenger-1774713260510.jpg not downloaded yet
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F5928%252F20435928%252Finterior_boot-1774704143218.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5928/20435928/interior_boot-1774704143218.jpg not downloaded yet
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9819%252F14979819%252Finterior_boot-1774694621435.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9819/14979819/interior_boot-1774694621435.jpg not downloaded yet
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6245%252F20096245%252Fexterior_rear_passenger-1774713247201.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6245/20096245/exterior_rear_passenger-1774713247201.jpg not downloaded yet
2026-03-29 20:20:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598dfe90>
2026-03-29 20:20:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e6aff2-c73f-5b73-818b-bd646f8f3a89/34e6aff2-c73f-5b73-818b-bd646f8f3a89_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2177%252F20432177%252Fdocs_service_history-1774708953666.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Db3d00f3c4f70c1775d8bc0a5f4a333c1') HTTP/1.1" 204 0
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2177/20432177/docs_service_history-1774708953666.jpg?ixlib=js-3.8.0&auto=format&s=b3d00f3c4f70c1775d8bc0a5f4a333c1 saved to cache
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 34e6aff2-c73f-5b73-818b-bd646f8f3a89
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5928%252F20435928%252Fdocs_service_history-1774705414490.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D93a8fee62394b3c12dc66c6dfdcfba7d%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5928/20435928/docs_service_history-1774705414490.jpg?ixlib=js-3.8.0&auto=format&s=93a8fee62394b3c12dc66c6dfdcfba7d not downloaded yet
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9819%252F14979819%252Fdocs_service_history-1774694905853.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D69eb94e319091f86a10e6c2b3f924e10%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9819/14979819/docs_service_history-1774694905853.jpg?ixlib=js-3.8.0&auto=format&s=69eb94e319091f86a10e6c2b3f924e10 not downloaded yet
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6245%252F20096245%252Finterior_front_seats-1774713771963.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6245/20096245/interior_front_seats-1774713771963.jpg not downloaded yet
2026-03-29 20:20:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d9e610>
2026-03-29 20:20:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc72d4a-bea3-5dfb-9df5-6ef78ed097ad/cfc72d4a-bea3-5dfb-9df5-6ef78ed097ad_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4482%252F20474482%252Fexterior_front_passenger-1774625014376.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4482/20474482/exterior_front_passenger-1774625014376.jpg saved to cache
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cfc72d4a-bea3-5dfb-9df5-6ef78ed097ad
2026-03-29 20:20:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5875/20175875/instrument_cluster-1774549668473.jpg> (referer: None)
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6245%252F20096245%252Finterior_rear_seats-1774714135812.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6245/20096245/interior_rear_seats-1774714135812.jpg not downloaded yet
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6245%252F20096245%252Finterior_dashboard-1774714459897.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6245/20096245/interior_dashboard-1774714459897.jpg not downloaded yet
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6245%252F20096245%252Finstrument_cluster-1774713866954.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6245/20096245/instrument_cluster-1774713866954.jpg not downloaded yet
2026-03-29 20:20:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/5875/20175875/interior_boot-1774699305203.jpg> (referer: None)
2026-03-29 20:20:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3905/19713905/interior_front_seats-1774700313947.jpg> (referer: None)
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6245%252F20096245%252Finterior_boot-1774714639764.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6245/20096245/interior_boot-1774714639764.jpg not downloaded yet
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6245%252F20096245%252Fdocs_service_history-1774716621865.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4229637ee58bdc6a2ecd16606a0a6dd7%27 HTTP/1.1" 200 None
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6245/20096245/docs_service_history-1774716621865.jpg?ixlib=js-3.8.0&auto=format&s=4229637ee58bdc6a2ecd16606a0a6dd7 not downloaded yet
2026-03-29 20:20:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1476&page=41&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:20:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:20:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:20:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:20:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:20:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b4bc10>
2026-03-29 20:20:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2c1cc52-51fe-56ff-9655-bcadaef6dba9/c2c1cc52-51fe-56ff-9655-bcadaef6dba9_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5875%252F20175875%252Finstrument_cluster-1774549668473.jpg') HTTP/1.1" 204 0
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5875/20175875/instrument_cluster-1774549668473.jpg saved to cache
2026-03-29 20:20:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c2c1cc52-51fe-56ff-9655-bcadaef6dba9
2026-03-29 20:20:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9819/14979819/exterior_rear_driver-1774624505509.jpg> (referer: None)
2026-03-29 20:20:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:20:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b4ab50>
2026-03-29 20:20:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:20:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:20:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2c1cc52-51fe-56ff-9655-bcadaef6dba9/c2c1cc52-51fe-56ff-9655-bcadaef6dba9_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F5875%252F20175875%252Finterior_boot-1774699305203.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/5875/20175875/interior_boot-1774699305203.jpg saved to cache
2026-03-29 20:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c2c1cc52-51fe-56ff-9655-bcadaef6dba9
2026-03-29 20:21:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658515e10>
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9778e29-d24e-5ba2-85b3-e018f638889d/d9778e29-d24e-5ba2-85b3-e018f638889d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3905%252F19713905%252Finterior_front_seats-1774700313947.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3905/19713905/interior_front_seats-1774700313947.jpg saved to cache
2026-03-29 20:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d9778e29-d24e-5ba2-85b3-e018f638889d
2026-03-29 20:21:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d9778e29-d24e-5ba2-85b3-e018f638889d, skipping ID generation
2026-03-29 20:21:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9778e29-d24e-5ba2-85b3-e018f638889d with scrape type 1
2026-03-29 20:21:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d9778e29-d24e-5ba2-85b3-e018f638889d sending to next pipeline
2026-03-29 20:21:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d9778e29-d24e-5ba2-85b3-e018f638889d, identifier: 19713905
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 20486464
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 20440188
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 19993213
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 20487855
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 20286408
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720286408%27 HTTP/1.1" 200 None
2026-03-29 20:21:00 [motorway.uk] INFO: Scrape type for 20286408: 1
2026-03-29 20:21:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d9778e29-d24e-5ba2-85b3-e018f638889d with identifier: 19713905
2026-03-29 20:21:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d9778e29-d24e-5ba2-85b3-e018f638889d with identifier: 19713905
2026-03-29 20:21:00 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d9778e29-d24e-5ba2-85b3-e018f638889d with identifier: 19713905 to the API
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:21:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos.imgix.net/3905/19713905/interior_front_seats-1774700313947.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'd9778e29-d24e-5ba2-85b3-e018f638889d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'R29 BLO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19713905',
'listing': 'auction',
'location': 'Rhondda Cynon Taff Pontypridd',
'make': 'BMW',
'model': 'M2',
'odometer': 59320,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9778e29-d24e-5ba2-85b3-e018f638889d/d9778e29-d24e-5ba2-85b3-e018f638889d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2207036,
'Height': 2311,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3905/19713905/exterior_front_driver-1774706041641.jpg',
'Width': 3081},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9778e29-d24e-5ba2-85b3-e018f638889d/d9778e29-d24e-5ba2-85b3-e018f638889d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2924260,
'Height': 2684,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3905/19713905/exterior_rear_driver-1774705975116.jpg',
'Width': 3579},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9778e29-d24e-5ba2-85b3-e018f638889d/d9778e29-d24e-5ba2-85b3-e018f638889d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1616122,
'Height': 2327,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3905/19713905/exterior_front_passenger-1774704432124.jpg',
'Width': 3103},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9778e29-d24e-5ba2-85b3-e018f638889d/d9778e29-d24e-5ba2-85b3-e018f638889d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1902415,
'Height': 2342,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3905/19713905/exterior_rear_passenger-1774706092747.jpg',
'Width': 3123},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9778e29-d24e-5ba2-85b3-e018f638889d/d9778e29-d24e-5ba2-85b3-e018f638889d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3609947,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3905/19713905/interior_front_seats-1774700313947.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9778e29-d24e-5ba2-85b3-e018f638889d/d9778e29-d24e-5ba2-85b3-e018f638889d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4023969,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3905/19713905/interior_rear_seats-1774700334449.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9778e29-d24e-5ba2-85b3-e018f638889d/d9778e29-d24e-5ba2-85b3-e018f638889d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2357959,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3905/19713905/interior_dashboard-1774702680198.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9778e29-d24e-5ba2-85b3-e018f638889d/d9778e29-d24e-5ba2-85b3-e018f638889d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2975551,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3905/19713905/instrument_cluster-1774700429137.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9778e29-d24e-5ba2-85b3-e018f638889d/d9778e29-d24e-5ba2-85b3-e018f638889d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4929351,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3905/19713905/interior_boot-1774700425083.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9778e29-d24e-5ba2-85b3-e018f638889d/d9778e29-d24e-5ba2-85b3-e018f638889d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 581089,
'Height': 587,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3905/19713905/docs_service_history-1774700538513.jpg?ixlib=js-3.8.0&auto=format&s=4034f7c1914d2c91dd0efe4a409f2d19',
'Width': 1567}],
'price': 16415,
'price_includes_vat': False,
'registration_date': '2019-08-28',
'seats_number': None,
'seller_name': None,
'title': 'BMW M240i Auto',
'transmission': 'automatic',
'trim': '40i Auto',
'vin': 'WBA2J520807E28678',
'year': 2019}
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719713905%27 HTTP/1.1" 200 None
2026-03-29 20:21:00 [motorway.uk] INFO: Saving data for 19713905: {'created_time': 1774815660.71297, 'last_price_update_time': 1774815660.712981, 'auction_closing_time': 1774884600.0}
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19713905') HTTP/1.1" 204 0
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 20343631
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 18279854
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 20486910
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486910%27 HTTP/1.1" 200 None
2026-03-29 20:21:00 [motorway.uk] INFO: Scrape type for 20486910: 1
2026-03-29 20:21:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 20396662
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720396662%27 HTTP/1.1" 200 None
2026-03-29 20:21:00 [motorway.uk] INFO: Scrape type for 20396662: 1
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658445710>
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7140c70b-51c4-5274-a187-68b60fb6b60e/7140c70b-51c4-5274-a187-68b60fb6b60e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9819%252F14979819%252Fexterior_rear_driver-1774624505509.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9819/14979819/exterior_rear_driver-1774624505509.jpg saved to cache
2026-03-29 20:21:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7140c70b-51c4-5274-a187-68b60fb6b60e
2026-03-29 20:21:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/5098/20475098/exterior_rear_passenger-1774691523897.jpg> (referer: None)
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 20497111
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 18991251
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 19358574
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 19916190
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 20386914
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 20473571
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 20372718
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 19803994
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 6427001
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 18641808
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 20288623
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 20475034
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 18052166
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 20487961
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 19939510
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 20461256
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 19966592
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719966592%27 HTTP/1.1" 200 None
2026-03-29 20:21:00 [motorway.uk] INFO: Scrape type for 19966592: 1
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 18928323
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 20009911
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 20350681
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 20480204
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720480204%27 HTTP/1.1" 200 None
2026-03-29 20:21:00 [motorway.uk] INFO: Scrape type for 20480204: 1
2026-03-29 20:21:00 [motorway.uk] INFO: Found listing with ID: 17069635
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717069635%27 HTTP/1.1" 200 None
2026-03-29 20:21:01 [motorway.uk] INFO: Scrape type for 17069635: 1
2026-03-29 20:21:01 [motorway.uk] INFO: Found listing with ID: 19856222
2026-03-29 20:21:01 [motorway.uk] INFO: Found listing with ID: 19751356
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719751356%27 HTTP/1.1" 200 None
2026-03-29 20:21:01 [motorway.uk] INFO: Scrape type for 19751356: 1
2026-03-29 20:21:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2177/20432177/interior_front_seats-1774708552342.jpg> (referer: None)
2026-03-29 20:21:01 [motorway.uk] INFO: Found listing with ID: 6251802
2026-03-29 20:21:01 [motorway.uk] INFO: Found listing with ID: 16994244
2026-03-29 20:21:01 [motorway.uk] INFO: Found listing with ID: 20200314
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720200314%27 HTTP/1.1" 200 None
2026-03-29 20:21:01 [motorway.uk] INFO: Scrape type for 20200314: 1
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ca7cd0>
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_612b94ca-a4b9-5d8c-a2ef-8ae7fffc2dd8/612b94ca-a4b9-5d8c-a2ef-8ae7fffc2dd8_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F5098%252F20475098%252Fexterior_rear_passenger-1774691523897.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/5098/20475098/exterior_rear_passenger-1774691523897.jpg saved to cache
2026-03-29 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 612b94ca-a4b9-5d8c-a2ef-8ae7fffc2dd8
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf356d0>
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e6aff2-c73f-5b73-818b-bd646f8f3a89/34e6aff2-c73f-5b73-818b-bd646f8f3a89_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2177%252F20432177%252Finterior_front_seats-1774708552342.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2177/20432177/interior_front_seats-1774708552342.jpg saved to cache
2026-03-29 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 34e6aff2-c73f-5b73-818b-bd646f8f3a89
2026-03-29 20:21:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9819/14979819/interior_front_seats-1774628590895.jpg> (referer: None)
2026-03-29 20:21:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9819/14979819/interior_rear_seats-1774624503375.jpg> (referer: None)
2026-03-29 20:21:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6245/20096245/instrument_cluster-1774713866954.jpg> (referer: None)
2026-03-29 20:21:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6245/20096245/interior_rear_seats-1774714135812.jpg> (referer: None)
2026-03-29 20:21:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20373131.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65bbefe10>
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7140c70b-51c4-5274-a187-68b60fb6b60e/7140c70b-51c4-5274-a187-68b60fb6b60e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9819%252F14979819%252Finterior_front_seats-1774628590895.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9819/14979819/interior_front_seats-1774628590895.jpg saved to cache
2026-03-29 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7140c70b-51c4-5274-a187-68b60fb6b60e
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582dccd0>
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7140c70b-51c4-5274-a187-68b60fb6b60e/7140c70b-51c4-5274-a187-68b60fb6b60e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9819%252F14979819%252Finterior_rear_seats-1774624503375.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9819/14979819/interior_rear_seats-1774624503375.jpg saved to cache
2026-03-29 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7140c70b-51c4-5274-a187-68b60fb6b60e
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bd90050>
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0beba8a3-9174-5484-abab-e26c29c10f3a/0beba8a3-9174-5484-abab-e26c29c10f3a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6245%252F20096245%252Finstrument_cluster-1774713866954.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6245/20096245/instrument_cluster-1774713866954.jpg saved to cache
2026-03-29 20:21:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0beba8a3-9174-5484-abab-e26c29c10f3a
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf51b90>
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0beba8a3-9174-5484-abab-e26c29c10f3a/0beba8a3-9174-5484-abab-e26c29c10f3a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6245%252F20096245%252Finterior_rear_seats-1774714135812.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6245/20096245/interior_rear_seats-1774714135812.jpg saved to cache
2026-03-29 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0beba8a3-9174-5484-abab-e26c29c10f3a
2026-03-29 20:21:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8254ddde-df63-521e-90ea-493c68286987 with identifier: 20373131
2026-03-29 20:21:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8254ddde-df63-521e-90ea-493c68286987 with scrape type 1
2026-03-29 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8254ddde-df63-521e-90ea-493c68286987
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3131%252F20373131%252Fexterior_front_driver-1774114654780.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3131/20373131/exterior_front_driver-1774114654780.jpg not downloaded yet
2026-03-29 20:21:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6245/20096245/docs_service_history-1774716621865.jpg?ixlib=js-3.8.0&auto=format&s=4229637ee58bdc6a2ecd16606a0a6dd7> (referer: None)
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3131%252F20373131%252Fexterior_rear_driver-1774114670782.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3131/20373131/exterior_rear_driver-1774114670782.jpg not downloaded yet
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3131%252F20373131%252Fexterior_front_passenger-1774705444464.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3131/20373131/exterior_front_passenger-1774705444464.jpg not downloaded yet
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3131%252F20373131%252Fexterior_rear_passenger-1774705461957.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3131/20373131/exterior_rear_passenger-1774705461957.jpg not downloaded yet
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3131%252F20373131%252Finterior_front_seats-1774115435974.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3131/20373131/interior_front_seats-1774115435974.jpg not downloaded yet
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3131%252F20373131%252Finterior_rear_seats-1774115456485.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3131/20373131/interior_rear_seats-1774115456485.jpg not downloaded yet
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3131%252F20373131%252Finterior_dashboard-1774115509299.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3131/20373131/interior_dashboard-1774115509299.jpg not downloaded yet
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3131%252F20373131%252Finterior_boot-1774115530669.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3131/20373131/interior_boot-1774115530669.jpg not downloaded yet
2026-03-29 20:21:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfd2350>
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0beba8a3-9174-5484-abab-e26c29c10f3a/0beba8a3-9174-5484-abab-e26c29c10f3a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6245%252F20096245%252Fdocs_service_history-1774716621865.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D4229637ee58bdc6a2ecd16606a0a6dd7') HTTP/1.1" 204 0
2026-03-29 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6245/20096245/docs_service_history-1774716621865.jpg?ixlib=js-3.8.0&auto=format&s=4229637ee58bdc6a2ecd16606a0a6dd7 saved to cache
2026-03-29 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0beba8a3-9174-5484-abab-e26c29c10f3a
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3131%252F20373131%252Fdocs_service_history-1774115883394.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbe3cd9a1dc8c31aca9970b0fc722c1d7%27 HTTP/1.1" 200 None
2026-03-29 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3131/20373131/docs_service_history-1774115883394.jpg?ixlib=js-3.8.0&auto=format&s=be3cd9a1dc8c31aca9970b0fc722c1d7 not downloaded yet
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3131%252F20373131%252Fdocs_service_history-1774115883671.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dad61b41ca85565bdd522872d4e61760e%27 HTTP/1.1" 200 None
2026-03-29 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3131/20373131/docs_service_history-1774115883671.jpg?ixlib=js-3.8.0&auto=format&s=ad61b41ca85565bdd522872d4e61760e not downloaded yet
2026-03-29 20:21:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6245/20096245/interior_boot-1774714639764.jpg> (referer: None)
2026-03-29 20:21:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:21:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658704a10>
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0beba8a3-9174-5484-abab-e26c29c10f3a/0beba8a3-9174-5484-abab-e26c29c10f3a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6245%252F20096245%252Finterior_boot-1774714639764.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6245/20096245/interior_boot-1774714639764.jpg saved to cache
2026-03-29 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0beba8a3-9174-5484-abab-e26c29c10f3a
2026-03-29 20:21:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3131/20373131/exterior_front_driver-1774114654780.jpg> (referer: None)
2026-03-29 20:21:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3131/20373131/docs_service_history-1774115883671.jpg?ixlib=js-3.8.0&auto=format&s=ad61b41ca85565bdd522872d4e61760e> (referer: None)
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65887d750>
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8254ddde-df63-521e-90ea-493c68286987/8254ddde-df63-521e-90ea-493c68286987_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3131%252F20373131%252Fexterior_front_driver-1774114654780.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3131/20373131/exterior_front_driver-1774114654780.jpg saved to cache
2026-03-29 20:21:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8254ddde-df63-521e-90ea-493c68286987
2026-03-29 20:21:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf4b250>
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8254ddde-df63-521e-90ea-493c68286987/8254ddde-df63-521e-90ea-493c68286987_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3131%252F20373131%252Fdocs_service_history-1774115883671.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dad61b41ca85565bdd522872d4e61760e') HTTP/1.1" 204 0
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3131/20373131/docs_service_history-1774115883671.jpg?ixlib=js-3.8.0&auto=format&s=ad61b41ca85565bdd522872d4e61760e saved to cache
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8254ddde-df63-521e-90ea-493c68286987
2026-03-29 20:21:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3131/20373131/docs_service_history-1774115883394.jpg?ixlib=js-3.8.0&auto=format&s=be3cd9a1dc8c31aca9970b0fc722c1d7> (referer: None)
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a16d10>
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8254ddde-df63-521e-90ea-493c68286987/8254ddde-df63-521e-90ea-493c68286987_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3131%252F20373131%252Fdocs_service_history-1774115883394.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dbe3cd9a1dc8c31aca9970b0fc722c1d7') HTTP/1.1" 204 0
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3131/20373131/docs_service_history-1774115883394.jpg?ixlib=js-3.8.0&auto=format&s=be3cd9a1dc8c31aca9970b0fc722c1d7 saved to cache
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8254ddde-df63-521e-90ea-493c68286987
2026-03-29 20:21:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20396662.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3131/20373131/interior_boot-1774115530669.jpg> (referer: None)
2026-03-29 20:21:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33d50bb3-5b14-58c6-9355-85589e515e9f with identifier: 20396662
2026-03-29 20:21:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33d50bb3-5b14-58c6-9355-85589e515e9f with scrape type 1
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 33d50bb3-5b14-58c6-9355-85589e515e9f
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6662%252F20396662%252Fexterior_front_driver-1774780143448.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6662/20396662/exterior_front_driver-1774780143448.jpg not downloaded yet
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6662%252F20396662%252Fexterior_rear_driver-1774780163388.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6662/20396662/exterior_rear_driver-1774780163388.jpg not downloaded yet
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6662%252F20396662%252Fexterior_front_passenger-1774780181167.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6662/20396662/exterior_front_passenger-1774780181167.jpg not downloaded yet
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6662%252F20396662%252Fexterior_rear_passenger-1774780170484.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6662/20396662/exterior_rear_passenger-1774780170484.jpg not downloaded yet
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a8cc90>
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8254ddde-df63-521e-90ea-493c68286987/8254ddde-df63-521e-90ea-493c68286987_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3131%252F20373131%252Finterior_boot-1774115530669.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3131/20373131/interior_boot-1774115530669.jpg saved to cache
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8254ddde-df63-521e-90ea-493c68286987
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6662%252F20396662%252Finterior_front_seats-1774782045058.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6662/20396662/interior_front_seats-1774782045058.jpg not downloaded yet
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6662%252F20396662%252Finterior_rear_seats-1774782179983.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6662/20396662/interior_rear_seats-1774782179983.jpg not downloaded yet
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6662%252F20396662%252Finterior_dashboard-1774782105704.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6662/20396662/interior_dashboard-1774782105704.jpg not downloaded yet
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6662%252F20396662%252Finterior_boot-1774780455961.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6662/20396662/interior_boot-1774780455961.jpg not downloaded yet
2026-03-29 20:21:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3131/20373131/interior_dashboard-1774115509299.jpg> (referer: None)
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6662%252F20396662%252Fdamage_scratches-1774780191897.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6662/20396662/damage_scratches-1774780191897.jpg not downloaded yet
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6662%252F20396662%252Fdamage_dents-1774780213468.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6662/20396662/damage_dents-1774780213468.jpg not downloaded yet
2026-03-29 20:21:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65830c110>
2026-03-29 20:21:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8254ddde-df63-521e-90ea-493c68286987/8254ddde-df63-521e-90ea-493c68286987_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3131%252F20373131%252Finterior_dashboard-1774115509299.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3131/20373131/interior_dashboard-1774115509299.jpg saved to cache
2026-03-29 20:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8254ddde-df63-521e-90ea-493c68286987
2026-03-29 20:21:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3131/20373131/interior_front_seats-1774115435974.jpg> (referer: None)
2026-03-29 20:21:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6662/20396662/interior_boot-1774780455961.jpg> (referer: None)
2026-03-29 20:21:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65830e110>
2026-03-29 20:21:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8254ddde-df63-521e-90ea-493c68286987/8254ddde-df63-521e-90ea-493c68286987_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3131%252F20373131%252Finterior_front_seats-1774115435974.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3131/20373131/interior_front_seats-1774115435974.jpg saved to cache
2026-03-29 20:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8254ddde-df63-521e-90ea-493c68286987
2026-03-29 20:21:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3131/20373131/interior_rear_seats-1774115456485.jpg> (referer: None)
2026-03-29 20:21:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589d99d0>
2026-03-29 20:21:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d50bb3-5b14-58c6-9355-85589e515e9f/33d50bb3-5b14-58c6-9355-85589e515e9f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6662%252F20396662%252Finterior_boot-1774780455961.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6662/20396662/interior_boot-1774780455961.jpg saved to cache
2026-03-29 20:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 33d50bb3-5b14-58c6-9355-85589e515e9f
2026-03-29 20:21:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f8c850>
2026-03-29 20:21:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8254ddde-df63-521e-90ea-493c68286987/8254ddde-df63-521e-90ea-493c68286987_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3131%252F20373131%252Finterior_rear_seats-1774115456485.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3131/20373131/interior_rear_seats-1774115456485.jpg saved to cache
2026-03-29 20:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8254ddde-df63-521e-90ea-493c68286987
2026-03-29 20:21:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6662/20396662/damage_dents-1774780213468.jpg> (referer: None)
2026-03-29 20:21:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589d9150>
2026-03-29 20:21:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d50bb3-5b14-58c6-9355-85589e515e9f/33d50bb3-5b14-58c6-9355-85589e515e9f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6662%252F20396662%252Fdamage_dents-1774780213468.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6662/20396662/damage_dents-1774780213468.jpg saved to cache
2026-03-29 20:21:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 33d50bb3-5b14-58c6-9355-85589e515e9f
2026-03-29 20:21:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6662/20396662/damage_scratches-1774780191897.jpg> (referer: None)
2026-03-29 20:21:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1512&page=42&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65857b390>
2026-03-29 20:21:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d50bb3-5b14-58c6-9355-85589e515e9f/33d50bb3-5b14-58c6-9355-85589e515e9f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6662%252F20396662%252Fdamage_scratches-1774780191897.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6662/20396662/damage_scratches-1774780191897.jpg saved to cache
2026-03-29 20:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 33d50bb3-5b14-58c6-9355-85589e515e9f
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 19943403
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 20465481
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 19602701
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 19736042
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 20475976
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 8134023
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 18661288
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718661288%27 HTTP/1.1" 200 None
2026-03-29 20:21:05 [motorway.uk] INFO: Scrape type for 18661288: 1
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 4637064
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%274637064%27 HTTP/1.1" 200 None
2026-03-29 20:21:05 [motorway.uk] INFO: Scrape type for 4637064: 2
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 9361295
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 20320814
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 20076402
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720076402%27 HTTP/1.1" 200 None
2026-03-29 20:21:05 [motorway.uk] INFO: Scrape type for 20076402: 1
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 20391441
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 20455567
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 12337686
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712337686%27 HTTP/1.1" 200 None
2026-03-29 20:21:05 [motorway.uk] INFO: Scrape type for 12337686: 1
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 16283042
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716283042%27 HTTP/1.1" 200 None
2026-03-29 20:21:05 [motorway.uk] INFO: Scrape type for 16283042: 1
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 20488544
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720488544%27 HTTP/1.1" 200 None
2026-03-29 20:21:05 [motorway.uk] INFO: Scrape type for 20488544: 1
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 7801463
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 19420355
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 19358892
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719358892%27 HTTP/1.1" 200 None
2026-03-29 20:21:05 [motorway.uk] INFO: Scrape type for 19358892: 1
2026-03-29 20:21:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6662/20396662/interior_dashboard-1774782105704.jpg> (referer: None)
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 20427982
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 19234910
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719234910%27 HTTP/1.1" 200 None
2026-03-29 20:21:05 [motorway.uk] INFO: Scrape type for 19234910: 1
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 20380457
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 5025216
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 3991169
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 9765536
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 13033676
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 20499852
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 18764881
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 20490232
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 20084784
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 14381280
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714381280%27 HTTP/1.1" 200 None
2026-03-29 20:21:05 [motorway.uk] INFO: Scrape type for 14381280: 1
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 20489994
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 20471821
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 19513424
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719513424%27 HTTP/1.1" 200 None
2026-03-29 20:21:05 [motorway.uk] INFO: Scrape type for 19513424: 1
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 20467422
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720467422%27 HTTP/1.1" 200 None
2026-03-29 20:21:05 [motorway.uk] INFO: Scrape type for 20467422: 1
2026-03-29 20:21:05 [motorway.uk] INFO: Found listing with ID: 20191328
2026-03-29 20:21:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6662/20396662/exterior_rear_passenger-1774780170484.jpg> (referer: None)
2026-03-29 20:21:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6662/20396662/interior_rear_seats-1774782179983.jpg> (referer: None)
2026-03-29 20:21:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b674d0>
2026-03-29 20:21:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d50bb3-5b14-58c6-9355-85589e515e9f/33d50bb3-5b14-58c6-9355-85589e515e9f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6662%252F20396662%252Finterior_dashboard-1774782105704.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6662/20396662/interior_dashboard-1774782105704.jpg saved to cache
2026-03-29 20:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 33d50bb3-5b14-58c6-9355-85589e515e9f
2026-03-29 20:21:05 [scrapy.extensions.logstats] INFO: Crawled 365 pages (at 30 pages/min), scraped 211 items (at 27 items/min)
2026-03-29 20:21:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 304MiB
2026-03-29 20:21:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658316c10>
2026-03-29 20:21:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d50bb3-5b14-58c6-9355-85589e515e9f/33d50bb3-5b14-58c6-9355-85589e515e9f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6662%252F20396662%252Fexterior_rear_passenger-1774780170484.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6662/20396662/exterior_rear_passenger-1774780170484.jpg saved to cache
2026-03-29 20:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 33d50bb3-5b14-58c6-9355-85589e515e9f
2026-03-29 20:21:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589d88d0>
2026-03-29 20:21:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d50bb3-5b14-58c6-9355-85589e515e9f/33d50bb3-5b14-58c6-9355-85589e515e9f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6662%252F20396662%252Finterior_rear_seats-1774782179983.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6662/20396662/interior_rear_seats-1774782179983.jpg saved to cache
2026-03-29 20:21:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 33d50bb3-5b14-58c6-9355-85589e515e9f
2026-03-29 20:21:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6662/20396662/interior_front_seats-1774782045058.jpg> (referer: None)
2026-03-29 20:21:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587c9250>
2026-03-29 20:21:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d50bb3-5b14-58c6-9355-85589e515e9f/33d50bb3-5b14-58c6-9355-85589e515e9f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6662%252F20396662%252Finterior_front_seats-1774782045058.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6662/20396662/interior_front_seats-1774782045058.jpg saved to cache
2026-03-29 20:21:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 33d50bb3-5b14-58c6-9355-85589e515e9f
2026-03-29 20:21:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19998992.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b5551d2-4800-5e8d-85a0-a53d93133a64 with identifier: 19998992
2026-03-29 20:21:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b5551d2-4800-5e8d-85a0-a53d93133a64 with scrape type 1
2026-03-29 20:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6b5551d2-4800-5e8d-85a0-a53d93133a64
2026-03-29 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8992%252F19998992%252Fexterior_front_driver-1774700982483.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8992/19998992/exterior_front_driver-1774700982483.jpg not downloaded yet
2026-03-29 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8992%252F19998992%252Fexterior_rear_driver-1774701004090.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8992/19998992/exterior_rear_driver-1774701004090.jpg not downloaded yet
2026-03-29 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8992%252F19998992%252Fexterior_front_passenger-1774701032714.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8992/19998992/exterior_front_passenger-1774701032714.jpg not downloaded yet
2026-03-29 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8992%252F19998992%252Fexterior_rear_passenger-1774701018021.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8992/19998992/exterior_rear_passenger-1774701018021.jpg not downloaded yet
2026-03-29 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8992%252F19998992%252Finterior_front_seats-1774708889706.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8992/19998992/interior_front_seats-1774708889706.jpg not downloaded yet
2026-03-29 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8992%252F19998992%252Finterior_rear_seats-1774701472113.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8992/19998992/interior_rear_seats-1774701472113.jpg not downloaded yet
2026-03-29 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8992%252F19998992%252Finterior_dashboard-1774709092737.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8992/19998992/interior_dashboard-1774709092737.jpg not downloaded yet
2026-03-29 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8992%252F19998992%252Finterior_boot-1774708908350.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8992/19998992/interior_boot-1774708908350.jpg not downloaded yet
2026-03-29 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8992%252F19998992%252Fdocs_service_history-1774702187906.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5163cc54df0d06d210339669c04d2ee2%27 HTTP/1.1" 200 None
2026-03-29 20:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8992/19998992/docs_service_history-1774702187906.jpg?ixlib=js-3.8.0&auto=format&s=5163cc54df0d06d210339669c04d2ee2 not downloaded yet
2026-03-29 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8992%252F19998992%252Fdocs_service_history-1774702188583.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D33b5a45abd4f9b41643d1a27d996c22e%27 HTTP/1.1" 200 None
2026-03-29 20:21:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8992/19998992/docs_service_history-1774702188583.jpg?ixlib=js-3.8.0&auto=format&s=33b5a45abd4f9b41643d1a27d996c22e not downloaded yet
2026-03-29 20:21:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19863425.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6214fd43-a88e-5166-871f-f30917538af1 with identifier: 19863425
2026-03-29 20:21:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6214fd43-a88e-5166-871f-f30917538af1 with scrape type 1
2026-03-29 20:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6214fd43-a88e-5166-871f-f30917538af1
2026-03-29 20:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3425%252F19863425%252Fexterior_front_driver-1774627239822.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3425/19863425/exterior_front_driver-1774627239822.jpg not downloaded yet
2026-03-29 20:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3425%252F19863425%252Fexterior_rear_driver-1774627265415.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3425/19863425/exterior_rear_driver-1774627265415.jpg not downloaded yet
2026-03-29 20:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3425%252F19863425%252Fexterior_front_passenger-1774627314783.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3425/19863425/exterior_front_passenger-1774627314783.jpg not downloaded yet
2026-03-29 20:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3425%252F19863425%252Fexterior_rear_passenger-1774627289880.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3425/19863425/exterior_rear_passenger-1774627289880.jpg not downloaded yet
2026-03-29 20:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3425%252F19863425%252Finterior_front_seats-1774628162497.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3425/19863425/interior_front_seats-1774628162497.jpg not downloaded yet
2026-03-29 20:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3425%252F19863425%252Finterior_rear_seats-1774628177473.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3425/19863425/interior_rear_seats-1774628177473.jpg not downloaded yet
2026-03-29 20:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3425%252F19863425%252Finterior_dashboard-1774629418375.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3425/19863425/interior_dashboard-1774629418375.jpg not downloaded yet
2026-03-29 20:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3425%252F19863425%252Finstrument_cluster-1774628107948.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3425/19863425/instrument_cluster-1774628107948.jpg not downloaded yet
2026-03-29 20:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3425%252F19863425%252Finterior_boot-1774628297106.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3425/19863425/interior_boot-1774628297106.jpg not downloaded yet
2026-03-29 20:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3425%252F19863425%252Fdocs_service_history-1774628668682.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dafab3982700094bbbd05b2951e7bf9bb%27 HTTP/1.1" 200 None
2026-03-29 20:21:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3425/19863425/docs_service_history-1774628668682.jpg?ixlib=js-3.8.0&auto=format&s=afab3982700094bbbd05b2951e7bf9bb not downloaded yet
2026-03-29 20:21:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8992/19998992/docs_service_history-1774702188583.jpg?ixlib=js-3.8.0&auto=format&s=33b5a45abd4f9b41643d1a27d996c22e> (referer: None)
2026-03-29 20:21:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583e7910>
2026-03-29 20:21:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b5551d2-4800-5e8d-85a0-a53d93133a64/6b5551d2-4800-5e8d-85a0-a53d93133a64_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8992%252F19998992%252Fdocs_service_history-1774702188583.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D33b5a45abd4f9b41643d1a27d996c22e') HTTP/1.1" 204 0
2026-03-29 20:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8992/19998992/docs_service_history-1774702188583.jpg?ixlib=js-3.8.0&auto=format&s=33b5a45abd4f9b41643d1a27d996c22e saved to cache
2026-03-29 20:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6b5551d2-4800-5e8d-85a0-a53d93133a64
2026-03-29 20:21:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3425/19863425/docs_service_history-1774628668682.jpg?ixlib=js-3.8.0&auto=format&s=afab3982700094bbbd05b2951e7bf9bb> (referer: None)
2026-03-29 20:21:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658adde10>
2026-03-29 20:21:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6214fd43-a88e-5166-871f-f30917538af1/6214fd43-a88e-5166-871f-f30917538af1_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3425%252F19863425%252Fdocs_service_history-1774628668682.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dafab3982700094bbbd05b2951e7bf9bb') HTTP/1.1" 204 0
2026-03-29 20:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3425/19863425/docs_service_history-1774628668682.jpg?ixlib=js-3.8.0&auto=format&s=afab3982700094bbbd05b2951e7bf9bb saved to cache
2026-03-29 20:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6214fd43-a88e-5166-871f-f30917538af1
2026-03-29 20:21:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3425/19863425/interior_boot-1774628297106.jpg> (referer: None)
2026-03-29 20:21:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:21:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587c92d0>
2026-03-29 20:21:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6214fd43-a88e-5166-871f-f30917538af1/6214fd43-a88e-5166-871f-f30917538af1_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3425%252F19863425%252Finterior_boot-1774628297106.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3425/19863425/interior_boot-1774628297106.jpg saved to cache
2026-03-29 20:21:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6214fd43-a88e-5166-871f-f30917538af1
2026-03-29 20:21:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3425/19863425/instrument_cluster-1774628107948.jpg> (referer: None)
2026-03-29 20:21:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:21:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ade010>
2026-03-29 20:21:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6214fd43-a88e-5166-871f-f30917538af1/6214fd43-a88e-5166-871f-f30917538af1_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3425%252F19863425%252Finstrument_cluster-1774628107948.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3425/19863425/instrument_cluster-1774628107948.jpg saved to cache
2026-03-29 20:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6214fd43-a88e-5166-871f-f30917538af1
2026-03-29 20:21:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3425/19863425/interior_dashboard-1774629418375.jpg> (referer: None)
2026-03-29 20:21:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599e8990>
2026-03-29 20:21:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6214fd43-a88e-5166-871f-f30917538af1/6214fd43-a88e-5166-871f-f30917538af1_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3425%252F19863425%252Finterior_dashboard-1774629418375.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3425/19863425/interior_dashboard-1774629418375.jpg saved to cache
2026-03-29 20:21:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6214fd43-a88e-5166-871f-f30917538af1
2026-03-29 20:21:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3425/19863425/interior_rear_seats-1774628177473.jpg> (referer: None)
2026-03-29 20:21:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:21:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583e5310>
2026-03-29 20:21:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6214fd43-a88e-5166-871f-f30917538af1/6214fd43-a88e-5166-871f-f30917538af1_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:21:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3425%252F19863425%252Finterior_rear_seats-1774628177473.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3425/19863425/interior_rear_seats-1774628177473.jpg saved to cache
2026-03-29 20:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6214fd43-a88e-5166-871f-f30917538af1
2026-03-29 20:21:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3425/19863425/interior_front_seats-1774628162497.jpg> (referer: None)
2026-03-29 20:21:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:21:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587c8250>
2026-03-29 20:21:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6214fd43-a88e-5166-871f-f30917538af1/6214fd43-a88e-5166-871f-f30917538af1_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3425%252F19863425%252Finterior_front_seats-1774628162497.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3425/19863425/interior_front_seats-1774628162497.jpg saved to cache
2026-03-29 20:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6214fd43-a88e-5166-871f-f30917538af1
2026-03-29 20:21:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3425/19863425/exterior_rear_passenger-1774627289880.jpg> (referer: None)
2026-03-29 20:21:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583e40d0>
2026-03-29 20:21:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6214fd43-a88e-5166-871f-f30917538af1/6214fd43-a88e-5166-871f-f30917538af1_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3425%252F19863425%252Fexterior_rear_passenger-1774627289880.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3425/19863425/exterior_rear_passenger-1774627289880.jpg saved to cache
2026-03-29 20:21:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6214fd43-a88e-5166-871f-f30917538af1
2026-03-29 20:21:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3425/19863425/exterior_front_passenger-1774627314783.jpg> (referer: None)
2026-03-29 20:21:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e85e10>
2026-03-29 20:21:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6214fd43-a88e-5166-871f-f30917538af1/6214fd43-a88e-5166-871f-f30917538af1_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3425%252F19863425%252Fexterior_front_passenger-1774627314783.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3425/19863425/exterior_front_passenger-1774627314783.jpg saved to cache
2026-03-29 20:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6214fd43-a88e-5166-871f-f30917538af1
2026-03-29 20:21:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15023759.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a8982d6-00d0-5b53-bfdc-4766d1afce5d with identifier: 15023759
2026-03-29 20:21:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a8982d6-00d0-5b53-bfdc-4766d1afce5d with scrape type 1
2026-03-29 20:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5a8982d6-00d0-5b53-bfdc-4766d1afce5d
2026-03-29 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3759%252F15023759%252F15023759-exterior_front_driver-default-1774795191074.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3759/15023759/15023759-exterior_front_driver-default-1774795191074.jpg not downloaded yet
2026-03-29 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3759%252F15023759%252F15023759-exterior_rear_driver-default-1774795190224.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3759/15023759/15023759-exterior_rear_driver-default-1774795190224.jpg not downloaded yet
2026-03-29 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3759%252F15023759%252F15023759-exterior_front_passenger-default-1774795188903.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3759/15023759/15023759-exterior_front_passenger-default-1774795188903.jpg not downloaded yet
2026-03-29 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3759%252F15023759%252F15023759-exterior_rear_passenger-default-1774795185314.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3759/15023759/15023759-exterior_rear_passenger-default-1774795185314.jpg not downloaded yet
2026-03-29 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3759%252F15023759%252F15023759-interior_front_seats-default-1774795170367.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3759/15023759/15023759-interior_front_seats-default-1774795170367.jpg not downloaded yet
2026-03-29 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3759%252F15023759%252F15023759-interior_rear_seats-default-1774795168620.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3759/15023759/15023759-interior_rear_seats-default-1774795168620.jpg not downloaded yet
2026-03-29 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3759%252F15023759%252F15023759-interior_dashboard-default-1774795178536.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3759/15023759/15023759-interior_dashboard-default-1774795178536.jpg not downloaded yet
2026-03-29 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3759%252F15023759%252F15023759-instrument_cluster-default-1774795297434.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3759/15023759/15023759-instrument_cluster-default-1774795297434.jpg not downloaded yet
2026-03-29 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3759%252F15023759%252F15023759-interior_boot-default-1774795165330.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3759/15023759/15023759-interior_boot-default-1774795165330.jpg not downloaded yet
2026-03-29 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3759%252F15023759%252Fdocs_service_history-1773857516221.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D00489102645790cf17548286329e0c1c%27 HTTP/1.1" 200 None
2026-03-29 20:21:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3759/15023759/docs_service_history-1773857516221.jpeg?ixlib=js-3.8.0&auto=format&s=00489102645790cf17548286329e0c1c already downloaded
2026-03-29 20:21:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3425/19863425/exterior_front_driver-1774627239822.jpg> (referer: None)
2026-03-29 20:21:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3425/19863425/exterior_rear_driver-1774627265415.jpg> (referer: None)
2026-03-29 20:21:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658405ad0>
2026-03-29 20:21:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6214fd43-a88e-5166-871f-f30917538af1/6214fd43-a88e-5166-871f-f30917538af1_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3425%252F19863425%252Fexterior_front_driver-1774627239822.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3425/19863425/exterior_front_driver-1774627239822.jpg saved to cache
2026-03-29 20:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6214fd43-a88e-5166-871f-f30917538af1
2026-03-29 20:21:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6580fb290>
2026-03-29 20:21:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6214fd43-a88e-5166-871f-f30917538af1/6214fd43-a88e-5166-871f-f30917538af1_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3425%252F19863425%252Fexterior_rear_driver-1774627265415.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3425/19863425/exterior_rear_driver-1774627265415.jpg saved to cache
2026-03-29 20:21:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6214fd43-a88e-5166-871f-f30917538af1
2026-03-29 20:21:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6214fd43-a88e-5166-871f-f30917538af1, skipping ID generation
2026-03-29 20:21:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6214fd43-a88e-5166-871f-f30917538af1 with scrape type 1
2026-03-29 20:21:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6214fd43-a88e-5166-871f-f30917538af1 sending to next pipeline
2026-03-29 20:21:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6214fd43-a88e-5166-871f-f30917538af1, identifier: 19863425
2026-03-29 20:21:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6214fd43-a88e-5166-871f-f30917538af1 with identifier: 19863425
2026-03-29 20:21:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6214fd43-a88e-5166-871f-f30917538af1 with identifier: 19863425
2026-03-29 20:21:13 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6214fd43-a88e-5166-871f-f30917538af1 with identifier: 19863425 to the API
2026-03-29 20:21:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:21:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:21:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3425/19863425/exterior_rear_driver-1774627265415.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '6214fd43-a88e-5166-871f-f30917538af1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'GK23 NBN',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19863425',
'listing': 'auction',
'location': 'Kent Deal',
'make': 'Nissan',
'model': 'Juke',
'odometer': 15149,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6214fd43-a88e-5166-871f-f30917538af1/6214fd43-a88e-5166-871f-f30917538af1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1626626,
'Height': 2629,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3425/19863425/exterior_front_driver-1774627239822.jpg',
'Width': 3505},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6214fd43-a88e-5166-871f-f30917538af1/6214fd43-a88e-5166-871f-f30917538af1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 996264,
'Height': 2018,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3425/19863425/exterior_rear_driver-1774627265415.jpg',
'Width': 2691},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6214fd43-a88e-5166-871f-f30917538af1/6214fd43-a88e-5166-871f-f30917538af1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1602075,
'Height': 2366,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3425/19863425/exterior_front_passenger-1774627314783.jpg',
'Width': 3155},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6214fd43-a88e-5166-871f-f30917538af1/6214fd43-a88e-5166-871f-f30917538af1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1500490,
'Height': 2303,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3425/19863425/exterior_rear_passenger-1774627289880.jpg',
'Width': 3071},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6214fd43-a88e-5166-871f-f30917538af1/6214fd43-a88e-5166-871f-f30917538af1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3540602,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3425/19863425/interior_front_seats-1774628162497.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6214fd43-a88e-5166-871f-f30917538af1/6214fd43-a88e-5166-871f-f30917538af1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2819282,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3425/19863425/interior_rear_seats-1774628177473.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6214fd43-a88e-5166-871f-f30917538af1/6214fd43-a88e-5166-871f-f30917538af1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2942450,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3425/19863425/interior_dashboard-1774629418375.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6214fd43-a88e-5166-871f-f30917538af1/6214fd43-a88e-5166-871f-f30917538af1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2783926,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3425/19863425/instrument_cluster-1774628107948.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6214fd43-a88e-5166-871f-f30917538af1/6214fd43-a88e-5166-871f-f30917538af1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2763074,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3425/19863425/interior_boot-1774628297106.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6214fd43-a88e-5166-871f-f30917538af1/6214fd43-a88e-5166-871f-f30917538af1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 757545,
'Height': 3374,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3425/19863425/docs_service_history-1774628668682.jpg?ixlib=js-3.8.0&auto=format&s=afab3982700094bbbd05b2951e7bf9bb',
'Width': 2550}],
'price': 14288,
'price_includes_vat': False,
'registration_date': '2023-06-30',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Juke N-Connecta HEV CVT',
'transmission': 'automatic',
'trim': 'N-Connecta HEV CVT',
'vin': 'SJNFCAF16U1250680',
'year': 2023}
2026-03-29 20:21:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719863425%27 HTTP/1.1" 200 None
2026-03-29 20:21:14 [motorway.uk] INFO: Saving data for 19863425: {'created_time': 1774815674.239035, 'last_price_update_time': 1774815674.239046, 'auction_closing_time': 1774884600.0}
2026-03-29 20:21:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19863425') HTTP/1.1" 204 0
2026-03-29 20:21:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3759/15023759/15023759-instrument_cluster-default-1774795297434.jpg> (referer: None)
2026-03-29 20:21:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3759/15023759/15023759-interior_boot-default-1774795165330.jpg> (referer: None)
2026-03-29 20:21:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659990a50>
2026-03-29 20:21:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a8982d6-00d0-5b53-bfdc-4766d1afce5d/5a8982d6-00d0-5b53-bfdc-4766d1afce5d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:21:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3759%252F15023759%252F15023759-instrument_cluster-default-1774795297434.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3759/15023759/15023759-instrument_cluster-default-1774795297434.jpg saved to cache
2026-03-29 20:21:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5a8982d6-00d0-5b53-bfdc-4766d1afce5d
2026-03-29 20:21:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582deb50>
2026-03-29 20:21:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a8982d6-00d0-5b53-bfdc-4766d1afce5d/5a8982d6-00d0-5b53-bfdc-4766d1afce5d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:21:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3759%252F15023759%252F15023759-interior_boot-default-1774795165330.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3759/15023759/15023759-interior_boot-default-1774795165330.jpg saved to cache
2026-03-29 20:21:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5a8982d6-00d0-5b53-bfdc-4766d1afce5d
2026-03-29 20:21:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3759/15023759/15023759-interior_dashboard-default-1774795178536.jpg> (referer: None)
2026-03-29 20:21:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659abc810>
2026-03-29 20:21:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a8982d6-00d0-5b53-bfdc-4766d1afce5d/5a8982d6-00d0-5b53-bfdc-4766d1afce5d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:21:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3759%252F15023759%252F15023759-interior_dashboard-default-1774795178536.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3759/15023759/15023759-interior_dashboard-default-1774795178536.jpg saved to cache
2026-03-29 20:21:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5a8982d6-00d0-5b53-bfdc-4766d1afce5d
2026-03-29 20:21:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3759/15023759/15023759-interior_rear_seats-default-1774795168620.jpg> (referer: None)
2026-03-29 20:21:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599fcb10>
2026-03-29 20:21:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a8982d6-00d0-5b53-bfdc-4766d1afce5d/5a8982d6-00d0-5b53-bfdc-4766d1afce5d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3759%252F15023759%252F15023759-interior_rear_seats-default-1774795168620.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3759/15023759/15023759-interior_rear_seats-default-1774795168620.jpg saved to cache
2026-03-29 20:21:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5a8982d6-00d0-5b53-bfdc-4766d1afce5d
2026-03-29 20:21:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3759/15023759/15023759-interior_front_seats-default-1774795170367.jpg> (referer: None)
2026-03-29 20:21:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659abcad0>
2026-03-29 20:21:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a8982d6-00d0-5b53-bfdc-4766d1afce5d/5a8982d6-00d0-5b53-bfdc-4766d1afce5d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3759%252F15023759%252F15023759-interior_front_seats-default-1774795170367.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3759/15023759/15023759-interior_front_seats-default-1774795170367.jpg saved to cache
2026-03-29 20:21:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5a8982d6-00d0-5b53-bfdc-4766d1afce5d
2026-03-29 20:21:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3759/15023759/15023759-exterior_rear_passenger-default-1774795185314.jpg> (referer: None)
2026-03-29 20:21:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3759/15023759/15023759-exterior_front_passenger-default-1774795188903.jpg> (referer: None)
2026-03-29 20:21:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599fd610>
2026-03-29 20:21:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a8982d6-00d0-5b53-bfdc-4766d1afce5d/5a8982d6-00d0-5b53-bfdc-4766d1afce5d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3759%252F15023759%252F15023759-exterior_rear_passenger-default-1774795185314.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3759/15023759/15023759-exterior_rear_passenger-default-1774795185314.jpg saved to cache
2026-03-29 20:21:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5a8982d6-00d0-5b53-bfdc-4766d1afce5d
2026-03-29 20:21:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b5ac10>
2026-03-29 20:21:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a8982d6-00d0-5b53-bfdc-4766d1afce5d/5a8982d6-00d0-5b53-bfdc-4766d1afce5d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3759%252F15023759%252F15023759-exterior_front_passenger-default-1774795188903.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3759/15023759/15023759-exterior_front_passenger-default-1774795188903.jpg saved to cache
2026-03-29 20:21:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5a8982d6-00d0-5b53-bfdc-4766d1afce5d
2026-03-29 20:21:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3759/15023759/15023759-exterior_rear_driver-default-1774795190224.jpg> (referer: None)
2026-03-29 20:21:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3759/15023759/15023759-exterior_front_driver-default-1774795191074.jpg> (referer: None)
2026-03-29 20:21:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659993350>
2026-03-29 20:21:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a8982d6-00d0-5b53-bfdc-4766d1afce5d/5a8982d6-00d0-5b53-bfdc-4766d1afce5d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3759%252F15023759%252F15023759-exterior_rear_driver-default-1774795190224.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3759/15023759/15023759-exterior_rear_driver-default-1774795190224.jpg saved to cache
2026-03-29 20:21:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5a8982d6-00d0-5b53-bfdc-4766d1afce5d
2026-03-29 20:21:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659991010>
2026-03-29 20:21:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a8982d6-00d0-5b53-bfdc-4766d1afce5d/5a8982d6-00d0-5b53-bfdc-4766d1afce5d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3759%252F15023759%252F15023759-exterior_front_driver-default-1774795191074.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3759/15023759/15023759-exterior_front_driver-default-1774795191074.jpg saved to cache
2026-03-29 20:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5a8982d6-00d0-5b53-bfdc-4766d1afce5d
2026-03-29 20:21:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a8982d6-00d0-5b53-bfdc-4766d1afce5d, skipping ID generation
2026-03-29 20:21:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a8982d6-00d0-5b53-bfdc-4766d1afce5d with scrape type 1
2026-03-29 20:21:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5a8982d6-00d0-5b53-bfdc-4766d1afce5d sending to next pipeline
2026-03-29 20:21:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5a8982d6-00d0-5b53-bfdc-4766d1afce5d, identifier: 15023759
2026-03-29 20:21:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5a8982d6-00d0-5b53-bfdc-4766d1afce5d with identifier: 15023759
2026-03-29 20:21:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5a8982d6-00d0-5b53-bfdc-4766d1afce5d with identifier: 15023759
2026-03-29 20:21:16 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5a8982d6-00d0-5b53-bfdc-4766d1afce5d with identifier: 15023759 to the API
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:21:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3759/15023759/15023759-exterior_front_driver-default-1774795191074.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '5a8982d6-00d0-5b53-bfdc-4766d1afce5d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'SK15 JXY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/15023759',
'listing': 'auction',
'location': 'West Sussex Hassocks',
'make': 'BMW',
'model': '3 Series',
'odometer': 58644,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a8982d6-00d0-5b53-bfdc-4766d1afce5d/5a8982d6-00d0-5b53-bfdc-4766d1afce5d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1316722,
'Height': 2283,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3759/15023759/15023759-exterior_front_driver-default-1774795191074.jpg',
'Width': 3044},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a8982d6-00d0-5b53-bfdc-4766d1afce5d/5a8982d6-00d0-5b53-bfdc-4766d1afce5d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 996548,
'Height': 2402,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3759/15023759/15023759-exterior_rear_driver-default-1774795190224.jpg',
'Width': 3203},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a8982d6-00d0-5b53-bfdc-4766d1afce5d/5a8982d6-00d0-5b53-bfdc-4766d1afce5d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1323398,
'Height': 2219,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3759/15023759/15023759-exterior_front_passenger-default-1774795188903.jpg',
'Width': 2959},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a8982d6-00d0-5b53-bfdc-4766d1afce5d/5a8982d6-00d0-5b53-bfdc-4766d1afce5d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1251945,
'Height': 2420,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3759/15023759/15023759-exterior_rear_passenger-default-1774795185314.jpg',
'Width': 3227},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a8982d6-00d0-5b53-bfdc-4766d1afce5d/5a8982d6-00d0-5b53-bfdc-4766d1afce5d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2222284,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3759/15023759/15023759-interior_front_seats-default-1774795170367.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a8982d6-00d0-5b53-bfdc-4766d1afce5d/5a8982d6-00d0-5b53-bfdc-4766d1afce5d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2000259,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3759/15023759/15023759-interior_rear_seats-default-1774795168620.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a8982d6-00d0-5b53-bfdc-4766d1afce5d/5a8982d6-00d0-5b53-bfdc-4766d1afce5d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1978224,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3759/15023759/15023759-interior_dashboard-default-1774795178536.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a8982d6-00d0-5b53-bfdc-4766d1afce5d/5a8982d6-00d0-5b53-bfdc-4766d1afce5d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2206915,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3759/15023759/15023759-instrument_cluster-default-1774795297434.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a8982d6-00d0-5b53-bfdc-4766d1afce5d/5a8982d6-00d0-5b53-bfdc-4766d1afce5d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2829122,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3759/15023759/15023759-interior_boot-default-1774795165330.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a67a3b36-1890-5f2b-96a0-a0815efa51f8/a67a3b36-1890-5f2b-96a0-a0815efa51f8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331557,
'Height': 2622,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3759/15023759/docs_service_history-1773857516221.jpeg?ixlib=js-3.8.0&auto=format&s=00489102645790cf17548286329e0c1c',
'Width': 1206}],
'price': 10450,
'price_includes_vat': False,
'registration_date': '2015-03-20',
'seats_number': None,
'seller_name': None,
'title': 'BMW 320d xDrive M Sport Auto',
'transmission': 'automatic',
'trim': '320d xDrive M Sport Auto',
'vin': 'WBA3W52080K422721',
'year': 2015}
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715023759%27 HTTP/1.1" 200 None
2026-03-29 20:21:16 [motorway.uk] INFO: Saving data for 15023759: {'created_time': 1774815676.555618, 'last_price_update_time': 1774815676.555629, 'auction_closing_time': 1774884600.0}
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='15023759') HTTP/1.1" 204 0
2026-03-29 20:21:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8992/19998992/docs_service_history-1774702187906.jpg?ixlib=js-3.8.0&auto=format&s=5163cc54df0d06d210339669c04d2ee2> (referer: None)
2026-03-29 20:21:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8992/19998992/interior_boot-1774708908350.jpg> (referer: None)
2026-03-29 20:21:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582dee50>
2026-03-29 20:21:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b5551d2-4800-5e8d-85a0-a53d93133a64/6b5551d2-4800-5e8d-85a0-a53d93133a64_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8992%252F19998992%252Fdocs_service_history-1774702187906.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D5163cc54df0d06d210339669c04d2ee2') HTTP/1.1" 204 0
2026-03-29 20:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8992/19998992/docs_service_history-1774702187906.jpg?ixlib=js-3.8.0&auto=format&s=5163cc54df0d06d210339669c04d2ee2 saved to cache
2026-03-29 20:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6b5551d2-4800-5e8d-85a0-a53d93133a64
2026-03-29 20:21:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582dfdd0>
2026-03-29 20:21:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b5551d2-4800-5e8d-85a0-a53d93133a64/6b5551d2-4800-5e8d-85a0-a53d93133a64_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8992%252F19998992%252Finterior_boot-1774708908350.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8992/19998992/interior_boot-1774708908350.jpg saved to cache
2026-03-29 20:21:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6b5551d2-4800-5e8d-85a0-a53d93133a64
2026-03-29 20:21:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8992/19998992/interior_dashboard-1774709092737.jpg> (referer: None)
2026-03-29 20:21:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599903d0>
2026-03-29 20:21:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b5551d2-4800-5e8d-85a0-a53d93133a64/6b5551d2-4800-5e8d-85a0-a53d93133a64_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8992%252F19998992%252Finterior_dashboard-1774709092737.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8992/19998992/interior_dashboard-1774709092737.jpg saved to cache
2026-03-29 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6b5551d2-4800-5e8d-85a0-a53d93133a64
2026-03-29 20:21:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8992/19998992/interior_rear_seats-1774701472113.jpg> (referer: None)
2026-03-29 20:21:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8992/19998992/interior_front_seats-1774708889706.jpg> (referer: None)
2026-03-29 20:21:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b58110>
2026-03-29 20:21:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b5551d2-4800-5e8d-85a0-a53d93133a64/6b5551d2-4800-5e8d-85a0-a53d93133a64_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8992%252F19998992%252Finterior_rear_seats-1774701472113.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8992/19998992/interior_rear_seats-1774701472113.jpg saved to cache
2026-03-29 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b5551d2-4800-5e8d-85a0-a53d93133a64
2026-03-29 20:21:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658b456d0>
2026-03-29 20:21:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b5551d2-4800-5e8d-85a0-a53d93133a64/6b5551d2-4800-5e8d-85a0-a53d93133a64_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8992%252F19998992%252Finterior_front_seats-1774708889706.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8992/19998992/interior_front_seats-1774708889706.jpg saved to cache
2026-03-29 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b5551d2-4800-5e8d-85a0-a53d93133a64
2026-03-29 20:21:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8992/19998992/exterior_rear_passenger-1774701018021.jpg> (referer: None)
2026-03-29 20:21:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ae7f10>
2026-03-29 20:21:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b5551d2-4800-5e8d-85a0-a53d93133a64/6b5551d2-4800-5e8d-85a0-a53d93133a64_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8992%252F19998992%252Fexterior_rear_passenger-1774701018021.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8992/19998992/exterior_rear_passenger-1774701018021.jpg saved to cache
2026-03-29 20:21:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b5551d2-4800-5e8d-85a0-a53d93133a64
2026-03-29 20:21:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8992/19998992/exterior_front_passenger-1774701032714.jpg> (referer: None)
2026-03-29 20:21:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8992/19998992/exterior_rear_driver-1774701004090.jpg> (referer: None)
2026-03-29 20:21:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599916d0>
2026-03-29 20:21:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b5551d2-4800-5e8d-85a0-a53d93133a64/6b5551d2-4800-5e8d-85a0-a53d93133a64_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8992%252F19998992%252Fexterior_front_passenger-1774701032714.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8992/19998992/exterior_front_passenger-1774701032714.jpg saved to cache
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b5551d2-4800-5e8d-85a0-a53d93133a64
2026-03-29 20:21:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658b47a10>
2026-03-29 20:21:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b5551d2-4800-5e8d-85a0-a53d93133a64/6b5551d2-4800-5e8d-85a0-a53d93133a64_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8992%252F19998992%252Fexterior_rear_driver-1774701004090.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8992/19998992/exterior_rear_driver-1774701004090.jpg saved to cache
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b5551d2-4800-5e8d-85a0-a53d93133a64
2026-03-29 20:21:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8992/19998992/exterior_front_driver-1774700982483.jpg> (referer: None)
2026-03-29 20:21:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599916d0>
2026-03-29 20:21:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b5551d2-4800-5e8d-85a0-a53d93133a64/6b5551d2-4800-5e8d-85a0-a53d93133a64_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8992%252F19998992%252Fexterior_front_driver-1774700982483.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8992/19998992/exterior_front_driver-1774700982483.jpg saved to cache
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b5551d2-4800-5e8d-85a0-a53d93133a64
2026-03-29 20:21:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b5551d2-4800-5e8d-85a0-a53d93133a64, skipping ID generation
2026-03-29 20:21:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b5551d2-4800-5e8d-85a0-a53d93133a64 with scrape type 1
2026-03-29 20:21:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b5551d2-4800-5e8d-85a0-a53d93133a64 sending to next pipeline
2026-03-29 20:21:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6b5551d2-4800-5e8d-85a0-a53d93133a64, identifier: 19998992
2026-03-29 20:21:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6b5551d2-4800-5e8d-85a0-a53d93133a64 with identifier: 19998992
2026-03-29 20:21:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6b5551d2-4800-5e8d-85a0-a53d93133a64 with identifier: 19998992
2026-03-29 20:21:18 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6b5551d2-4800-5e8d-85a0-a53d93133a64 with identifier: 19998992 to the API
2026-03-29 20:21:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:21:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8992/19998992/exterior_front_driver-1774700982483.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '6b5551d2-4800-5e8d-85a0-a53d93133a64',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'VK71 DXY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19998992',
'listing': 'auction',
'location': 'North Yorkshire York',
'make': 'Volkswagen',
'model': 'Golf',
'odometer': 25200,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b5551d2-4800-5e8d-85a0-a53d93133a64/6b5551d2-4800-5e8d-85a0-a53d93133a64_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2866808,
'Height': 2986,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8992/19998992/exterior_front_driver-1774700982483.jpg',
'Width': 3981},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b5551d2-4800-5e8d-85a0-a53d93133a64/6b5551d2-4800-5e8d-85a0-a53d93133a64_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1959792,
'Height': 2576,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8992/19998992/exterior_rear_driver-1774701004090.jpg',
'Width': 3435},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b5551d2-4800-5e8d-85a0-a53d93133a64/6b5551d2-4800-5e8d-85a0-a53d93133a64_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2038011,
'Height': 2597,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8992/19998992/exterior_front_passenger-1774701032714.jpg',
'Width': 3463},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b5551d2-4800-5e8d-85a0-a53d93133a64/6b5551d2-4800-5e8d-85a0-a53d93133a64_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1868024,
'Height': 2557,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8992/19998992/exterior_rear_passenger-1774701018021.jpg',
'Width': 3409},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b5551d2-4800-5e8d-85a0-a53d93133a64/6b5551d2-4800-5e8d-85a0-a53d93133a64_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3225361,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8992/19998992/interior_front_seats-1774708889706.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b5551d2-4800-5e8d-85a0-a53d93133a64/6b5551d2-4800-5e8d-85a0-a53d93133a64_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3427818,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8992/19998992/interior_rear_seats-1774701472113.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b5551d2-4800-5e8d-85a0-a53d93133a64/6b5551d2-4800-5e8d-85a0-a53d93133a64_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2396149,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8992/19998992/interior_dashboard-1774709092737.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b5551d2-4800-5e8d-85a0-a53d93133a64/6b5551d2-4800-5e8d-85a0-a53d93133a64_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2820488,
'Height': 2679,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8992/19998992/interior_boot-1774708908350.jpg',
'Width': 3572},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b5551d2-4800-5e8d-85a0-a53d93133a64/6b5551d2-4800-5e8d-85a0-a53d93133a64_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1726384,
'Height': 2372,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8992/19998992/docs_service_history-1774702187906.jpg?ixlib=js-3.8.0&auto=format&s=5163cc54df0d06d210339669c04d2ee2',
'Width': 1515},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b5551d2-4800-5e8d-85a0-a53d93133a64/6b5551d2-4800-5e8d-85a0-a53d93133a64_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2314994,
'Height': 1895,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8992/19998992/docs_service_history-1774702188583.jpg?ixlib=js-3.8.0&auto=format&s=33b5a45abd4f9b41643d1a27d996c22e',
'Width': 2481}],
'price': 17771,
'price_includes_vat': False,
'registration_date': '2021-09-30',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Golf R-LINE TSI',
'transmission': 'manual',
'trim': 'R-LINE TSI',
'vin': 'WVWZZZCDZNW117506',
'year': 2021}
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719998992%27 HTTP/1.1" 200 None
2026-03-29 20:21:19 [motorway.uk] INFO: Saving data for 19998992: {'created_time': 1774815679.197542, 'last_price_update_time': 1774815679.197554, 'auction_closing_time': 1774884600.0}
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19998992') HTTP/1.1" 204 0
2026-03-29 20:21:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17069635.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91b6d7c3-93c2-5699-9476-6a3c9971a513 with identifier: 17069635
2026-03-29 20:21:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91b6d7c3-93c2-5699-9476-6a3c9971a513 with scrape type 1
2026-03-29 20:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 91b6d7c3-93c2-5699-9476-6a3c9971a513
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9635%252F17069635%252Fexterior_front_driver-1774704581263.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9635/17069635/exterior_front_driver-1774704581263.jpg not downloaded yet
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9635%252F17069635%252Fexterior_rear_driver-1774712322211.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9635/17069635/exterior_rear_driver-1774712322211.jpg not downloaded yet
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9635%252F17069635%252Fexterior_front_passenger-1774712338507.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9635/17069635/exterior_front_passenger-1774712338507.jpg not downloaded yet
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9635%252F17069635%252Fexterior_rear_passenger-1774712360035.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9635/17069635/exterior_rear_passenger-1774712360035.jpg not downloaded yet
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9635%252F17069635%252Finterior_front_seats-1774705076420.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9635/17069635/interior_front_seats-1774705076420.jpg not downloaded yet
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9635%252F17069635%252Finterior_rear_seats-1774704993785.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9635/17069635/interior_rear_seats-1774704993785.jpg not downloaded yet
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9635%252F17069635%252Finterior_dashboard-1774712384762.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9635/17069635/interior_dashboard-1774712384762.jpg not downloaded yet
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9635%252F17069635%252Finstrument_cluster-1774712395017.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9635/17069635/instrument_cluster-1774712395017.jpg not downloaded yet
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9635%252F17069635%252Finterior_boot-1774705044876.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9635/17069635/interior_boot-1774705044876.jpg not downloaded yet
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9635%252F17069635%252Fwheels_front_driver-1774704672185.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9635/17069635/wheels_front_driver-1774704672185.jpg not downloaded yet
2026-03-29 20:21:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19709380.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cba8fc2-af4c-5850-a1ff-b094b520d4f3 with identifier: 19709380
2026-03-29 20:21:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cba8fc2-af4c-5850-a1ff-b094b520d4f3 with scrape type 1
2026-03-29 20:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6cba8fc2-af4c-5850-a1ff-b094b520d4f3
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9380%252F19709380%252Fexterior_front_driver-1770642965504.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9380/19709380/exterior_front_driver-1770642965504.jpg not downloaded yet
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9380%252F19709380%252Fexterior_rear_driver-1770643150699.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9380/19709380/exterior_rear_driver-1770643150699.jpg not downloaded yet
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9380%252F19709380%252Fexterior_front_passenger-1770643107307.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9380/19709380/exterior_front_passenger-1770643107307.jpg not downloaded yet
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9380%252F19709380%252Fexterior_rear_passenger-1770643077393.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9380/19709380/exterior_rear_passenger-1770643077393.jpg not downloaded yet
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9380%252F19709380%252Finterior_front_seats-1770643805628.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9380/19709380/interior_front_seats-1770643805628.jpg not downloaded yet
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9380%252F19709380%252Finterior_rear_seats-1770643846732.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9380/19709380/interior_rear_seats-1770643846732.jpg not downloaded yet
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9380%252F19709380%252Finterior_dashboard-1770644071467.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9380/19709380/interior_dashboard-1770644071467.jpg not downloaded yet
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9380%252F19709380%252Finstrument_cluster-1770643988258.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9380/19709380/instrument_cluster-1770643988258.jpg not downloaded yet
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9380%252F19709380%252Finterior_boot-1770643947260.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9380/19709380/interior_boot-1770643947260.jpg not downloaded yet
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F9380%252F19709380%252Fdocs_service_history-1770737579374.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D124b4d4d45056e65fded02996e2f9038%27 HTTP/1.1" 200 None
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/9380/19709380/docs_service_history-1770737579374.png?ixlib=js-3.8.0&auto=format&s=124b4d4d45056e65fded02996e2f9038 not downloaded yet
2026-03-29 20:21:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9635/17069635/wheels_front_driver-1774704672185.jpg> (referer: None)
2026-03-29 20:21:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658517910>
2026-03-29 20:21:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91b6d7c3-93c2-5699-9476-6a3c9971a513/91b6d7c3-93c2-5699-9476-6a3c9971a513_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9635%252F17069635%252Fwheels_front_driver-1774704672185.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9635/17069635/wheels_front_driver-1774704672185.jpg saved to cache
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 91b6d7c3-93c2-5699-9476-6a3c9971a513
2026-03-29 20:21:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/9380/19709380/docs_service_history-1770737579374.png?ixlib=js-3.8.0&auto=format&s=124b4d4d45056e65fded02996e2f9038> (referer: None)
2026-03-29 20:21:20 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-29 20:21:20 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-29 20:21:20 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-29 20:21:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c1d6d0>
2026-03-29 20:21:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cba8fc2-af4c-5850-a1ff-b094b520d4f3/6cba8fc2-af4c-5850-a1ff-b094b520d4f3_image_9.png HTTP/1.1" 201 0
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F9380%252F19709380%252Fdocs_service_history-1770737579374.png%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D124b4d4d45056e65fded02996e2f9038') HTTP/1.1" 204 0
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/9380/19709380/docs_service_history-1770737579374.png?ixlib=js-3.8.0&auto=format&s=124b4d4d45056e65fded02996e2f9038 saved to cache
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6cba8fc2-af4c-5850-a1ff-b094b520d4f3
2026-03-29 20:21:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9380/19709380/interior_boot-1770643947260.jpg> (referer: None)
2026-03-29 20:21:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:21:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f0f610>
2026-03-29 20:21:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cba8fc2-af4c-5850-a1ff-b094b520d4f3/6cba8fc2-af4c-5850-a1ff-b094b520d4f3_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9380%252F19709380%252Finterior_boot-1770643947260.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9380/19709380/interior_boot-1770643947260.jpg saved to cache
2026-03-29 20:21:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6cba8fc2-af4c-5850-a1ff-b094b520d4f3
2026-03-29 20:21:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9380/19709380/instrument_cluster-1770643988258.jpg> (referer: None)
2026-03-29 20:21:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:21:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f0f4d0>
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cba8fc2-af4c-5850-a1ff-b094b520d4f3/6cba8fc2-af4c-5850-a1ff-b094b520d4f3_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9380%252F19709380%252Finstrument_cluster-1770643988258.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9380/19709380/instrument_cluster-1770643988258.jpg saved to cache
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6cba8fc2-af4c-5850-a1ff-b094b520d4f3
2026-03-29 20:21:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9380/19709380/interior_dashboard-1770644071467.jpg> (referer: None)
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c1c810>
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cba8fc2-af4c-5850-a1ff-b094b520d4f3/6cba8fc2-af4c-5850-a1ff-b094b520d4f3_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9380%252F19709380%252Finterior_dashboard-1770644071467.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9380/19709380/interior_dashboard-1770644071467.jpg saved to cache
2026-03-29 20:21:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6cba8fc2-af4c-5850-a1ff-b094b520d4f3
2026-03-29 20:21:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19966592.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9380/19709380/interior_rear_seats-1770643846732.jpg> (referer: None)
2026-03-29 20:21:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29d0dfb9-ecb6-57d7-821d-8a75daa97cfa with identifier: 19966592
2026-03-29 20:21:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29d0dfb9-ecb6-57d7-821d-8a75daa97cfa with scrape type 1
2026-03-29 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 29d0dfb9-ecb6-57d7-821d-8a75daa97cfa
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6592%252F19966592%252Fexterior_front_driver-1774779405775.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6592/19966592/exterior_front_driver-1774779405775.jpg not downloaded yet
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6592%252F19966592%252Fexterior_rear_driver-1774779418538.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6592/19966592/exterior_rear_driver-1774779418538.jpg not downloaded yet
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6592%252F19966592%252Fexterior_front_passenger-1774779438940.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6592/19966592/exterior_front_passenger-1774779438940.jpg not downloaded yet
2026-03-29 20:21:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:21:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658abb310>
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cba8fc2-af4c-5850-a1ff-b094b520d4f3/6cba8fc2-af4c-5850-a1ff-b094b520d4f3_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9380%252F19709380%252Finterior_rear_seats-1770643846732.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9380/19709380/interior_rear_seats-1770643846732.jpg saved to cache
2026-03-29 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6cba8fc2-af4c-5850-a1ff-b094b520d4f3
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6592%252F19966592%252Fexterior_rear_passenger-1774718733284.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6592/19966592/exterior_rear_passenger-1774718733284.jpg not downloaded yet
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6592%252F19966592%252Finterior_front_seats-1774719003736.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6592/19966592/interior_front_seats-1774719003736.jpg not downloaded yet
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6592%252F19966592%252Finterior_rear_seats-1774719013861.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6592/19966592/interior_rear_seats-1774719013861.jpg not downloaded yet
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6592%252F19966592%252Finterior_dashboard-1774779364842.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6592/19966592/interior_dashboard-1774779364842.jpg not downloaded yet
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6592%252F19966592%252Finstrument_cluster-1774719118503.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6592/19966592/instrument_cluster-1774719118503.jpg not downloaded yet
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6592%252F19966592%252Finterior_boot-1774779376121.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6592/19966592/interior_boot-1774779376121.jpg not downloaded yet
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6592%252F19966592%252Fdocs_service_history-1774778723920.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8c8b163aa4bb8023ba1ef46bef4e69b7%27 HTTP/1.1" 200 None
2026-03-29 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6592/19966592/docs_service_history-1774778723920.jpg?ixlib=js-3.8.0&auto=format&s=8c8b163aa4bb8023ba1ef46bef4e69b7 not downloaded yet
2026-03-29 20:21:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9380/19709380/interior_front_seats-1770643805628.jpg> (referer: None)
2026-03-29 20:21:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9380/19709380/exterior_rear_passenger-1770643077393.jpg> (referer: None)
2026-03-29 20:21:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:21:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6580fb2d0>
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cba8fc2-af4c-5850-a1ff-b094b520d4f3/6cba8fc2-af4c-5850-a1ff-b094b520d4f3_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9380%252F19709380%252Finterior_front_seats-1770643805628.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9380/19709380/interior_front_seats-1770643805628.jpg saved to cache
2026-03-29 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6cba8fc2-af4c-5850-a1ff-b094b520d4f3
2026-03-29 20:21:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/6592/19966592/docs_service_history-1774778723920.jpg?ixlib=js-3.8.0&auto=format&s=8c8b163aa4bb8023ba1ef46bef4e69b7> (referer: None)
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65888f990>
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cba8fc2-af4c-5850-a1ff-b094b520d4f3/6cba8fc2-af4c-5850-a1ff-b094b520d4f3_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9380%252F19709380%252Fexterior_rear_passenger-1770643077393.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9380/19709380/exterior_rear_passenger-1770643077393.jpg saved to cache
2026-03-29 20:21:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6cba8fc2-af4c-5850-a1ff-b094b520d4f3
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599fdcd0>
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d0dfb9-ecb6-57d7-821d-8a75daa97cfa/29d0dfb9-ecb6-57d7-821d-8a75daa97cfa_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F6592%252F19966592%252Fdocs_service_history-1774778723920.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8c8b163aa4bb8023ba1ef46bef4e69b7') HTTP/1.1" 204 0
2026-03-29 20:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/6592/19966592/docs_service_history-1774778723920.jpg?ixlib=js-3.8.0&auto=format&s=8c8b163aa4bb8023ba1ef46bef4e69b7 saved to cache
2026-03-29 20:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 29d0dfb9-ecb6-57d7-821d-8a75daa97cfa
2026-03-29 20:21:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6592/19966592/interior_boot-1774779376121.jpg> (referer: None)
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65888da90>
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d0dfb9-ecb6-57d7-821d-8a75daa97cfa/29d0dfb9-ecb6-57d7-821d-8a75daa97cfa_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6592%252F19966592%252Finterior_boot-1774779376121.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6592/19966592/interior_boot-1774779376121.jpg saved to cache
2026-03-29 20:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 29d0dfb9-ecb6-57d7-821d-8a75daa97cfa
2026-03-29 20:21:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6592/19966592/interior_dashboard-1774779364842.jpg> (referer: None)
2026-03-29 20:21:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6592/19966592/instrument_cluster-1774719118503.jpg> (referer: None)
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c1db50>
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d0dfb9-ecb6-57d7-821d-8a75daa97cfa/29d0dfb9-ecb6-57d7-821d-8a75daa97cfa_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6592%252F19966592%252Finterior_dashboard-1774779364842.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6592/19966592/interior_dashboard-1774779364842.jpg saved to cache
2026-03-29 20:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 29d0dfb9-ecb6-57d7-821d-8a75daa97cfa
2026-03-29 20:21:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587a19d0>
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d0dfb9-ecb6-57d7-821d-8a75daa97cfa/29d0dfb9-ecb6-57d7-821d-8a75daa97cfa_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6592%252F19966592%252Finstrument_cluster-1774719118503.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6592/19966592/instrument_cluster-1774719118503.jpg saved to cache
2026-03-29 20:21:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 29d0dfb9-ecb6-57d7-821d-8a75daa97cfa
2026-03-29 20:21:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6592/19966592/interior_rear_seats-1774719013861.jpg> (referer: None)
2026-03-29 20:21:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599fee90>
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d0dfb9-ecb6-57d7-821d-8a75daa97cfa/29d0dfb9-ecb6-57d7-821d-8a75daa97cfa_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6592%252F19966592%252Finterior_rear_seats-1774719013861.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6592/19966592/interior_rear_seats-1774719013861.jpg saved to cache
2026-03-29 20:21:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 29d0dfb9-ecb6-57d7-821d-8a75daa97cfa
2026-03-29 20:21:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6592/19966592/interior_front_seats-1774719003736.jpg> (referer: None)
2026-03-29 20:21:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6592/19966592/exterior_rear_passenger-1774718733284.jpg> (referer: None)
2026-03-29 20:21:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6580fb290>
2026-03-29 20:21:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d0dfb9-ecb6-57d7-821d-8a75daa97cfa/29d0dfb9-ecb6-57d7-821d-8a75daa97cfa_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6592%252F19966592%252Finterior_front_seats-1774719003736.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6592/19966592/interior_front_seats-1774719003736.jpg saved to cache
2026-03-29 20:21:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 29d0dfb9-ecb6-57d7-821d-8a75daa97cfa
2026-03-29 20:21:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c1fa10>
2026-03-29 20:21:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d0dfb9-ecb6-57d7-821d-8a75daa97cfa/29d0dfb9-ecb6-57d7-821d-8a75daa97cfa_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6592%252F19966592%252Fexterior_rear_passenger-1774718733284.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6592/19966592/exterior_rear_passenger-1774718733284.jpg saved to cache
2026-03-29 20:21:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 29d0dfb9-ecb6-57d7-821d-8a75daa97cfa
2026-03-29 20:21:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6592/19966592/exterior_front_passenger-1774779438940.jpg> (referer: None)
2026-03-29 20:21:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658367110>
2026-03-29 20:21:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d0dfb9-ecb6-57d7-821d-8a75daa97cfa/29d0dfb9-ecb6-57d7-821d-8a75daa97cfa_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6592%252F19966592%252Fexterior_front_passenger-1774779438940.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6592/19966592/exterior_front_passenger-1774779438940.jpg saved to cache
2026-03-29 20:21:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 29d0dfb9-ecb6-57d7-821d-8a75daa97cfa
2026-03-29 20:21:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6592/19966592/exterior_front_driver-1774779405775.jpg> (referer: None)
2026-03-29 20:21:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfd2810>
2026-03-29 20:21:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d0dfb9-ecb6-57d7-821d-8a75daa97cfa/29d0dfb9-ecb6-57d7-821d-8a75daa97cfa_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6592%252F19966592%252Fexterior_front_driver-1774779405775.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6592/19966592/exterior_front_driver-1774779405775.jpg saved to cache
2026-03-29 20:21:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29d0dfb9-ecb6-57d7-821d-8a75daa97cfa
2026-03-29 20:21:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6592/19966592/exterior_rear_driver-1774779418538.jpg> (referer: None)
2026-03-29 20:21:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599fd050>
2026-03-29 20:21:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29d0dfb9-ecb6-57d7-821d-8a75daa97cfa/29d0dfb9-ecb6-57d7-821d-8a75daa97cfa_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6592%252F19966592%252Fexterior_rear_driver-1774779418538.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6592/19966592/exterior_rear_driver-1774779418538.jpg saved to cache
2026-03-29 20:21:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 29d0dfb9-ecb6-57d7-821d-8a75daa97cfa
2026-03-29 20:21:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29d0dfb9-ecb6-57d7-821d-8a75daa97cfa, skipping ID generation
2026-03-29 20:21:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29d0dfb9-ecb6-57d7-821d-8a75daa97cfa with scrape type 1
2026-03-29 20:21:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29d0dfb9-ecb6-57d7-821d-8a75daa97cfa sending to next pipeline
2026-03-29 20:21:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 29d0dfb9-ecb6-57d7-821d-8a75daa97cfa, identifier: 19966592
2026-03-29 20:21:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 29d0dfb9-ecb6-57d7-821d-8a75daa97cfa with identifier: 19966592
2026-03-29 20:21:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 29d0dfb9-ecb6-57d7-821d-8a75daa97cfa with identifier: 19966592
2026-03-29 20:21:25 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 29d0dfb9-ecb6-57d7-821d-8a75daa97cfa with identifier: 19966592 to the API
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:21:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/6592/19966592/exterior_rear_driver-1774779418538.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.8L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Hybrid',
'id': '29d0dfb9-ecb6-57d7-821d-8a75daa97cfa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'R24 PYD',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19966592',
'listing': 'auction',
'location': 'West Yorkshire Bradford',
'make': 'Lexus',
'model': 'CT 200',
'odometer': 85252,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d0dfb9-ecb6-57d7-821d-8a75daa97cfa/29d0dfb9-ecb6-57d7-821d-8a75daa97cfa_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1814046,
'Height': 2498,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6592/19966592/exterior_front_driver-1774779405775.jpg',
'Width': 3331},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d0dfb9-ecb6-57d7-821d-8a75daa97cfa/29d0dfb9-ecb6-57d7-821d-8a75daa97cfa_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1929136,
'Height': 2423,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6592/19966592/exterior_rear_driver-1774779418538.jpg',
'Width': 3231},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d0dfb9-ecb6-57d7-821d-8a75daa97cfa/29d0dfb9-ecb6-57d7-821d-8a75daa97cfa_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1893354,
'Height': 2461,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6592/19966592/exterior_front_passenger-1774779438940.jpg',
'Width': 3281},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d0dfb9-ecb6-57d7-821d-8a75daa97cfa/29d0dfb9-ecb6-57d7-821d-8a75daa97cfa_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1383266,
'Height': 2252,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6592/19966592/exterior_rear_passenger-1774718733284.jpg',
'Width': 3003},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d0dfb9-ecb6-57d7-821d-8a75daa97cfa/29d0dfb9-ecb6-57d7-821d-8a75daa97cfa_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3936275,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6592/19966592/interior_front_seats-1774719003736.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d0dfb9-ecb6-57d7-821d-8a75daa97cfa/29d0dfb9-ecb6-57d7-821d-8a75daa97cfa_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3136710,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6592/19966592/interior_rear_seats-1774719013861.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d0dfb9-ecb6-57d7-821d-8a75daa97cfa/29d0dfb9-ecb6-57d7-821d-8a75daa97cfa_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2474447,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6592/19966592/interior_dashboard-1774779364842.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d0dfb9-ecb6-57d7-821d-8a75daa97cfa/29d0dfb9-ecb6-57d7-821d-8a75daa97cfa_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2606186,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6592/19966592/instrument_cluster-1774719118503.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d0dfb9-ecb6-57d7-821d-8a75daa97cfa/29d0dfb9-ecb6-57d7-821d-8a75daa97cfa_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3101403,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6592/19966592/interior_boot-1774779376121.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29d0dfb9-ecb6-57d7-821d-8a75daa97cfa/29d0dfb9-ecb6-57d7-821d-8a75daa97cfa_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 916776,
'Height': 2309,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/6592/19966592/docs_service_history-1774778723920.jpg?ixlib=js-3.8.0&auto=format&s=8c8b163aa4bb8023ba1ef46bef4e69b7',
'Width': 3078}],
'price': 6276,
'price_includes_vat': False,
'registration_date': '2013-05-30',
'seats_number': None,
'seller_name': None,
'title': 'Lexus CT 200H F Sport CVT',
'transmission': 'automatic',
'trim': 'H F Sport CVT',
'vin': 'JTHKD5BH002139805',
'year': 2013}
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719966592%27 HTTP/1.1" 200 None
2026-03-29 20:21:25 [motorway.uk] INFO: Saving data for 19966592: {'created_time': 1774815685.760049, 'last_price_update_time': 1774815685.760059, 'auction_closing_time': 1774884600.0}
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19966592') HTTP/1.1" 204 0
2026-03-29 20:21:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9380/19709380/exterior_front_passenger-1770643107307.jpg> (referer: None)
2026-03-29 20:21:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9380/19709380/exterior_rear_driver-1770643150699.jpg> (referer: None)
2026-03-29 20:21:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599fefd0>
2026-03-29 20:21:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cba8fc2-af4c-5850-a1ff-b094b520d4f3/6cba8fc2-af4c-5850-a1ff-b094b520d4f3_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9380%252F19709380%252Fexterior_front_passenger-1770643107307.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9380/19709380/exterior_front_passenger-1770643107307.jpg saved to cache
2026-03-29 20:21:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6cba8fc2-af4c-5850-a1ff-b094b520d4f3
2026-03-29 20:21:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65876f090>
2026-03-29 20:21:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cba8fc2-af4c-5850-a1ff-b094b520d4f3/6cba8fc2-af4c-5850-a1ff-b094b520d4f3_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9380%252F19709380%252Fexterior_rear_driver-1770643150699.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9380/19709380/exterior_rear_driver-1770643150699.jpg saved to cache
2026-03-29 20:21:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6cba8fc2-af4c-5850-a1ff-b094b520d4f3
2026-03-29 20:21:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9380/19709380/exterior_front_driver-1770642965504.jpg> (referer: None)
2026-03-29 20:21:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9635/17069635/instrument_cluster-1774712395017.jpg> (referer: None)
2026-03-29 20:21:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587a1b50>
2026-03-29 20:21:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cba8fc2-af4c-5850-a1ff-b094b520d4f3/6cba8fc2-af4c-5850-a1ff-b094b520d4f3_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9380%252F19709380%252Fexterior_front_driver-1770642965504.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9380/19709380/exterior_front_driver-1770642965504.jpg saved to cache
2026-03-29 20:21:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6cba8fc2-af4c-5850-a1ff-b094b520d4f3
2026-03-29 20:21:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6cba8fc2-af4c-5850-a1ff-b094b520d4f3, skipping ID generation
2026-03-29 20:21:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cba8fc2-af4c-5850-a1ff-b094b520d4f3 with scrape type 1
2026-03-29 20:21:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6cba8fc2-af4c-5850-a1ff-b094b520d4f3 sending to next pipeline
2026-03-29 20:21:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6cba8fc2-af4c-5850-a1ff-b094b520d4f3, identifier: 19709380
2026-03-29 20:21:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6cba8fc2-af4c-5850-a1ff-b094b520d4f3 with identifier: 19709380
2026-03-29 20:21:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6cba8fc2-af4c-5850-a1ff-b094b520d4f3 with identifier: 19709380
2026-03-29 20:21:26 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6cba8fc2-af4c-5850-a1ff-b094b520d4f3 with identifier: 19709380 to the API
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:21:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9380/19709380/exterior_front_driver-1770642965504.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '6cba8fc2-af4c-5850-a1ff-b094b520d4f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CA14 JVV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19709380',
'listing': 'auction',
'location': 'West Sussex Arundel',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 68094,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cba8fc2-af4c-5850-a1ff-b094b520d4f3/6cba8fc2-af4c-5850-a1ff-b094b520d4f3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1870046,
'Height': 3011,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9380/19709380/exterior_front_driver-1770642965504.jpg',
'Width': 4014},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cba8fc2-af4c-5850-a1ff-b094b520d4f3/6cba8fc2-af4c-5850-a1ff-b094b520d4f3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1501126,
'Height': 2845,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9380/19709380/exterior_rear_driver-1770643150699.jpg',
'Width': 3793},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cba8fc2-af4c-5850-a1ff-b094b520d4f3/6cba8fc2-af4c-5850-a1ff-b094b520d4f3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1443244,
'Height': 2795,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9380/19709380/exterior_front_passenger-1770643107307.jpg',
'Width': 3726},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cba8fc2-af4c-5850-a1ff-b094b520d4f3/6cba8fc2-af4c-5850-a1ff-b094b520d4f3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1387893,
'Height': 2847,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9380/19709380/exterior_rear_passenger-1770643077393.jpg',
'Width': 3796},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cba8fc2-af4c-5850-a1ff-b094b520d4f3/6cba8fc2-af4c-5850-a1ff-b094b520d4f3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2986208,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9380/19709380/interior_front_seats-1770643805628.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cba8fc2-af4c-5850-a1ff-b094b520d4f3/6cba8fc2-af4c-5850-a1ff-b094b520d4f3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2730062,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9380/19709380/interior_rear_seats-1770643846732.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cba8fc2-af4c-5850-a1ff-b094b520d4f3/6cba8fc2-af4c-5850-a1ff-b094b520d4f3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1522962,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9380/19709380/interior_dashboard-1770644071467.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cba8fc2-af4c-5850-a1ff-b094b520d4f3/6cba8fc2-af4c-5850-a1ff-b094b520d4f3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2460493,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9380/19709380/instrument_cluster-1770643988258.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cba8fc2-af4c-5850-a1ff-b094b520d4f3/6cba8fc2-af4c-5850-a1ff-b094b520d4f3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2424810,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9380/19709380/interior_boot-1770643947260.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cba8fc2-af4c-5850-a1ff-b094b520d4f3/6cba8fc2-af4c-5850-a1ff-b094b520d4f3_image_9.png',
'Extension': 'png',
'FileSizeInBytes': 670345,
'Height': 730,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/9380/19709380/docs_service_history-1770737579374.png?ixlib=js-3.8.0&auto=format&s=124b4d4d45056e65fded02996e2f9038',
'Width': 753}],
'price': 5022,
'price_includes_vat': False,
'registration_date': '2014-06-17',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Qashqai Tekna DCI',
'transmission': 'manual',
'trim': 'Tekna DCI',
'vin': 'SJNFAAJ11U1138222',
'year': 2014}
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719709380%27 HTTP/1.1" 200 None
2026-03-29 20:21:26 [motorway.uk] INFO: Saving data for 19709380: {'created_time': 1774815686.857005, 'last_price_update_time': 1774815686.857017, 'auction_closing_time': 1774884600.0}
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19709380') HTTP/1.1" 204 0
2026-03-29 20:21:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658446bd0>
2026-03-29 20:21:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91b6d7c3-93c2-5699-9476-6a3c9971a513/91b6d7c3-93c2-5699-9476-6a3c9971a513_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:21:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9635%252F17069635%252Finstrument_cluster-1774712395017.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9635/17069635/instrument_cluster-1774712395017.jpg saved to cache
2026-03-29 20:21:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 91b6d7c3-93c2-5699-9476-6a3c9971a513
2026-03-29 20:21:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9635/17069635/interior_dashboard-1774712384762.jpg> (referer: None)
2026-03-29 20:21:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9635/17069635/interior_boot-1774705044876.jpg> (referer: None)
2026-03-29 20:21:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c1e890>
2026-03-29 20:21:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91b6d7c3-93c2-5699-9476-6a3c9971a513/91b6d7c3-93c2-5699-9476-6a3c9971a513_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9635%252F17069635%252Finterior_dashboard-1774712384762.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9635/17069635/interior_dashboard-1774712384762.jpg saved to cache
2026-03-29 20:21:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 91b6d7c3-93c2-5699-9476-6a3c9971a513
2026-03-29 20:21:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658364d50>
2026-03-29 20:21:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91b6d7c3-93c2-5699-9476-6a3c9971a513/91b6d7c3-93c2-5699-9476-6a3c9971a513_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9635%252F17069635%252Finterior_boot-1774705044876.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9635/17069635/interior_boot-1774705044876.jpg saved to cache
2026-03-29 20:21:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 91b6d7c3-93c2-5699-9476-6a3c9971a513
2026-03-29 20:21:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9635/17069635/interior_rear_seats-1774704993785.jpg> (referer: None)
2026-03-29 20:21:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65853f410>
2026-03-29 20:21:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91b6d7c3-93c2-5699-9476-6a3c9971a513/91b6d7c3-93c2-5699-9476-6a3c9971a513_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9635%252F17069635%252Finterior_rear_seats-1774704993785.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9635/17069635/interior_rear_seats-1774704993785.jpg saved to cache
2026-03-29 20:21:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 91b6d7c3-93c2-5699-9476-6a3c9971a513
2026-03-29 20:21:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9635/17069635/exterior_rear_passenger-1774712360035.jpg> (referer: None)
2026-03-29 20:21:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9635/17069635/interior_front_seats-1774705076420.jpg> (referer: None)
2026-03-29 20:21:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587a3090>
2026-03-29 20:21:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91b6d7c3-93c2-5699-9476-6a3c9971a513/91b6d7c3-93c2-5699-9476-6a3c9971a513_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9635%252F17069635%252Fexterior_rear_passenger-1774712360035.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9635/17069635/exterior_rear_passenger-1774712360035.jpg saved to cache
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 91b6d7c3-93c2-5699-9476-6a3c9971a513
2026-03-29 20:21:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65876ea50>
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91b6d7c3-93c2-5699-9476-6a3c9971a513/91b6d7c3-93c2-5699-9476-6a3c9971a513_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9635%252F17069635%252Finterior_front_seats-1774705076420.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9635/17069635/interior_front_seats-1774705076420.jpg saved to cache
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 91b6d7c3-93c2-5699-9476-6a3c9971a513
2026-03-29 20:21:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9635/17069635/exterior_front_passenger-1774712338507.jpg> (referer: None)
2026-03-29 20:21:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/9635/17069635/exterior_rear_driver-1774712322211.jpg> (referer: None)
2026-03-29 20:21:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9635/17069635/exterior_front_driver-1774704581263.jpg> (referer: None)
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582dc550>
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91b6d7c3-93c2-5699-9476-6a3c9971a513/91b6d7c3-93c2-5699-9476-6a3c9971a513_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9635%252F17069635%252Fexterior_front_passenger-1774712338507.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9635/17069635/exterior_front_passenger-1774712338507.jpg saved to cache
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 91b6d7c3-93c2-5699-9476-6a3c9971a513
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c1f390>
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91b6d7c3-93c2-5699-9476-6a3c9971a513/91b6d7c3-93c2-5699-9476-6a3c9971a513_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F9635%252F17069635%252Fexterior_rear_driver-1774712322211.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/9635/17069635/exterior_rear_driver-1774712322211.jpg saved to cache
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 91b6d7c3-93c2-5699-9476-6a3c9971a513
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c1fa90>
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91b6d7c3-93c2-5699-9476-6a3c9971a513/91b6d7c3-93c2-5699-9476-6a3c9971a513_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9635%252F17069635%252Fexterior_front_driver-1774704581263.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9635/17069635/exterior_front_driver-1774704581263.jpg saved to cache
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 91b6d7c3-93c2-5699-9476-6a3c9971a513
2026-03-29 20:21:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 91b6d7c3-93c2-5699-9476-6a3c9971a513, skipping ID generation
2026-03-29 20:21:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91b6d7c3-93c2-5699-9476-6a3c9971a513 with scrape type 1
2026-03-29 20:21:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 91b6d7c3-93c2-5699-9476-6a3c9971a513 sending to next pipeline
2026-03-29 20:21:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 91b6d7c3-93c2-5699-9476-6a3c9971a513, identifier: 17069635
2026-03-29 20:21:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 91b6d7c3-93c2-5699-9476-6a3c9971a513 with identifier: 17069635
2026-03-29 20:21:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 91b6d7c3-93c2-5699-9476-6a3c9971a513 with identifier: 17069635
2026-03-29 20:21:28 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 91b6d7c3-93c2-5699-9476-6a3c9971a513 with identifier: 17069635 to the API
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:21:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:21:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9635/17069635/exterior_front_driver-1774704581263.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '91b6d7c3-93c2-5699-9476-6a3c9971a513',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WM70 KWE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17069635',
'listing': 'auction',
'location': 'Greater Manchester Bolton',
'make': 'BMW',
'model': '2 Series',
'odometer': 41443,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 17,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91b6d7c3-93c2-5699-9476-6a3c9971a513/91b6d7c3-93c2-5699-9476-6a3c9971a513_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 773123,
'Height': 1472,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9635/17069635/exterior_front_driver-1774704581263.jpg',
'Width': 1962},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91b6d7c3-93c2-5699-9476-6a3c9971a513/91b6d7c3-93c2-5699-9476-6a3c9971a513_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 890578,
'Height': 1546,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9635/17069635/exterior_rear_driver-1774712322211.jpg',
'Width': 2061},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91b6d7c3-93c2-5699-9476-6a3c9971a513/91b6d7c3-93c2-5699-9476-6a3c9971a513_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 745913,
'Height': 1473,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9635/17069635/exterior_front_passenger-1774712338507.jpg',
'Width': 1964},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91b6d7c3-93c2-5699-9476-6a3c9971a513/91b6d7c3-93c2-5699-9476-6a3c9971a513_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1270668,
'Height': 1738,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9635/17069635/exterior_rear_passenger-1774712360035.jpg',
'Width': 2317},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91b6d7c3-93c2-5699-9476-6a3c9971a513/91b6d7c3-93c2-5699-9476-6a3c9971a513_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3149805,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9635/17069635/interior_front_seats-1774705076420.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91b6d7c3-93c2-5699-9476-6a3c9971a513/91b6d7c3-93c2-5699-9476-6a3c9971a513_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2446231,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9635/17069635/interior_rear_seats-1774704993785.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91b6d7c3-93c2-5699-9476-6a3c9971a513/91b6d7c3-93c2-5699-9476-6a3c9971a513_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1700087,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9635/17069635/interior_dashboard-1774712384762.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91b6d7c3-93c2-5699-9476-6a3c9971a513/91b6d7c3-93c2-5699-9476-6a3c9971a513_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 683327,
'Height': 1938,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/9635/17069635/instrument_cluster-1774712395017.jpg',
'Width': 2584},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91b6d7c3-93c2-5699-9476-6a3c9971a513/91b6d7c3-93c2-5699-9476-6a3c9971a513_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3500514,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/9635/17069635/interior_boot-1774705044876.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91b6d7c3-93c2-5699-9476-6a3c9971a513/91b6d7c3-93c2-5699-9476-6a3c9971a513_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1028643,
'Height': 1909,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9635/17069635/wheels_front_driver-1774704672185.jpg',
'Width': 2545}],
'price': 14098,
'price_includes_vat': False,
'registration_date': '2021-01-13',
'seats_number': None,
'seller_name': None,
'title': 'BMW 218i Sport',
'transmission': 'manual',
'trim': '218i Sport',
'vin': 'WBA12AK0207H53067',
'year': 2021}
2026-03-29 20:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717069635%27 HTTP/1.1" 200 None
2026-03-29 20:21:29 [motorway.uk] INFO: Saving data for 17069635: {'created_time': 1774815689.06027, 'last_price_update_time': 1774815689.060282, 'auction_closing_time': 1774884600.0}
2026-03-29 20:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17069635') HTTP/1.1" 204 0
2026-03-29 20:21:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17844342.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6c248f4-2c07-5f0e-9393-d23c7f9943da with identifier: 17844342
2026-03-29 20:21:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6c248f4-2c07-5f0e-9393-d23c7f9943da with scrape type 1
2026-03-29 20:21:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c6c248f4-2c07-5f0e-9393-d23c7f9943da
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4342%252F17844342%252Fexterior_front_driver-1774697308436.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4342/17844342/exterior_front_driver-1774697308436.jpg not downloaded yet
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4342%252F17844342%252Fexterior_rear_driver-1774697312099.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4342/17844342/exterior_rear_driver-1774697312099.jpg not downloaded yet
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4342%252F17844342%252Fexterior_front_passenger-1774697315019.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4342/17844342/exterior_front_passenger-1774697315019.jpg not downloaded yet
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4342%252F17844342%252Fexterior_rear_passenger-1774697312169.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4342/17844342/exterior_rear_passenger-1774697312169.jpg not downloaded yet
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4342%252F17844342%252Finterior_front_seats-1774698132804.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4342/17844342/interior_front_seats-1774698132804.jpg not downloaded yet
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4342%252F17844342%252Finterior_rear_seats-1774698139474.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4342/17844342/interior_rear_seats-1774698139474.jpg not downloaded yet
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4342%252F17844342%252Finterior_dashboard-1774699129639.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4342/17844342/interior_dashboard-1774699129639.jpg not downloaded yet
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4342%252F17844342%252Finterior_boot-1774698136690.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4342/17844342/interior_boot-1774698136690.jpg not downloaded yet
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4342%252F17844342%252Fdocs_service_history-1774698310023.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D47bd5c31e592fb41816c6952fe8c9b0e%27 HTTP/1.1" 200 None
2026-03-29 20:21:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4342/17844342/docs_service_history-1774698310023.jpg?ixlib=js-3.8.0&auto=format&s=47bd5c31e592fb41816c6952fe8c9b0e not downloaded yet
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4342%252F17844342%252Fdocs_service_history-1774698332986.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0a1fd12b4e0433ecf515c82ee3d07bd6%27 HTTP/1.1" 200 None
2026-03-29 20:21:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4342/17844342/docs_service_history-1774698332986.jpg?ixlib=js-3.8.0&auto=format&s=0a1fd12b4e0433ecf515c82ee3d07bd6 not downloaded yet
2026-03-29 20:21:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20467422.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63714342-a090-5a02-9d2b-66ddb084cb04 with identifier: 20467422
2026-03-29 20:21:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63714342-a090-5a02-9d2b-66ddb084cb04 with scrape type 1
2026-03-29 20:21:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 63714342-a090-5a02-9d2b-66ddb084cb04
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7422%252F20467422%252Fexterior_front_driver-1774708045367.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7422/20467422/exterior_front_driver-1774708045367.jpg not downloaded yet
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7422%252F20467422%252Fexterior_rear_driver-1774708059766.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7422/20467422/exterior_rear_driver-1774708059766.jpg not downloaded yet
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7422%252F20467422%252Fexterior_front_passenger-1774708109762.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7422/20467422/exterior_front_passenger-1774708109762.jpg not downloaded yet
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7422%252F20467422%252Fexterior_rear_passenger-1774708101050.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7422/20467422/exterior_rear_passenger-1774708101050.jpg not downloaded yet
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7422%252F20467422%252Finterior_front_seats-1774708690658.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7422/20467422/interior_front_seats-1774708690658.jpg not downloaded yet
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7422%252F20467422%252Finterior_rear_seats-1774708708494.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7422/20467422/interior_rear_seats-1774708708494.jpg not downloaded yet
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7422%252F20467422%252Finterior_dashboard-1774708745887.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7422/20467422/interior_dashboard-1774708745887.jpg not downloaded yet
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7422%252F20467422%252Finstrument_cluster-1774708750053.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7422/20467422/instrument_cluster-1774708750053.jpg not downloaded yet
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7422%252F20467422%252Finterior_boot-1774708845441.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7422/20467422/interior_boot-1774708845441.jpg not downloaded yet
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7422%252F20467422%252Fdamage_scratches-1774708160328.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7422/20467422/damage_scratches-1774708160328.jpg not downloaded yet
2026-03-29 20:21:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4342/17844342/docs_service_history-1774698332986.jpg?ixlib=js-3.8.0&auto=format&s=0a1fd12b4e0433ecf515c82ee3d07bd6> (referer: None)
2026-03-29 20:21:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658446310>
2026-03-29 20:21:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6c248f4-2c07-5f0e-9393-d23c7f9943da/c6c248f4-2c07-5f0e-9393-d23c7f9943da_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4342%252F17844342%252Fdocs_service_history-1774698332986.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D0a1fd12b4e0433ecf515c82ee3d07bd6') HTTP/1.1" 204 0
2026-03-29 20:21:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4342/17844342/docs_service_history-1774698332986.jpg?ixlib=js-3.8.0&auto=format&s=0a1fd12b4e0433ecf515c82ee3d07bd6 saved to cache
2026-03-29 20:21:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c6c248f4-2c07-5f0e-9393-d23c7f9943da
2026-03-29 20:21:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19751356.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6051ddf7-2491-5162-96b0-23b9ea90cd44 with identifier: 19751356
2026-03-29 20:21:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6051ddf7-2491-5162-96b0-23b9ea90cd44 with scrape type 1
2026-03-29 20:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6051ddf7-2491-5162-96b0-23b9ea90cd44
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1356%252F19751356%252Fexterior_front_driver-1771485905393.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1356/19751356/exterior_front_driver-1771485905393.jpg already downloaded
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1356%252F19751356%252Fexterior_rear_driver-1771485923805.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1356/19751356/exterior_rear_driver-1771485923805.jpg already downloaded
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1356%252F19751356%252Fexterior_front_passenger-1771485945743.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1356/19751356/exterior_front_passenger-1771485945743.jpg already downloaded
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1356%252F19751356%252Fexterior_rear_passenger-1771485933997.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1356/19751356/exterior_rear_passenger-1771485933997.jpg already downloaded
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1356%252F19751356%252Finterior_front_seats-1771486325524.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1356/19751356/interior_front_seats-1771486325524.jpg already downloaded
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1356%252F19751356%252Finterior_rear_seats-1771486353766.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1356/19751356/interior_rear_seats-1771486353766.jpg already downloaded
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1356%252F19751356%252Finterior_dashboard-1771486433820.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1356/19751356/interior_dashboard-1771486433820.jpg already downloaded
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1356%252F19751356%252Finstrument_cluster-1771494477039.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1356/19751356/instrument_cluster-1771494477039.jpg already downloaded
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1356%252F19751356%252Finterior_boot-1771486421951.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1356/19751356/interior_boot-1771486421951.jpg already downloaded
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F1356%252F19751356%252Fdocs_service_history-1771487467097.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D224bb21ad74d72d6ff090453ebd59a75%27 HTTP/1.1" 200 None
2026-03-29 20:21:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/1356/19751356/docs_service_history-1771487467097.jpg?ixlib=js-3.8.0&auto=format&s=224bb21ad74d72d6ff090453ebd59a75 already downloaded
2026-03-29 20:21:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6051ddf7-2491-5162-96b0-23b9ea90cd44, identifier: 19751356
2026-03-29 20:21:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6051ddf7-2491-5162-96b0-23b9ea90cd44 with identifier: 19751356
2026-03-29 20:21:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6051ddf7-2491-5162-96b0-23b9ea90cd44 with identifier: 19751356
2026-03-29 20:21:46 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6051ddf7-2491-5162-96b0-23b9ea90cd44 with identifier: 19751356 to the API
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:21:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19751356.json>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '6051ddf7-2491-5162-96b0-23b9ea90cd44',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NJ15 FHG',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19751356',
'listing': 'auction',
'location': 'Greater London Wembley',
'make': 'Volkswagen',
'model': 'Golf',
'odometer': 102412,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 30,
'photo_urls': ['https://motorway-photos-redacted.imgix.net/1356/19751356/exterior_front_driver-1771485905393.jpg',
'https://motorway-photos-redacted.imgix.net/1356/19751356/exterior_rear_driver-1771485923805.jpg',
'https://motorway-photos-redacted.imgix.net/1356/19751356/exterior_front_passenger-1771485945743.jpg',
'https://motorway-photos-redacted.imgix.net/1356/19751356/exterior_rear_passenger-1771485933997.jpg',
'https://motorway-photos.imgix.net/1356/19751356/interior_front_seats-1771486325524.jpg',
'https://motorway-photos.imgix.net/1356/19751356/interior_rear_seats-1771486353766.jpg',
'https://motorway-photos-redacted.imgix.net/1356/19751356/interior_dashboard-1771486433820.jpg',
'https://motorway-photos-modified.imgix.net/1356/19751356/instrument_cluster-1771494477039.jpg',
'https://motorway-photos.imgix.net/1356/19751356/interior_boot-1771486421951.jpg',
'https://motorway-service-history-photos.imgix.net/redacted/1356/19751356/docs_service_history-1771487467097.jpg?ixlib=js-3.8.0&auto=format&s=224bb21ad74d72d6ff090453ebd59a75'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e372f89-426f-5515-bea2-ce7f8982b915/9e372f89-426f-5515-bea2-ce7f8982b915_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1932114,
'Height': 2587,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1356/19751356/exterior_front_driver-1771485905393.jpg',
'Width': 3449},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e372f89-426f-5515-bea2-ce7f8982b915/9e372f89-426f-5515-bea2-ce7f8982b915_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1541140,
'Height': 2415,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1356/19751356/exterior_rear_driver-1771485923805.jpg',
'Width': 3220},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e372f89-426f-5515-bea2-ce7f8982b915/9e372f89-426f-5515-bea2-ce7f8982b915_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1762179,
'Height': 2647,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1356/19751356/exterior_front_passenger-1771485945743.jpg',
'Width': 3529},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e372f89-426f-5515-bea2-ce7f8982b915/9e372f89-426f-5515-bea2-ce7f8982b915_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1663877,
'Height': 2401,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1356/19751356/exterior_rear_passenger-1771485933997.jpg',
'Width': 3201},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e372f89-426f-5515-bea2-ce7f8982b915/9e372f89-426f-5515-bea2-ce7f8982b915_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3091882,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1356/19751356/interior_front_seats-1771486325524.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e372f89-426f-5515-bea2-ce7f8982b915/9e372f89-426f-5515-bea2-ce7f8982b915_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2748274,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1356/19751356/interior_rear_seats-1771486353766.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e372f89-426f-5515-bea2-ce7f8982b915/9e372f89-426f-5515-bea2-ce7f8982b915_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2096881,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1356/19751356/interior_dashboard-1771486433820.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e372f89-426f-5515-bea2-ce7f8982b915/9e372f89-426f-5515-bea2-ce7f8982b915_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 923662,
'Height': 2197,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1356/19751356/instrument_cluster-1771494477039.jpg',
'Width': 2929},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e372f89-426f-5515-bea2-ce7f8982b915/9e372f89-426f-5515-bea2-ce7f8982b915_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2942257,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1356/19751356/interior_boot-1771486421951.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e372f89-426f-5515-bea2-ce7f8982b915/9e372f89-426f-5515-bea2-ce7f8982b915_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48615,
'Height': 842,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/1356/19751356/docs_service_history-1771487467097.jpg?ixlib=js-3.8.0&auto=format&s=224bb21ad74d72d6ff090453ebd59a75',
'Width': 596}],
'price': 6978,
'price_includes_vat': False,
'registration_date': '2015-03-03',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Golf GTI',
'transmission': 'manual',
'trim': 'GTI',
'vin': 'WVWZZZAUZFW239457',
'year': 2015}
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719751356%27 HTTP/1.1" 200 None
2026-03-29 20:21:46 [motorway.uk] INFO: Saving data for 19751356: {'created_time': 1774815706.733632, 'last_price_update_time': 1774815706.733644, 'auction_closing_time': 1774884600.0}
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19751356') HTTP/1.1" 204 0
2026-03-29 20:21:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7422/20467422/damage_scratches-1774708160328.jpg> (referer: None)
2026-03-29 20:21:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7422/20467422/interior_boot-1774708845441.jpg> (referer: None)
2026-03-29 20:21:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658413ad0>
2026-03-29 20:21:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63714342-a090-5a02-9d2b-66ddb084cb04/63714342-a090-5a02-9d2b-66ddb084cb04_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7422%252F20467422%252Fdamage_scratches-1774708160328.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7422/20467422/damage_scratches-1774708160328.jpg saved to cache
2026-03-29 20:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 63714342-a090-5a02-9d2b-66ddb084cb04
2026-03-29 20:21:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bd93710>
2026-03-29 20:21:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63714342-a090-5a02-9d2b-66ddb084cb04/63714342-a090-5a02-9d2b-66ddb084cb04_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7422%252F20467422%252Finterior_boot-1774708845441.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7422/20467422/interior_boot-1774708845441.jpg saved to cache
2026-03-29 20:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 63714342-a090-5a02-9d2b-66ddb084cb04
2026-03-29 20:21:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7422/20467422/instrument_cluster-1774708750053.jpg> (referer: None)
2026-03-29 20:21:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f0db90>
2026-03-29 20:21:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63714342-a090-5a02-9d2b-66ddb084cb04/63714342-a090-5a02-9d2b-66ddb084cb04_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7422%252F20467422%252Finstrument_cluster-1774708750053.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7422/20467422/instrument_cluster-1774708750053.jpg saved to cache
2026-03-29 20:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 63714342-a090-5a02-9d2b-66ddb084cb04
2026-03-29 20:21:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7422/20467422/interior_rear_seats-1774708708494.jpg> (referer: None)
2026-03-29 20:21:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7422/20467422/interior_dashboard-1774708745887.jpg> (referer: None)
2026-03-29 20:21:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bd936d0>
2026-03-29 20:21:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63714342-a090-5a02-9d2b-66ddb084cb04/63714342-a090-5a02-9d2b-66ddb084cb04_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7422%252F20467422%252Finterior_rear_seats-1774708708494.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7422/20467422/interior_rear_seats-1774708708494.jpg saved to cache
2026-03-29 20:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 63714342-a090-5a02-9d2b-66ddb084cb04
2026-03-29 20:21:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b64550>
2026-03-29 20:21:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63714342-a090-5a02-9d2b-66ddb084cb04/63714342-a090-5a02-9d2b-66ddb084cb04_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7422%252F20467422%252Finterior_dashboard-1774708745887.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7422/20467422/interior_dashboard-1774708745887.jpg saved to cache
2026-03-29 20:21:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 63714342-a090-5a02-9d2b-66ddb084cb04
2026-03-29 20:21:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7422/20467422/interior_front_seats-1774708690658.jpg> (referer: None)
2026-03-29 20:21:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659abf490>
2026-03-29 20:21:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63714342-a090-5a02-9d2b-66ddb084cb04/63714342-a090-5a02-9d2b-66ddb084cb04_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7422%252F20467422%252Finterior_front_seats-1774708690658.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7422/20467422/interior_front_seats-1774708690658.jpg saved to cache
2026-03-29 20:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 63714342-a090-5a02-9d2b-66ddb084cb04
2026-03-29 20:21:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7422/20467422/exterior_rear_passenger-1774708101050.jpg> (referer: None)
2026-03-29 20:21:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b2e190>
2026-03-29 20:21:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63714342-a090-5a02-9d2b-66ddb084cb04/63714342-a090-5a02-9d2b-66ddb084cb04_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7422%252F20467422%252Fexterior_rear_passenger-1774708101050.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7422/20467422/exterior_rear_passenger-1774708101050.jpg saved to cache
2026-03-29 20:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 63714342-a090-5a02-9d2b-66ddb084cb04
2026-03-29 20:21:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7422/20467422/exterior_front_passenger-1774708109762.jpg> (referer: None)
2026-03-29 20:21:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7422/20467422/exterior_rear_driver-1774708059766.jpg> (referer: None)
2026-03-29 20:21:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c167d0>
2026-03-29 20:21:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63714342-a090-5a02-9d2b-66ddb084cb04/63714342-a090-5a02-9d2b-66ddb084cb04_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7422%252F20467422%252Fexterior_front_passenger-1774708109762.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7422/20467422/exterior_front_passenger-1774708109762.jpg saved to cache
2026-03-29 20:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 63714342-a090-5a02-9d2b-66ddb084cb04
2026-03-29 20:21:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658411c50>
2026-03-29 20:21:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63714342-a090-5a02-9d2b-66ddb084cb04/63714342-a090-5a02-9d2b-66ddb084cb04_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7422%252F20467422%252Fexterior_rear_driver-1774708059766.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7422/20467422/exterior_rear_driver-1774708059766.jpg saved to cache
2026-03-29 20:21:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 63714342-a090-5a02-9d2b-66ddb084cb04
2026-03-29 20:21:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7422/20467422/exterior_front_driver-1774708045367.jpg> (referer: None)
2026-03-29 20:21:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4342/17844342/docs_service_history-1774698310023.jpg?ixlib=js-3.8.0&auto=format&s=47bd5c31e592fb41816c6952fe8c9b0e> (referer: None)
2026-03-29 20:21:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b65790>
2026-03-29 20:21:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63714342-a090-5a02-9d2b-66ddb084cb04/63714342-a090-5a02-9d2b-66ddb084cb04_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7422%252F20467422%252Fexterior_front_driver-1774708045367.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7422/20467422/exterior_front_driver-1774708045367.jpg saved to cache
2026-03-29 20:21:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63714342-a090-5a02-9d2b-66ddb084cb04
2026-03-29 20:21:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63714342-a090-5a02-9d2b-66ddb084cb04, skipping ID generation
2026-03-29 20:21:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63714342-a090-5a02-9d2b-66ddb084cb04 with scrape type 1
2026-03-29 20:21:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63714342-a090-5a02-9d2b-66ddb084cb04 sending to next pipeline
2026-03-29 20:21:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 63714342-a090-5a02-9d2b-66ddb084cb04, identifier: 20467422
2026-03-29 20:21:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 63714342-a090-5a02-9d2b-66ddb084cb04 with identifier: 20467422
2026-03-29 20:21:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 63714342-a090-5a02-9d2b-66ddb084cb04 with identifier: 20467422
2026-03-29 20:21:49 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 63714342-a090-5a02-9d2b-66ddb084cb04 with identifier: 20467422 to the API
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:21:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7422/20467422/exterior_front_driver-1774708045367.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '63714342-a090-5a02-9d2b-66ddb084cb04',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'LD08 BJX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20467422',
'listing': 'auction',
'location': 'Warwickshire Warwick',
'make': 'Mercedes',
'model': 'M Class',
'odometer': 116618,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63714342-a090-5a02-9d2b-66ddb084cb04/63714342-a090-5a02-9d2b-66ddb084cb04_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1900266,
'Height': 2700,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7422/20467422/exterior_front_driver-1774708045367.jpg',
'Width': 3600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63714342-a090-5a02-9d2b-66ddb084cb04/63714342-a090-5a02-9d2b-66ddb084cb04_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1594600,
'Height': 2550,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7422/20467422/exterior_rear_driver-1774708059766.jpg',
'Width': 3400},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63714342-a090-5a02-9d2b-66ddb084cb04/63714342-a090-5a02-9d2b-66ddb084cb04_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1538884,
'Height': 2514,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7422/20467422/exterior_front_passenger-1774708109762.jpg',
'Width': 3352},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63714342-a090-5a02-9d2b-66ddb084cb04/63714342-a090-5a02-9d2b-66ddb084cb04_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2000543,
'Height': 2853,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7422/20467422/exterior_rear_passenger-1774708101050.jpg',
'Width': 3804},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63714342-a090-5a02-9d2b-66ddb084cb04/63714342-a090-5a02-9d2b-66ddb084cb04_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3493489,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7422/20467422/interior_front_seats-1774708690658.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63714342-a090-5a02-9d2b-66ddb084cb04/63714342-a090-5a02-9d2b-66ddb084cb04_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3853406,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7422/20467422/interior_rear_seats-1774708708494.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63714342-a090-5a02-9d2b-66ddb084cb04/63714342-a090-5a02-9d2b-66ddb084cb04_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2245112,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7422/20467422/interior_dashboard-1774708745887.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63714342-a090-5a02-9d2b-66ddb084cb04/63714342-a090-5a02-9d2b-66ddb084cb04_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2513062,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7422/20467422/instrument_cluster-1774708750053.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63714342-a090-5a02-9d2b-66ddb084cb04/63714342-a090-5a02-9d2b-66ddb084cb04_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4451673,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7422/20467422/interior_boot-1774708845441.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63714342-a090-5a02-9d2b-66ddb084cb04/63714342-a090-5a02-9d2b-66ddb084cb04_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3105770,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7422/20467422/damage_scratches-1774708160328.jpg',
'Width': 4032}],
'price': 2116,
'price_includes_vat': False,
'registration_date': '2008-06-17',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes ML280 Edition 10 CDI Auto',
'transmission': 'automatic',
'trim': 'ML280 Edition 10 CDI Auto',
'vin': 'WDC1641202A391262',
'year': 2008}
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720467422%27 HTTP/1.1" 200 None
2026-03-29 20:21:49 [motorway.uk] INFO: Saving data for 20467422: {'created_time': 1774815709.77527, 'last_price_update_time': 1774815709.775279, 'auction_closing_time': 1774884600.0}
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20467422') HTTP/1.1" 204 0
2026-03-29 20:21:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658aba950>
2026-03-29 20:21:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6c248f4-2c07-5f0e-9393-d23c7f9943da/c6c248f4-2c07-5f0e-9393-d23c7f9943da_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4342%252F17844342%252Fdocs_service_history-1774698310023.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D47bd5c31e592fb41816c6952fe8c9b0e') HTTP/1.1" 204 0
2026-03-29 20:21:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4342/17844342/docs_service_history-1774698310023.jpg?ixlib=js-3.8.0&auto=format&s=47bd5c31e592fb41816c6952fe8c9b0e saved to cache
2026-03-29 20:21:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c6c248f4-2c07-5f0e-9393-d23c7f9943da
2026-03-29 20:21:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/4342/17844342/interior_dashboard-1774699129639.jpg> (referer: None)
2026-03-29 20:21:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4342/17844342/interior_boot-1774698136690.jpg> (referer: None)
2026-03-29 20:21:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582d5050>
2026-03-29 20:21:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6c248f4-2c07-5f0e-9393-d23c7f9943da/c6c248f4-2c07-5f0e-9393-d23c7f9943da_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:21:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F4342%252F17844342%252Finterior_dashboard-1774699129639.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/4342/17844342/interior_dashboard-1774699129639.jpg saved to cache
2026-03-29 20:21:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c6c248f4-2c07-5f0e-9393-d23c7f9943da
2026-03-29 20:21:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658ab8710>
2026-03-29 20:21:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6c248f4-2c07-5f0e-9393-d23c7f9943da/c6c248f4-2c07-5f0e-9393-d23c7f9943da_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:21:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4342%252F17844342%252Finterior_boot-1774698136690.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4342/17844342/interior_boot-1774698136690.jpg saved to cache
2026-03-29 20:21:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c6c248f4-2c07-5f0e-9393-d23c7f9943da
2026-03-29 20:21:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4342/17844342/interior_rear_seats-1774698139474.jpg> (referer: None)
2026-03-29 20:21:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658abbd10>
2026-03-29 20:21:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6c248f4-2c07-5f0e-9393-d23c7f9943da/c6c248f4-2c07-5f0e-9393-d23c7f9943da_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:21:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4342%252F17844342%252Finterior_rear_seats-1774698139474.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4342/17844342/interior_rear_seats-1774698139474.jpg saved to cache
2026-03-29 20:21:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c6c248f4-2c07-5f0e-9393-d23c7f9943da
2026-03-29 20:21:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4342/17844342/interior_front_seats-1774698132804.jpg> (referer: None)
2026-03-29 20:21:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4342/17844342/exterior_rear_passenger-1774697312169.jpg> (referer: None)
2026-03-29 20:21:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599922d0>
2026-03-29 20:21:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6c248f4-2c07-5f0e-9393-d23c7f9943da/c6c248f4-2c07-5f0e-9393-d23c7f9943da_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:21:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4342%252F17844342%252Finterior_front_seats-1774698132804.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4342/17844342/interior_front_seats-1774698132804.jpg saved to cache
2026-03-29 20:21:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c6c248f4-2c07-5f0e-9393-d23c7f9943da
2026-03-29 20:21:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582d5050>
2026-03-29 20:21:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6c248f4-2c07-5f0e-9393-d23c7f9943da/c6c248f4-2c07-5f0e-9393-d23c7f9943da_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:21:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4342%252F17844342%252Fexterior_rear_passenger-1774697312169.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4342/17844342/exterior_rear_passenger-1774697312169.jpg saved to cache
2026-03-29 20:21:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c6c248f4-2c07-5f0e-9393-d23c7f9943da
2026-03-29 20:21:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4342/17844342/exterior_front_passenger-1774697315019.jpg> (referer: None)
2026-03-29 20:21:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4342/17844342/exterior_rear_driver-1774697312099.jpg> (referer: None)
2026-03-29 20:21:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658410910>
2026-03-29 20:21:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6c248f4-2c07-5f0e-9393-d23c7f9943da/c6c248f4-2c07-5f0e-9393-d23c7f9943da_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4342%252F17844342%252Fexterior_front_passenger-1774697315019.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4342/17844342/exterior_front_passenger-1774697315019.jpg saved to cache
2026-03-29 20:21:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c6c248f4-2c07-5f0e-9393-d23c7f9943da
2026-03-29 20:21:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fee750>
2026-03-29 20:21:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6c248f4-2c07-5f0e-9393-d23c7f9943da/c6c248f4-2c07-5f0e-9393-d23c7f9943da_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4342%252F17844342%252Fexterior_rear_driver-1774697312099.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4342/17844342/exterior_rear_driver-1774697312099.jpg saved to cache
2026-03-29 20:21:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c6c248f4-2c07-5f0e-9393-d23c7f9943da
2026-03-29 20:21:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4342/17844342/exterior_front_driver-1774697308436.jpg> (referer: None)
2026-03-29 20:21:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584110d0>
2026-03-29 20:21:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6c248f4-2c07-5f0e-9393-d23c7f9943da/c6c248f4-2c07-5f0e-9393-d23c7f9943da_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4342%252F17844342%252Fexterior_front_driver-1774697308436.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4342/17844342/exterior_front_driver-1774697308436.jpg saved to cache
2026-03-29 20:21:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c6c248f4-2c07-5f0e-9393-d23c7f9943da
2026-03-29 20:21:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c6c248f4-2c07-5f0e-9393-d23c7f9943da, skipping ID generation
2026-03-29 20:21:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6c248f4-2c07-5f0e-9393-d23c7f9943da with scrape type 1
2026-03-29 20:21:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c6c248f4-2c07-5f0e-9393-d23c7f9943da sending to next pipeline
2026-03-29 20:21:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c6c248f4-2c07-5f0e-9393-d23c7f9943da, identifier: 17844342
2026-03-29 20:21:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c6c248f4-2c07-5f0e-9393-d23c7f9943da with identifier: 17844342
2026-03-29 20:21:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c6c248f4-2c07-5f0e-9393-d23c7f9943da with identifier: 17844342
2026-03-29 20:21:51 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c6c248f4-2c07-5f0e-9393-d23c7f9943da with identifier: 17844342 to the API
2026-03-29 20:21:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:21:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:21:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4342/17844342/exterior_front_driver-1774697308436.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'c6c248f4-2c07-5f0e-9393-d23c7f9943da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AK66 EZM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17844342',
'listing': 'auction',
'location': 'West Midlands Wolverhampton',
'make': 'Volvo',
'model': 'V40',
'odometer': 87811,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6c248f4-2c07-5f0e-9393-d23c7f9943da/c6c248f4-2c07-5f0e-9393-d23c7f9943da_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1771342,
'Height': 2435,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4342/17844342/exterior_front_driver-1774697308436.jpg',
'Width': 3246},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6c248f4-2c07-5f0e-9393-d23c7f9943da/c6c248f4-2c07-5f0e-9393-d23c7f9943da_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1263689,
'Height': 2265,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4342/17844342/exterior_rear_driver-1774697312099.jpg',
'Width': 3020},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6c248f4-2c07-5f0e-9393-d23c7f9943da/c6c248f4-2c07-5f0e-9393-d23c7f9943da_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1304203,
'Height': 2105,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4342/17844342/exterior_front_passenger-1774697315019.jpg',
'Width': 2806},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6c248f4-2c07-5f0e-9393-d23c7f9943da/c6c248f4-2c07-5f0e-9393-d23c7f9943da_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1679165,
'Height': 2528,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4342/17844342/exterior_rear_passenger-1774697312169.jpg',
'Width': 3371},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6c248f4-2c07-5f0e-9393-d23c7f9943da/c6c248f4-2c07-5f0e-9393-d23c7f9943da_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1975140,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4342/17844342/interior_front_seats-1774698132804.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6c248f4-2c07-5f0e-9393-d23c7f9943da/c6c248f4-2c07-5f0e-9393-d23c7f9943da_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1596521,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4342/17844342/interior_rear_seats-1774698139474.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6c248f4-2c07-5f0e-9393-d23c7f9943da/c6c248f4-2c07-5f0e-9393-d23c7f9943da_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1757463,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/4342/17844342/interior_dashboard-1774699129639.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6c248f4-2c07-5f0e-9393-d23c7f9943da/c6c248f4-2c07-5f0e-9393-d23c7f9943da_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2244363,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/4342/17844342/interior_boot-1774698136690.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6c248f4-2c07-5f0e-9393-d23c7f9943da/c6c248f4-2c07-5f0e-9393-d23c7f9943da_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1320038,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4342/17844342/docs_service_history-1774698310023.jpg?ixlib=js-3.8.0&auto=format&s=47bd5c31e592fb41816c6952fe8c9b0e',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6c248f4-2c07-5f0e-9393-d23c7f9943da/c6c248f4-2c07-5f0e-9393-d23c7f9943da_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1283306,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4342/17844342/docs_service_history-1774698332986.jpg?ixlib=js-3.8.0&auto=format&s=0a1fd12b4e0433ecf515c82ee3d07bd6',
'Width': 3840}],
'price': 4307,
'price_includes_vat': False,
'registration_date': '2016-10-15',
'seats_number': None,
'seller_name': None,
'title': 'Volvo V40 Momentum T2',
'transmission': 'manual',
'trim': 'Momentum T2',
'vin': 'YV1MV21L1H2386077',
'year': 2016}
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717844342%27 HTTP/1.1" 200 None
2026-03-29 20:21:52 [motorway.uk] INFO: Saving data for 17844342: {'created_time': 1774815712.068168, 'last_price_update_time': 1774815712.06818, 'auction_closing_time': 1774884600.0}
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17844342') HTTP/1.1" 204 0
2026-03-29 20:21:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6662/20396662/exterior_front_passenger-1774780181167.jpg> (referer: None)
2026-03-29 20:21:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658abab10>
2026-03-29 20:21:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d50bb3-5b14-58c6-9355-85589e515e9f/33d50bb3-5b14-58c6-9355-85589e515e9f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6662%252F20396662%252Fexterior_front_passenger-1774780181167.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6662/20396662/exterior_front_passenger-1774780181167.jpg saved to cache
2026-03-29 20:21:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 33d50bb3-5b14-58c6-9355-85589e515e9f
2026-03-29 20:21:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14381280.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 862e78a3-314f-5f6d-8685-bb1f8d09bf36 with identifier: 14381280
2026-03-29 20:21:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 862e78a3-314f-5f6d-8685-bb1f8d09bf36 with scrape type 1
2026-03-29 20:21:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 862e78a3-314f-5f6d-8685-bb1f8d09bf36
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1280%252F14381280%252Fexterior_front_driver-1770897650502.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1280/14381280/exterior_front_driver-1770897650502.jpg not downloaded yet
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1280%252F14381280%252Fexterior_rear_driver-1770828432449.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1280/14381280/exterior_rear_driver-1770828432449.jpg not downloaded yet
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1280%252F14381280%252Fexterior_front_passenger-1770897657476.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1280/14381280/exterior_front_passenger-1770897657476.jpg not downloaded yet
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1280%252F14381280%252Fexterior_rear_passenger-1770828436282.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1280/14381280/exterior_rear_passenger-1770828436282.jpg not downloaded yet
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1280%252F14381280%252Finterior_front_seats-1770897952741.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1280/14381280/interior_front_seats-1770897952741.jpg not downloaded yet
2026-03-29 20:21:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6662/20396662/exterior_rear_driver-1774780163388.jpg> (referer: None)
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1280%252F14381280%252Finterior_rear_seats-1770828449008.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1280/14381280/interior_rear_seats-1770828449008.jpg not downloaded yet
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1280%252F14381280%252Finterior_dashboard-1774625272119.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1280/14381280/interior_dashboard-1774625272119.jpg not downloaded yet
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1280%252F14381280%252Finstrument_cluster-1770828442813.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1280/14381280/instrument_cluster-1770828442813.jpg not downloaded yet
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1280%252F14381280%252Finterior_boot-1774625285042.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1280/14381280/interior_boot-1774625285042.jpg not downloaded yet
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F1280%252F14381280%252Fdocs_service_history-1770900999821.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8868cf186ba50394ffd6f7204a1eb90e%27 HTTP/1.1" 200 None
2026-03-29 20:21:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/1280/14381280/docs_service_history-1770900999821.jpg?ixlib=js-3.8.0&auto=format&s=8868cf186ba50394ffd6f7204a1eb90e not downloaded yet
2026-03-29 20:21:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf43190>
2026-03-29 20:21:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d50bb3-5b14-58c6-9355-85589e515e9f/33d50bb3-5b14-58c6-9355-85589e515e9f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6662%252F20396662%252Fexterior_rear_driver-1774780163388.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6662/20396662/exterior_rear_driver-1774780163388.jpg saved to cache
2026-03-29 20:21:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 33d50bb3-5b14-58c6-9355-85589e515e9f
2026-03-29 20:21:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6662/20396662/exterior_front_driver-1774780143448.jpg> (referer: None)
2026-03-29 20:21:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a09c90>
2026-03-29 20:21:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d50bb3-5b14-58c6-9355-85589e515e9f/33d50bb3-5b14-58c6-9355-85589e515e9f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:21:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6662%252F20396662%252Fexterior_front_driver-1774780143448.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6662/20396662/exterior_front_driver-1774780143448.jpg saved to cache
2026-03-29 20:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 33d50bb3-5b14-58c6-9355-85589e515e9f
2026-03-29 20:21:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 33d50bb3-5b14-58c6-9355-85589e515e9f, skipping ID generation
2026-03-29 20:21:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33d50bb3-5b14-58c6-9355-85589e515e9f with scrape type 1
2026-03-29 20:21:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 33d50bb3-5b14-58c6-9355-85589e515e9f sending to next pipeline
2026-03-29 20:21:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 33d50bb3-5b14-58c6-9355-85589e515e9f, identifier: 20396662
2026-03-29 20:21:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 33d50bb3-5b14-58c6-9355-85589e515e9f with identifier: 20396662
2026-03-29 20:21:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 20:21:53 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Grey+%26+Black HTTP/1.1" 200 None
2026-03-29 20:21:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 20:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 20:21:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 33d50bb3-5b14-58c6-9355-85589e515e9f with identifier: 20396662
2026-03-29 20:21:53 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 33d50bb3-5b14-58c6-9355-85589e515e9f with identifier: 20396662 to the API
2026-03-29 20:21:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:21:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:21:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6662/20396662/exterior_front_driver-1774780143448.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '33d50bb3-5b14-58c6-9355-85589e515e9f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'HT16 WME',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20396662',
'listing': 'auction',
'location': 'West Yorkshire Huddersfield',
'make': 'Renault',
'model': 'Captur',
'odometer': 81000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d50bb3-5b14-58c6-9355-85589e515e9f/33d50bb3-5b14-58c6-9355-85589e515e9f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2644567,
'Height': 2891,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6662/20396662/exterior_front_driver-1774780143448.jpg',
'Width': 3855},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d50bb3-5b14-58c6-9355-85589e515e9f/33d50bb3-5b14-58c6-9355-85589e515e9f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1754945,
'Height': 2420,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6662/20396662/exterior_rear_driver-1774780163388.jpg',
'Width': 3226},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d50bb3-5b14-58c6-9355-85589e515e9f/33d50bb3-5b14-58c6-9355-85589e515e9f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2257586,
'Height': 2759,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6662/20396662/exterior_front_passenger-1774780181167.jpg',
'Width': 3679},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d50bb3-5b14-58c6-9355-85589e515e9f/33d50bb3-5b14-58c6-9355-85589e515e9f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1649787,
'Height': 2327,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6662/20396662/exterior_rear_passenger-1774780170484.jpg',
'Width': 3103},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d50bb3-5b14-58c6-9355-85589e515e9f/33d50bb3-5b14-58c6-9355-85589e515e9f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3628480,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6662/20396662/interior_front_seats-1774782045058.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d50bb3-5b14-58c6-9355-85589e515e9f/33d50bb3-5b14-58c6-9355-85589e515e9f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4070603,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6662/20396662/interior_rear_seats-1774782179983.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d50bb3-5b14-58c6-9355-85589e515e9f/33d50bb3-5b14-58c6-9355-85589e515e9f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4361084,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6662/20396662/interior_dashboard-1774782105704.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d50bb3-5b14-58c6-9355-85589e515e9f/33d50bb3-5b14-58c6-9355-85589e515e9f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3828045,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6662/20396662/interior_boot-1774780455961.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d50bb3-5b14-58c6-9355-85589e515e9f/33d50bb3-5b14-58c6-9355-85589e515e9f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3090875,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6662/20396662/damage_scratches-1774780191897.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33d50bb3-5b14-58c6-9355-85589e515e9f/33d50bb3-5b14-58c6-9355-85589e515e9f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2213714,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6662/20396662/damage_dents-1774780213468.jpg',
'Width': 4032}],
'price': 5305,
'price_includes_vat': False,
'registration_date': '2016-06-28',
'seats_number': None,
'seller_name': None,
'title': 'Renault Captur Dynamique S NAV DC',
'transmission': 'automatic',
'trim': 'Dynamique S NAV DC',
'vin': 'VF12RAJ1D55805762',
'year': 2016}
2026-03-29 20:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720396662%27 HTTP/1.1" 200 None
2026-03-29 20:21:53 [motorway.uk] INFO: Saving data for 20396662: {'created_time': 1774815713.741081, 'last_price_update_time': 1774815713.741092, 'auction_closing_time': 1774884600.0}
2026-03-29 20:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20396662') HTTP/1.1" 204 0
2026-03-29 20:21:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/1280/14381280/docs_service_history-1770900999821.jpg?ixlib=js-3.8.0&auto=format&s=8868cf186ba50394ffd6f7204a1eb90e> (referer: None)
2026-03-29 20:21:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658446dd0>
2026-03-29 20:21:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_862e78a3-314f-5f6d-8685-bb1f8d09bf36/862e78a3-314f-5f6d-8685-bb1f8d09bf36_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252F1280%252F14381280%252Fdocs_service_history-1770900999821.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D8868cf186ba50394ffd6f7204a1eb90e') HTTP/1.1" 204 0
2026-03-29 20:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/1280/14381280/docs_service_history-1770900999821.jpg?ixlib=js-3.8.0&auto=format&s=8868cf186ba50394ffd6f7204a1eb90e saved to cache
2026-03-29 20:21:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 862e78a3-314f-5f6d-8685-bb1f8d09bf36
2026-03-29 20:21:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1280/14381280/interior_front_seats-1770897952741.jpg> (referer: None)
2026-03-29 20:21:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1280/14381280/interior_boot-1774625285042.jpg> (referer: None)
2026-03-29 20:21:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 146 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 154 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:54 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xe0'
2026-03-29 20:21:54 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 162 - value: b'DNY-NX9\x00'
2026-03-29 20:21:54 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xe8'
2026-03-29 20:21:54 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 82 - Data Location: 170 - value: b'HONOR\x00'
2026-03-29 20:21:54 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xc4'
2026-03-29 20:21:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:21:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:54 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 142 - Data Location: 176 - value: b'2026:02:12 12:01:52\x00'
2026-03-29 20:21:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a08690>
2026-03-29 20:21:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_862e78a3-314f-5f6d-8685-bb1f8d09bf36/862e78a3-314f-5f6d-8685-bb1f8d09bf36_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1280%252F14381280%252Finterior_front_seats-1770897952741.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1280/14381280/interior_front_seats-1770897952741.jpg saved to cache
2026-03-29 20:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 862e78a3-314f-5f6d-8685-bb1f8d09bf36
2026-03-29 20:21:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582d5c10>
2026-03-29 20:21:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_862e78a3-314f-5f6d-8685-bb1f8d09bf36/862e78a3-314f-5f6d-8685-bb1f8d09bf36_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1280%252F14381280%252Finterior_boot-1774625285042.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1280/14381280/interior_boot-1774625285042.jpg saved to cache
2026-03-29 20:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 862e78a3-314f-5f6d-8685-bb1f8d09bf36
2026-03-29 20:21:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1280/14381280/interior_dashboard-1774625272119.jpg> (referer: None)
2026-03-29 20:21:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6580f9b50>
2026-03-29 20:21:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_862e78a3-314f-5f6d-8685-bb1f8d09bf36/862e78a3-314f-5f6d-8685-bb1f8d09bf36_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1280%252F14381280%252Finterior_dashboard-1774625272119.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1280/14381280/interior_dashboard-1774625272119.jpg saved to cache
2026-03-29 20:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 862e78a3-314f-5f6d-8685-bb1f8d09bf36
2026-03-29 20:21:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19234910.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a68b2d7-e877-5bc2-811b-5e1e6f592211 with identifier: 19234910
2026-03-29 20:21:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a68b2d7-e877-5bc2-811b-5e1e6f592211 with scrape type 1
2026-03-29 20:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8a68b2d7-e877-5bc2-811b-5e1e6f592211
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4910%252F19234910%252Fexterior_front_driver-1768661352384.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4910/19234910/exterior_front_driver-1768661352384.jpg not downloaded yet
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4910%252F19234910%252Fexterior_rear_driver-1768661407801.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4910/19234910/exterior_rear_driver-1768661407801.jpg not downloaded yet
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4910%252F19234910%252Fexterior_front_passenger-1768661498927.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4910/19234910/exterior_front_passenger-1768661498927.jpg not downloaded yet
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4910%252F19234910%252Fexterior_rear_passenger-1768661404787.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4910/19234910/exterior_rear_passenger-1768661404787.jpg not downloaded yet
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4910%252F19234910%252Finterior_front_seats-1773486039856.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4910/19234910/interior_front_seats-1773486039856.jpg not downloaded yet
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4910%252F19234910%252Finterior_rear_seats-1773486060974.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4910/19234910/interior_rear_seats-1773486060974.jpg not downloaded yet
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4910%252F19234910%252Finterior_dashboard-1773486136681.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4910/19234910/interior_dashboard-1773486136681.jpg not downloaded yet
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4910%252F19234910%252Finstrument_cluster-1773486126755.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4910/19234910/instrument_cluster-1773486126755.jpg not downloaded yet
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F4910%252F19234910%252Finterior_boot-1773486175458.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4910/19234910/interior_boot-1773486175458.jpg not downloaded yet
2026-03-29 20:21:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4910%252F19234910%252Fdocs_service_history-1774786072398.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9812a99329193e92bbcf84fea8a73f74%27 HTTP/1.1" 200 None
2026-03-29 20:21:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4910/19234910/docs_service_history-1774786072398.jpg?ixlib=js-3.8.0&auto=format&s=9812a99329193e92bbcf84fea8a73f74 not downloaded yet
2026-03-29 20:21:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1280/14381280/exterior_rear_passenger-1770828436282.jpg> (referer: None)
2026-03-29 20:21:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1280/14381280/instrument_cluster-1770828442813.jpg> (referer: None)
2026-03-29 20:21:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598d9850>
2026-03-29 20:21:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_862e78a3-314f-5f6d-8685-bb1f8d09bf36/862e78a3-314f-5f6d-8685-bb1f8d09bf36_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1280%252F14381280%252Fexterior_rear_passenger-1770828436282.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1280/14381280/exterior_rear_passenger-1770828436282.jpg saved to cache
2026-03-29 20:21:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 862e78a3-314f-5f6d-8685-bb1f8d09bf36
2026-03-29 20:21:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 146 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 154 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:55 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xe0'
2026-03-29 20:21:55 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 162 - value: b'DNY-NX9\x00'
2026-03-29 20:21:55 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xe8'
2026-03-29 20:21:55 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 82 - Data Location: 170 - value: b'HONOR\x00'
2026-03-29 20:21:55 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xc4'
2026-03-29 20:21:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:21:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:55 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 142 - Data Location: 176 - value: b'2026:02:11 16:36:45\x00'
2026-03-29 20:21:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659ce56d0>
2026-03-29 20:21:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_862e78a3-314f-5f6d-8685-bb1f8d09bf36/862e78a3-314f-5f6d-8685-bb1f8d09bf36_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1280%252F14381280%252Finstrument_cluster-1770828442813.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1280/14381280/instrument_cluster-1770828442813.jpg saved to cache
2026-03-29 20:21:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 862e78a3-314f-5f6d-8685-bb1f8d09bf36
2026-03-29 20:21:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1280/14381280/interior_rear_seats-1770828449008.jpg> (referer: None)
2026-03-29 20:21:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19513424.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 22 - Data Location: 146 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 154 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:55 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x0f\xe0'
2026-03-29 20:21:55 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 58 - Data Location: 162 - value: b'DNY-NX9\x00'
2026-03-29 20:21:55 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x0b\xe8'
2026-03-29 20:21:55 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 82 - Data Location: 170 - value: b'HONOR\x00'
2026-03-29 20:21:55 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xc4'
2026-03-29 20:21:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x06'
2026-03-29 20:21:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:55 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 142 - Data Location: 176 - value: b'2026:02:11 16:38:08\x00'
2026-03-29 20:21:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f0ce90>
2026-03-29 20:21:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_862e78a3-314f-5f6d-8685-bb1f8d09bf36/862e78a3-314f-5f6d-8685-bb1f8d09bf36_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1280%252F14381280%252Finterior_rear_seats-1770828449008.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1280/14381280/interior_rear_seats-1770828449008.jpg saved to cache
2026-03-29 20:21:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 862e78a3-314f-5f6d-8685-bb1f8d09bf36
2026-03-29 20:21:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6da3ac9-3755-5da2-8d05-22f84f91658f with identifier: 19513424
2026-03-29 20:21:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6da3ac9-3755-5da2-8d05-22f84f91658f with scrape type 1
2026-03-29 20:21:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d6da3ac9-3755-5da2-8d05-22f84f91658f
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3424%252F19513424%252F19513424-exterior_front_driver-modified-1774779485051.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:21:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3424/19513424/19513424-exterior_front_driver-modified-1774779485051.jpeg not downloaded yet
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3424%252F19513424%252Fexterior_rear_driver-1774518373085.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3424/19513424/exterior_rear_driver-1774518373085.jpg not downloaded yet
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3424%252F19513424%252Fexterior_front_passenger-1774518406515.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3424/19513424/exterior_front_passenger-1774518406515.jpg not downloaded yet
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3424%252F19513424%252Fexterior_rear_passenger-1774518423485.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3424/19513424/exterior_rear_passenger-1774518423485.jpg not downloaded yet
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3424%252F19513424%252F19513424-interior_front_seats-modified-1774779615957.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:21:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3424/19513424/19513424-interior_front_seats-modified-1774779615957.jpeg not downloaded yet
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3424%252F19513424%252Finterior_rear_seats-1774518516563.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3424/19513424/interior_rear_seats-1774518516563.jpg not downloaded yet
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3424%252F19513424%252F19513424-interior_dashboard-modified-1774779204057.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:21:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3424/19513424/19513424-interior_dashboard-modified-1774779204057.jpeg not downloaded yet
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3424%252F19513424%252Finstrument_cluster-1774518621744.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3424/19513424/instrument_cluster-1774518621744.jpg not downloaded yet
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3424%252F19513424%252Finterior_boot-1774518573166.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:21:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3424/19513424/interior_boot-1774518573166.jpg not downloaded yet
2026-03-29 20:21:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/4910/19234910/docs_service_history-1774786072398.jpg?ixlib=js-3.8.0&auto=format&s=9812a99329193e92bbcf84fea8a73f74> (referer: None)
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3424%252F19513424%252Fdocs_service_history-1774545536303.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfdb76cae0dde559a7538582ec0c6b6bb%27 HTTP/1.1" 200 None
2026-03-29 20:21:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3424/19513424/docs_service_history-1774545536303.jpg?ixlib=js-3.8.0&auto=format&s=fdb76cae0dde559a7538582ec0c6b6bb not downloaded yet
2026-03-29 20:21:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4910/19234910/interior_boot-1773486175458.jpg> (referer: None)
2026-03-29 20:21:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 86 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 94 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:56 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00f'
2026-03-29 20:21:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658c21f90>
2026-03-29 20:21:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a68b2d7-e877-5bc2-811b-5e1e6f592211/8a68b2d7-e877-5bc2-811b-5e1e6f592211_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F4910%252F19234910%252Fdocs_service_history-1774786072398.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9812a99329193e92bbcf84fea8a73f74') HTTP/1.1" 204 0
2026-03-29 20:21:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/4910/19234910/docs_service_history-1774786072398.jpg?ixlib=js-3.8.0&auto=format&s=9812a99329193e92bbcf84fea8a73f74 saved to cache
2026-03-29 20:21:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8a68b2d7-e877-5bc2-811b-5e1e6f592211
2026-03-29 20:21:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf5fc50>
2026-03-29 20:21:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a68b2d7-e877-5bc2-811b-5e1e6f592211/8a68b2d7-e877-5bc2-811b-5e1e6f592211_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4910%252F19234910%252Finterior_boot-1773486175458.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4910/19234910/interior_boot-1773486175458.jpg saved to cache
2026-03-29 20:21:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8a68b2d7-e877-5bc2-811b-5e1e6f592211
2026-03-29 20:21:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4910/19234910/interior_dashboard-1773486136681.jpg> (referer: None)
2026-03-29 20:21:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4910/19234910/instrument_cluster-1773486126755.jpg> (referer: None)
2026-03-29 20:21:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3424/19513424/instrument_cluster-1774518621744.jpg> (referer: None)
2026-03-29 20:21:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e85990>
2026-03-29 20:21:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a68b2d7-e877-5bc2-811b-5e1e6f592211/8a68b2d7-e877-5bc2-811b-5e1e6f592211_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4910%252F19234910%252Finterior_dashboard-1773486136681.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4910/19234910/interior_dashboard-1773486136681.jpg saved to cache
2026-03-29 20:21:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8a68b2d7-e877-5bc2-811b-5e1e6f592211
2026-03-29 20:21:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be54e90>
2026-03-29 20:21:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a68b2d7-e877-5bc2-811b-5e1e6f592211/8a68b2d7-e877-5bc2-811b-5e1e6f592211_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4910%252F19234910%252Finstrument_cluster-1773486126755.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4910/19234910/instrument_cluster-1773486126755.jpg saved to cache
2026-03-29 20:21:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8a68b2d7-e877-5bc2-811b-5e1e6f592211
2026-03-29 20:21:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583fb7d0>
2026-03-29 20:21:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6da3ac9-3755-5da2-8d05-22f84f91658f/d6da3ac9-3755-5da2-8d05-22f84f91658f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3424%252F19513424%252Finstrument_cluster-1774518621744.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3424/19513424/instrument_cluster-1774518621744.jpg saved to cache
2026-03-29 20:21:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d6da3ac9-3755-5da2-8d05-22f84f91658f
2026-03-29 20:21:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3424/19513424/docs_service_history-1774545536303.jpg?ixlib=js-3.8.0&auto=format&s=fdb76cae0dde559a7538582ec0c6b6bb> (referer: None)
2026-03-29 20:21:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3424/19513424/interior_boot-1774518573166.jpg> (referer: None)
2026-03-29 20:21:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3424/19513424/19513424-interior_dashboard-modified-1774779204057.jpeg> (referer: None)
2026-03-29 20:21:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3424/19513424/interior_rear_seats-1774518516563.jpg> (referer: None)
2026-03-29 20:21:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-29 20:21:56 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:21:56 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:21:56 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00\x10R\x12\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\xbba\x00\x10J\x85\x00\x00\x00\x00'
2026-03-29 20:21:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fbe9d0>
2026-03-29 20:21:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6da3ac9-3755-5da2-8d05-22f84f91658f/d6da3ac9-3755-5da2-8d05-22f84f91658f_image_9.mpo HTTP/1.1" 201 0
2026-03-29 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3424%252F19513424%252Fdocs_service_history-1774545536303.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dfdb76cae0dde559a7538582ec0c6b6bb') HTTP/1.1" 204 0
2026-03-29 20:21:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3424/19513424/docs_service_history-1774545536303.jpg?ixlib=js-3.8.0&auto=format&s=fdb76cae0dde559a7538582ec0c6b6bb saved to cache
2026-03-29 20:21:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d6da3ac9-3755-5da2-8d05-22f84f91658f
2026-03-29 20:21:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e847d0>
2026-03-29 20:21:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6da3ac9-3755-5da2-8d05-22f84f91658f/d6da3ac9-3755-5da2-8d05-22f84f91658f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3424%252F19513424%252Finterior_boot-1774518573166.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3424/19513424/interior_boot-1774518573166.jpg saved to cache
2026-03-29 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d6da3ac9-3755-5da2-8d05-22f84f91658f
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599fa250>
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6da3ac9-3755-5da2-8d05-22f84f91658f/d6da3ac9-3755-5da2-8d05-22f84f91658f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3424%252F19513424%252F19513424-interior_dashboard-modified-1774779204057.jpeg') HTTP/1.1" 204 0
2026-03-29 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3424/19513424/19513424-interior_dashboard-modified-1774779204057.jpeg saved to cache
2026-03-29 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d6da3ac9-3755-5da2-8d05-22f84f91658f
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65879ce90>
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6da3ac9-3755-5da2-8d05-22f84f91658f/d6da3ac9-3755-5da2-8d05-22f84f91658f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3424%252F19513424%252Finterior_rear_seats-1774518516563.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3424/19513424/interior_rear_seats-1774518516563.jpg saved to cache
2026-03-29 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d6da3ac9-3755-5da2-8d05-22f84f91658f
2026-03-29 20:21:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3424/19513424/exterior_rear_passenger-1774518423485.jpg> (referer: None)
2026-03-29 20:21:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3424/19513424/19513424-interior_front_seats-modified-1774779615957.jpeg> (referer: None)
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589fb110>
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6da3ac9-3755-5da2-8d05-22f84f91658f/d6da3ac9-3755-5da2-8d05-22f84f91658f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3424%252F19513424%252Fexterior_rear_passenger-1774518423485.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3424/19513424/exterior_rear_passenger-1774518423485.jpg saved to cache
2026-03-29 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6da3ac9-3755-5da2-8d05-22f84f91658f
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a4fad0>
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6da3ac9-3755-5da2-8d05-22f84f91658f/d6da3ac9-3755-5da2-8d05-22f84f91658f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3424%252F19513424%252F19513424-interior_front_seats-modified-1774779615957.jpeg') HTTP/1.1" 204 0
2026-03-29 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3424/19513424/19513424-interior_front_seats-modified-1774779615957.jpeg saved to cache
2026-03-29 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6da3ac9-3755-5da2-8d05-22f84f91658f
2026-03-29 20:21:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3424/19513424/19513424-exterior_front_driver-modified-1774779485051.jpeg> (referer: None)
2026-03-29 20:21:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3424/19513424/exterior_rear_driver-1774518373085.jpg> (referer: None)
2026-03-29 20:21:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3424/19513424/exterior_front_passenger-1774518406515.jpg> (referer: None)
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e46490>
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6da3ac9-3755-5da2-8d05-22f84f91658f/d6da3ac9-3755-5da2-8d05-22f84f91658f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3424%252F19513424%252F19513424-exterior_front_driver-modified-1774779485051.jpeg') HTTP/1.1" 204 0
2026-03-29 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3424/19513424/19513424-exterior_front_driver-modified-1774779485051.jpeg saved to cache
2026-03-29 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6da3ac9-3755-5da2-8d05-22f84f91658f
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f68f50>
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6da3ac9-3755-5da2-8d05-22f84f91658f/d6da3ac9-3755-5da2-8d05-22f84f91658f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3424%252F19513424%252Fexterior_rear_driver-1774518373085.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3424/19513424/exterior_rear_driver-1774518373085.jpg saved to cache
2026-03-29 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d6da3ac9-3755-5da2-8d05-22f84f91658f
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583faf50>
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6da3ac9-3755-5da2-8d05-22f84f91658f/d6da3ac9-3755-5da2-8d05-22f84f91658f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3424%252F19513424%252Fexterior_front_passenger-1774518406515.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3424/19513424/exterior_front_passenger-1774518406515.jpg saved to cache
2026-03-29 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6da3ac9-3755-5da2-8d05-22f84f91658f
2026-03-29 20:21:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6da3ac9-3755-5da2-8d05-22f84f91658f, skipping ID generation
2026-03-29 20:21:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6da3ac9-3755-5da2-8d05-22f84f91658f with scrape type 1
2026-03-29 20:21:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6da3ac9-3755-5da2-8d05-22f84f91658f sending to next pipeline
2026-03-29 20:21:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d6da3ac9-3755-5da2-8d05-22f84f91658f, identifier: 19513424
2026-03-29 20:21:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d6da3ac9-3755-5da2-8d05-22f84f91658f with identifier: 19513424
2026-03-29 20:21:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d6da3ac9-3755-5da2-8d05-22f84f91658f with identifier: 19513424
2026-03-29 20:21:58 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d6da3ac9-3755-5da2-8d05-22f84f91658f with identifier: 19513424 to the API
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:21:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3424/19513424/exterior_front_passenger-1774518406515.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'd6da3ac9-3755-5da2-8d05-22f84f91658f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MU54 PHE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19513424',
'listing': 'auction',
'location': 'Bridgend County Borough Maesteg',
'make': 'Mercedes',
'model': 'A Class',
'odometer': 60284,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6da3ac9-3755-5da2-8d05-22f84f91658f/d6da3ac9-3755-5da2-8d05-22f84f91658f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1036157,
'Height': 2009,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3424/19513424/19513424-exterior_front_driver-modified-1774779485051.jpeg',
'Width': 2679},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6da3ac9-3755-5da2-8d05-22f84f91658f/d6da3ac9-3755-5da2-8d05-22f84f91658f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 648384,
'Height': 1833,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3424/19513424/exterior_rear_driver-1774518373085.jpg',
'Width': 2444},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6da3ac9-3755-5da2-8d05-22f84f91658f/d6da3ac9-3755-5da2-8d05-22f84f91658f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 676160,
'Height': 1859,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3424/19513424/exterior_front_passenger-1774518406515.jpg',
'Width': 2479},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6da3ac9-3755-5da2-8d05-22f84f91658f/d6da3ac9-3755-5da2-8d05-22f84f91658f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 620823,
'Height': 1737,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3424/19513424/exterior_rear_passenger-1774518423485.jpg',
'Width': 2316},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6da3ac9-3755-5da2-8d05-22f84f91658f/d6da3ac9-3755-5da2-8d05-22f84f91658f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1497086,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3424/19513424/19513424-interior_front_seats-modified-1774779615957.jpeg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6da3ac9-3755-5da2-8d05-22f84f91658f/d6da3ac9-3755-5da2-8d05-22f84f91658f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 893562,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/3424/19513424/interior_rear_seats-1774518516563.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6da3ac9-3755-5da2-8d05-22f84f91658f/d6da3ac9-3755-5da2-8d05-22f84f91658f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2568199,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3424/19513424/19513424-interior_dashboard-modified-1774779204057.jpeg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6da3ac9-3755-5da2-8d05-22f84f91658f/d6da3ac9-3755-5da2-8d05-22f84f91658f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1249135,
'Height': 3060,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3424/19513424/instrument_cluster-1774518621744.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6da3ac9-3755-5da2-8d05-22f84f91658f/d6da3ac9-3755-5da2-8d05-22f84f91658f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1627677,
'Height': 3060,
'OriginUrl': 'https://motorway-photos.imgix.net/3424/19513424/interior_boot-1774518573166.jpg',
'Width': 4080},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6da3ac9-3755-5da2-8d05-22f84f91658f/d6da3ac9-3755-5da2-8d05-22f84f91658f_image_9.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 1117555,
'Height': 4000,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3424/19513424/docs_service_history-1774545536303.jpg?ixlib=js-3.8.0&auto=format&s=fdb76cae0dde559a7538582ec0c6b6bb',
'Width': 3000}],
'price': 7426,
'price_includes_vat': False,
'registration_date': '2016-10-31',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes A 180 D AMG Line',
'transmission': 'manual',
'trim': 'A 180 D AMG Line',
'vin': 'WDD1760122V166131',
'year': 2016}
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719513424%27 HTTP/1.1" 200 None
2026-03-29 20:21:58 [motorway.uk] INFO: Saving data for 19513424: {'created_time': 1774815718.497415, 'last_price_update_time': 1774815718.497427, 'auction_closing_time': 1774884600.0}
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19513424') HTTP/1.1" 204 0
2026-03-29 20:21:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4910/19234910/interior_rear_seats-1773486060974.jpg> (referer: None)
2026-03-29 20:21:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4910/19234910/exterior_front_passenger-1768661498927.jpg> (referer: None)
2026-03-29 20:21:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4910/19234910/exterior_rear_passenger-1768661404787.jpg> (referer: None)
2026-03-29 20:21:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/4910/19234910/interior_front_seats-1773486039856.jpg> (referer: None)
2026-03-29 20:21:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f8c490>
2026-03-29 20:21:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a68b2d7-e877-5bc2-811b-5e1e6f592211/8a68b2d7-e877-5bc2-811b-5e1e6f592211_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4910%252F19234910%252Finterior_rear_seats-1773486060974.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4910/19234910/interior_rear_seats-1773486060974.jpg saved to cache
2026-03-29 20:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8a68b2d7-e877-5bc2-811b-5e1e6f592211
2026-03-29 20:21:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1548&page=43&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:21:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:21:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659bffd10>
2026-03-29 20:21:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a68b2d7-e877-5bc2-811b-5e1e6f592211/8a68b2d7-e877-5bc2-811b-5e1e6f592211_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4910%252F19234910%252Fexterior_front_passenger-1768661498927.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4910/19234910/exterior_front_passenger-1768661498927.jpg saved to cache
2026-03-29 20:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8a68b2d7-e877-5bc2-811b-5e1e6f592211
2026-03-29 20:21:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586d8690>
2026-03-29 20:21:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a68b2d7-e877-5bc2-811b-5e1e6f592211/8a68b2d7-e877-5bc2-811b-5e1e6f592211_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4910%252F19234910%252Fexterior_rear_passenger-1768661404787.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4910/19234910/exterior_rear_passenger-1768661404787.jpg saved to cache
2026-03-29 20:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8a68b2d7-e877-5bc2-811b-5e1e6f592211
2026-03-29 20:21:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:21:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:21:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:21:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:21:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d78990>
2026-03-29 20:21:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a68b2d7-e877-5bc2-811b-5e1e6f592211/8a68b2d7-e877-5bc2-811b-5e1e6f592211_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F4910%252F19234910%252Finterior_front_seats-1773486039856.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/4910/19234910/interior_front_seats-1773486039856.jpg saved to cache
2026-03-29 20:21:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8a68b2d7-e877-5bc2-811b-5e1e6f592211
2026-03-29 20:21:58 [motorway.uk] INFO: Found listing with ID: 20440595
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720440595%27 HTTP/1.1" 200 None
2026-03-29 20:21:59 [motorway.uk] INFO: Scrape type for 20440595: 1
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 20484011
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 20329533
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 19798498
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 20066226
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 18421687
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 20199197
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720199197%27 HTTP/1.1" 200 None
2026-03-29 20:21:59 [motorway.uk] INFO: Scrape type for 20199197: 1
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 19475567
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 19580249
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 9018744
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 20414685
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 14657011
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 19911856
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719911856%27 HTTP/1.1" 200 None
2026-03-29 20:21:59 [motorway.uk] INFO: Scrape type for 19911856: 1
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 10143250
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 20267897
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 19688766
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 20489770
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720489770%27 HTTP/1.1" 200 None
2026-03-29 20:21:59 [motorway.uk] INFO: Scrape type for 20489770: 1
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 16571680
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 20430888
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 20485034
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 3044789
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 20138195
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 20392438
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 16417496
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 18624558
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718624558%27 HTTP/1.1" 200 None
2026-03-29 20:21:59 [motorway.uk] INFO: Scrape type for 18624558: 1
2026-03-29 20:21:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4910/19234910/exterior_rear_driver-1768661407801.jpg> (referer: None)
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 19258894
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 13525953
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 17208307
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 17537906
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717537906%27 HTTP/1.1" 200 None
2026-03-29 20:21:59 [motorway.uk] INFO: Scrape type for 17537906: 1
2026-03-29 20:21:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1280/14381280/exterior_front_passenger-1770897657476.jpg> (referer: None)
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 15848839
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 20122744
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720122744%27 HTTP/1.1" 200 None
2026-03-29 20:21:59 [motorway.uk] INFO: Scrape type for 20122744: 1
2026-03-29 20:21:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/4910/19234910/exterior_front_driver-1768661352384.jpg> (referer: None)
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 20442189
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 19052068
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719052068%27 HTTP/1.1" 200 None
2026-03-29 20:21:59 [motorway.uk] INFO: Scrape type for 19052068: 1
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 20414776
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 10974269
2026-03-29 20:21:59 [motorway.uk] INFO: Found listing with ID: 20354803
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720354803%27 HTTP/1.1" 200 None
2026-03-29 20:21:59 [motorway.uk] INFO: Scrape type for 20354803: 1
2026-03-29 20:21:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1280/14381280/exterior_front_driver-1770897650502.jpg> (referer: None)
2026-03-29 20:21:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586da250>
2026-03-29 20:21:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a68b2d7-e877-5bc2-811b-5e1e6f592211/8a68b2d7-e877-5bc2-811b-5e1e6f592211_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4910%252F19234910%252Fexterior_rear_driver-1768661407801.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4910/19234910/exterior_rear_driver-1768661407801.jpg saved to cache
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8a68b2d7-e877-5bc2-811b-5e1e6f592211
2026-03-29 20:21:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65888df10>
2026-03-29 20:21:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_862e78a3-314f-5f6d-8685-bb1f8d09bf36/862e78a3-314f-5f6d-8685-bb1f8d09bf36_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1280%252F14381280%252Fexterior_front_passenger-1770897657476.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1280/14381280/exterior_front_passenger-1770897657476.jpg saved to cache
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 862e78a3-314f-5f6d-8685-bb1f8d09bf36
2026-03-29 20:21:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:21:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582d7dd0>
2026-03-29 20:21:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:21:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a68b2d7-e877-5bc2-811b-5e1e6f592211/8a68b2d7-e877-5bc2-811b-5e1e6f592211_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F4910%252F19234910%252Fexterior_front_driver-1768661352384.jpg') HTTP/1.1" 204 0
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/4910/19234910/exterior_front_driver-1768661352384.jpg saved to cache
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8a68b2d7-e877-5bc2-811b-5e1e6f592211
2026-03-29 20:21:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8a68b2d7-e877-5bc2-811b-5e1e6f592211, skipping ID generation
2026-03-29 20:21:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a68b2d7-e877-5bc2-811b-5e1e6f592211 with scrape type 1
2026-03-29 20:21:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8a68b2d7-e877-5bc2-811b-5e1e6f592211 sending to next pipeline
2026-03-29 20:21:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8a68b2d7-e877-5bc2-811b-5e1e6f592211, identifier: 19234910
2026-03-29 20:21:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8a68b2d7-e877-5bc2-811b-5e1e6f592211 with identifier: 19234910
2026-03-29 20:21:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8a68b2d7-e877-5bc2-811b-5e1e6f592211 with identifier: 19234910
2026-03-29 20:21:59 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8a68b2d7-e877-5bc2-811b-5e1e6f592211 with identifier: 19234910 to the API
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:21:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/4910/19234910/exterior_front_driver-1768661352384.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '8a68b2d7-e877-5bc2-811b-5e1e6f592211',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'X6 JDX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19234910',
'listing': 'auction',
'location': 'Cardiff Cardiff',
'make': 'MINI',
'model': 'Clubman',
'odometer': 66167,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a68b2d7-e877-5bc2-811b-5e1e6f592211/8a68b2d7-e877-5bc2-811b-5e1e6f592211_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1120352,
'Height': 2420,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4910/19234910/exterior_front_driver-1768661352384.jpg',
'Width': 3227},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a68b2d7-e877-5bc2-811b-5e1e6f592211/8a68b2d7-e877-5bc2-811b-5e1e6f592211_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 829313,
'Height': 1940,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4910/19234910/exterior_rear_driver-1768661407801.jpg',
'Width': 2586},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a68b2d7-e877-5bc2-811b-5e1e6f592211/8a68b2d7-e877-5bc2-811b-5e1e6f592211_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1256199,
'Height': 2506,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4910/19234910/exterior_front_passenger-1768661498927.jpg',
'Width': 3341},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a68b2d7-e877-5bc2-811b-5e1e6f592211/8a68b2d7-e877-5bc2-811b-5e1e6f592211_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1306637,
'Height': 2761,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4910/19234910/exterior_rear_passenger-1768661404787.jpg',
'Width': 3681},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a68b2d7-e877-5bc2-811b-5e1e6f592211/8a68b2d7-e877-5bc2-811b-5e1e6f592211_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2819470,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4910/19234910/interior_front_seats-1773486039856.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a68b2d7-e877-5bc2-811b-5e1e6f592211/8a68b2d7-e877-5bc2-811b-5e1e6f592211_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2334871,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4910/19234910/interior_rear_seats-1773486060974.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a68b2d7-e877-5bc2-811b-5e1e6f592211/8a68b2d7-e877-5bc2-811b-5e1e6f592211_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1661859,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4910/19234910/interior_dashboard-1773486136681.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a68b2d7-e877-5bc2-811b-5e1e6f592211/8a68b2d7-e877-5bc2-811b-5e1e6f592211_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2219381,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/4910/19234910/instrument_cluster-1773486126755.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a68b2d7-e877-5bc2-811b-5e1e6f592211/8a68b2d7-e877-5bc2-811b-5e1e6f592211_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3323848,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/4910/19234910/interior_boot-1773486175458.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a68b2d7-e877-5bc2-811b-5e1e6f592211/8a68b2d7-e877-5bc2-811b-5e1e6f592211_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4352722,
'Height': 4032,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/4910/19234910/docs_service_history-1774786072398.jpg?ixlib=js-3.8.0&auto=format&s=9812a99329193e92bbcf84fea8a73f74',
'Width': 2268}],
'price': 7820,
'price_includes_vat': False,
'registration_date': '2016-03-03',
'seats_number': None,
'seller_name': None,
'title': 'MINI Clubman Cooper S Auto',
'transmission': 'manual',
'trim': 'Cooper S Auto',
'vin': 'WMWLN720102D35065',
'year': 2016}
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719234910%27 HTTP/1.1" 200 None
2026-03-29 20:22:00 [motorway.uk] INFO: Saving data for 19234910: {'created_time': 1774815720.033321, 'last_price_update_time': 1774815720.033336, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19234910') HTTP/1.1" 204 0
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658315d10>
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_862e78a3-314f-5f6d-8685-bb1f8d09bf36/862e78a3-314f-5f6d-8685-bb1f8d09bf36_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1280%252F14381280%252Fexterior_front_driver-1770897650502.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1280/14381280/exterior_front_driver-1770897650502.jpg saved to cache
2026-03-29 20:22:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 862e78a3-314f-5f6d-8685-bb1f8d09bf36
2026-03-29 20:22:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1280/14381280/exterior_rear_driver-1770828432449.jpg> (referer: None)
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bda5dd0>
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_862e78a3-314f-5f6d-8685-bb1f8d09bf36/862e78a3-314f-5f6d-8685-bb1f8d09bf36_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1280%252F14381280%252Fexterior_rear_driver-1770828432449.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1280/14381280/exterior_rear_driver-1770828432449.jpg saved to cache
2026-03-29 20:22:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 862e78a3-314f-5f6d-8685-bb1f8d09bf36
2026-03-29 20:22:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 862e78a3-314f-5f6d-8685-bb1f8d09bf36, skipping ID generation
2026-03-29 20:22:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 862e78a3-314f-5f6d-8685-bb1f8d09bf36 with scrape type 1
2026-03-29 20:22:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 862e78a3-314f-5f6d-8685-bb1f8d09bf36 sending to next pipeline
2026-03-29 20:22:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 862e78a3-314f-5f6d-8685-bb1f8d09bf36, identifier: 14381280
2026-03-29 20:22:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 862e78a3-314f-5f6d-8685-bb1f8d09bf36 with identifier: 14381280
2026-03-29 20:22:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 862e78a3-314f-5f6d-8685-bb1f8d09bf36 with identifier: 14381280
2026-03-29 20:22:00 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 862e78a3-314f-5f6d-8685-bb1f8d09bf36 with identifier: 14381280 to the API
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1280/14381280/exterior_rear_driver-1770828432449.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.3L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '862e78a3-314f-5f6d-8685-bb1f8d09bf36',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AF11 GCV',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/14381280',
'listing': 'auction',
'location': 'Cambridgeshire Cambridge',
'make': 'Honda',
'model': 'Jazz',
'odometer': 64800,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_862e78a3-314f-5f6d-8685-bb1f8d09bf36/862e78a3-314f-5f6d-8685-bb1f8d09bf36_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1106518,
'Height': 1999,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1280/14381280/exterior_front_driver-1770897650502.jpg',
'Width': 2665},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_862e78a3-314f-5f6d-8685-bb1f8d09bf36/862e78a3-314f-5f6d-8685-bb1f8d09bf36_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1312445,
'Height': 2265,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1280/14381280/exterior_rear_driver-1770828432449.jpg',
'Width': 3020},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_862e78a3-314f-5f6d-8685-bb1f8d09bf36/862e78a3-314f-5f6d-8685-bb1f8d09bf36_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1053966,
'Height': 2033,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1280/14381280/exterior_front_passenger-1770897657476.jpg',
'Width': 2711},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_862e78a3-314f-5f6d-8685-bb1f8d09bf36/862e78a3-314f-5f6d-8685-bb1f8d09bf36_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1031122,
'Height': 2051,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1280/14381280/exterior_rear_passenger-1770828436282.jpg',
'Width': 2734},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_862e78a3-314f-5f6d-8685-bb1f8d09bf36/862e78a3-314f-5f6d-8685-bb1f8d09bf36_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6634583,
'Height': 3048,
'OriginUrl': 'https://motorway-photos.imgix.net/1280/14381280/interior_front_seats-1770897952741.jpg',
'Width': 4064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_862e78a3-314f-5f6d-8685-bb1f8d09bf36/862e78a3-314f-5f6d-8685-bb1f8d09bf36_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 6842849,
'Height': 3048,
'OriginUrl': 'https://motorway-photos.imgix.net/1280/14381280/interior_rear_seats-1770828449008.jpg',
'Width': 4064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_862e78a3-314f-5f6d-8685-bb1f8d09bf36/862e78a3-314f-5f6d-8685-bb1f8d09bf36_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 818970,
'Height': 2225,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1280/14381280/interior_dashboard-1774625272119.jpg',
'Width': 2967},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_862e78a3-314f-5f6d-8685-bb1f8d09bf36/862e78a3-314f-5f6d-8685-bb1f8d09bf36_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5053834,
'Height': 3048,
'OriginUrl': 'https://motorway-photos.imgix.net/1280/14381280/instrument_cluster-1770828442813.jpg',
'Width': 4064},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_862e78a3-314f-5f6d-8685-bb1f8d09bf36/862e78a3-314f-5f6d-8685-bb1f8d09bf36_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387118,
'Height': 1315,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1280/14381280/interior_boot-1774625285042.jpg',
'Width': 1753},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_862e78a3-314f-5f6d-8685-bb1f8d09bf36/862e78a3-314f-5f6d-8685-bb1f8d09bf36_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 455633,
'Height': 2048,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/1280/14381280/docs_service_history-1770900999821.jpg?ixlib=js-3.8.0&auto=format&s=8868cf186ba50394ffd6f7204a1eb90e',
'Width': 1536}],
'price': 4288,
'price_includes_vat': False,
'registration_date': '2011-03-01',
'seats_number': None,
'seller_name': None,
'title': 'Honda Jazz I-VTEC ES CVT',
'transmission': 'automatic',
'trim': 'I-VTEC ES CVT',
'vin': 'SHHGG6860CU002039',
'year': 2011}
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714381280%27 HTTP/1.1" 200 None
2026-03-29 20:22:01 [motorway.uk] INFO: Saving data for 14381280: {'created_time': 1774815721.066371, 'last_price_update_time': 1774815721.066386, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='14381280') HTTP/1.1" 204 0
2026-03-29 20:22:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16283042.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e062e35-202d-52ce-a4c2-abc2d860d39e with identifier: 16283042
2026-03-29 20:22:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e062e35-202d-52ce-a4c2-abc2d860d39e with scrape type 1
2026-03-29 20:22:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6e062e35-202d-52ce-a4c2-abc2d860d39e
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3042%252F16283042%252Fexterior_front_driver-1774699252376.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3042/16283042/exterior_front_driver-1774699252376.jpg not downloaded yet
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3042%252F16283042%252Fexterior_rear_driver-1774699270087.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3042/16283042/exterior_rear_driver-1774699270087.jpg not downloaded yet
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3042%252F16283042%252Fexterior_front_passenger-1774699298508.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3042/16283042/exterior_front_passenger-1774699298508.jpg not downloaded yet
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3042%252F16283042%252Fexterior_rear_passenger-1774699281664.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3042/16283042/exterior_rear_passenger-1774699281664.jpg not downloaded yet
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3042%252F16283042%252Finterior_front_seats-1774699872130.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3042/16283042/interior_front_seats-1774699872130.jpg not downloaded yet
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3042%252F16283042%252Finterior_rear_seats-1774699884943.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3042/16283042/interior_rear_seats-1774699884943.jpg not downloaded yet
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3042%252F16283042%252Finterior_dashboard-1774699917820.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3042/16283042/interior_dashboard-1774699917820.jpg not downloaded yet
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F3042%252F16283042%252Finterior_boot-1774699931208.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3042/16283042/interior_boot-1774699931208.jpg not downloaded yet
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3042%252F16283042%252Fdocs_service_history-1774700374545.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De7756f1478eff33d43e0ee0a5ae9b29b%27 HTTP/1.1" 200 None
2026-03-29 20:22:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3042/16283042/docs_service_history-1774700374545.jpg?ixlib=js-3.8.0&auto=format&s=e7756f1478eff33d43e0ee0a5ae9b29b not downloaded yet
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3042%252F16283042%252Fdocs_service_history-1774700381167.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df681ec3c3b1ab07e6fd124e0759d5333%27 HTTP/1.1" 200 None
2026-03-29 20:22:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3042/16283042/docs_service_history-1774700381167.jpg?ixlib=js-3.8.0&auto=format&s=f681ec3c3b1ab07e6fd124e0759d5333 not downloaded yet
2026-03-29 20:22:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/12337686.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79be7a3a-cbdc-5a2f-880a-209820d747fc with identifier: 12337686
2026-03-29 20:22:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79be7a3a-cbdc-5a2f-880a-209820d747fc with scrape type 1
2026-03-29 20:22:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 79be7a3a-cbdc-5a2f-880a-209820d747fc
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7686%252F12337686%252Fexterior_front_driver-1774374574565.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:22:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7686/12337686/exterior_front_driver-1774374574565.jpeg not downloaded yet
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7686%252F12337686%252Fexterior_rear_driver-1774374615065.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:22:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7686/12337686/exterior_rear_driver-1774374615065.jpeg not downloaded yet
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7686%252F12337686%252Fexterior_front_passenger-1774374588880.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:22:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7686/12337686/exterior_front_passenger-1774374588880.jpeg not downloaded yet
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7686%252F12337686%252Fexterior_rear_passenger-1774374607922.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:22:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7686/12337686/exterior_rear_passenger-1774374607922.jpeg not downloaded yet
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7686%252F12337686%252F12337686-interior_front_seats-modified-1774542819272.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:22:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7686/12337686/12337686-interior_front_seats-modified-1774542819272.jpeg not downloaded yet
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7686%252F12337686%252Finterior_rear_seats-1774374655756.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:22:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7686/12337686/interior_rear_seats-1774374655756.jpeg not downloaded yet
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7686%252F12337686%252F12337686-interior_dashboard-modified-1774542836437.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:22:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7686/12337686/12337686-interior_dashboard-modified-1774542836437.jpeg not downloaded yet
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7686%252F12337686%252F12337686-instrument_cluster-modified-1774542953552.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:22:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7686/12337686/12337686-instrument_cluster-modified-1774542953552.jpeg not downloaded yet
2026-03-29 20:22:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3042/16283042/docs_service_history-1774700381167.jpg?ixlib=js-3.8.0&auto=format&s=f681ec3c3b1ab07e6fd124e0759d5333> (referer: None)
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7686%252F12337686%252Finterior_boot-1774374678259.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:22:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7686/12337686/interior_boot-1774374678259.jpeg not downloaded yet
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7686%252F12337686%252F12337686-docs_service_history-modified-1774542742635.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D32e33cc575c23e2faf03da719b0ccac7%27 HTTP/1.1" 200 None
2026-03-29 20:22:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7686/12337686/12337686-docs_service_history-modified-1774542742635.jpeg?ixlib=js-3.8.0&auto=format&s=32e33cc575c23e2faf03da719b0ccac7 not downloaded yet
2026-03-29 20:22:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65871a650>
2026-03-29 20:22:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e062e35-202d-52ce-a4c2-abc2d860d39e/6e062e35-202d-52ce-a4c2-abc2d860d39e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3042%252F16283042%252Fdocs_service_history-1774700381167.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Df681ec3c3b1ab07e6fd124e0759d5333') HTTP/1.1" 204 0
2026-03-29 20:22:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3042/16283042/docs_service_history-1774700381167.jpg?ixlib=js-3.8.0&auto=format&s=f681ec3c3b1ab07e6fd124e0759d5333 saved to cache
2026-03-29 20:22:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6e062e35-202d-52ce-a4c2-abc2d860d39e
2026-03-29 20:22:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7686/12337686/12337686-instrument_cluster-modified-1774542953552.jpeg> (referer: None)
2026-03-29 20:22:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658132a50>
2026-03-29 20:22:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79be7a3a-cbdc-5a2f-880a-209820d747fc/79be7a3a-cbdc-5a2f-880a-209820d747fc_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7686%252F12337686%252F12337686-instrument_cluster-modified-1774542953552.jpeg') HTTP/1.1" 204 0
2026-03-29 20:22:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7686/12337686/12337686-instrument_cluster-modified-1774542953552.jpeg saved to cache
2026-03-29 20:22:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 79be7a3a-cbdc-5a2f-880a-209820d747fc
2026-03-29 20:22:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/7686/12337686/12337686-docs_service_history-modified-1774542742635.jpeg?ixlib=js-3.8.0&auto=format&s=32e33cc575c23e2faf03da719b0ccac7> (referer: None)
2026-03-29 20:22:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582c7510>
2026-03-29 20:22:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79be7a3a-cbdc-5a2f-880a-209820d747fc/79be7a3a-cbdc-5a2f-880a-209820d747fc_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7686%252F12337686%252F12337686-docs_service_history-modified-1774542742635.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D32e33cc575c23e2faf03da719b0ccac7') HTTP/1.1" 204 0
2026-03-29 20:22:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7686/12337686/12337686-docs_service_history-modified-1774542742635.jpeg?ixlib=js-3.8.0&auto=format&s=32e33cc575c23e2faf03da719b0ccac7 saved to cache
2026-03-29 20:22:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 79be7a3a-cbdc-5a2f-880a-209820d747fc
2026-03-29 20:22:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7686/12337686/interior_boot-1774374678259.jpeg> (referer: None)
2026-03-29 20:22:05 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 146 - value: b'Apple\x00'
2026-03-29 20:22:05 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'iPhone 13 Pro Max\x00'
2026-03-29 20:22:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 58 - Data Location: 170 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 70 - Data Location: 178 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:05 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 94 - Data Location: 186 - value: b'26.3.1\x00'
2026-03-29 20:22:05 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 106 - Data Location: 194 - value: b'2026:03:24 17:51:16\x00'
2026-03-29 20:22:05 [PIL.TiffImagePlugin] DEBUG: tag: HostComputer (316) - type: string (2) Tag Location: 118 - Data Location: 214 - value: b'iPhone 13 Pro Max\x00'
2026-03-29 20:22:05 [PIL.TiffImagePlugin] DEBUG: tag: YCbCrPositioning (531) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\xe8'
2026-03-29 20:22:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658719b50>
2026-03-29 20:22:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79be7a3a-cbdc-5a2f-880a-209820d747fc/79be7a3a-cbdc-5a2f-880a-209820d747fc_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7686%252F12337686%252Finterior_boot-1774374678259.jpeg') HTTP/1.1" 204 0
2026-03-29 20:22:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7686/12337686/interior_boot-1774374678259.jpeg saved to cache
2026-03-29 20:22:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 79be7a3a-cbdc-5a2f-880a-209820d747fc
2026-03-29 20:22:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7686/12337686/12337686-interior_dashboard-modified-1774542836437.jpeg> (referer: None)
2026-03-29 20:22:05 [scrapy.extensions.logstats] INFO: Crawled 379 pages (at 14 pages/min), scraped 224 items (at 13 items/min)
2026-03-29 20:22:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 304MiB
2026-03-29 20:22:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c5e1d0>
2026-03-29 20:22:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79be7a3a-cbdc-5a2f-880a-209820d747fc/79be7a3a-cbdc-5a2f-880a-209820d747fc_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7686%252F12337686%252F12337686-interior_dashboard-modified-1774542836437.jpeg') HTTP/1.1" 204 0
2026-03-29 20:22:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7686/12337686/12337686-interior_dashboard-modified-1774542836437.jpeg saved to cache
2026-03-29 20:22:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 79be7a3a-cbdc-5a2f-880a-209820d747fc
2026-03-29 20:22:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7686/12337686/interior_rear_seats-1774374655756.jpeg> (referer: None)
2026-03-29 20:22:06 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-03-29 20:22:06 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-03-29 20:22:06 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00%\xc0]\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x01\x02\x97\x00%\xb6M\x00\x00\x00\x00'
2026-03-29 20:22:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65871a410>
2026-03-29 20:22:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79be7a3a-cbdc-5a2f-880a-209820d747fc/79be7a3a-cbdc-5a2f-880a-209820d747fc_image_5.mpo HTTP/1.1" 201 0
2026-03-29 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7686%252F12337686%252Finterior_rear_seats-1774374655756.jpeg') HTTP/1.1" 204 0
2026-03-29 20:22:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7686/12337686/interior_rear_seats-1774374655756.jpeg saved to cache
2026-03-29 20:22:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 79be7a3a-cbdc-5a2f-880a-209820d747fc
2026-03-29 20:22:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7686/12337686/12337686-interior_front_seats-modified-1774542819272.jpeg> (referer: None)
2026-03-29 20:22:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587a2850>
2026-03-29 20:22:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79be7a3a-cbdc-5a2f-880a-209820d747fc/79be7a3a-cbdc-5a2f-880a-209820d747fc_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7686%252F12337686%252F12337686-interior_front_seats-modified-1774542819272.jpeg') HTTP/1.1" 204 0
2026-03-29 20:22:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7686/12337686/12337686-interior_front_seats-modified-1774542819272.jpeg saved to cache
2026-03-29 20:22:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 79be7a3a-cbdc-5a2f-880a-209820d747fc
2026-03-29 20:22:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7686/12337686/exterior_rear_passenger-1774374607922.jpeg> (referer: None)
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64b9496d0>
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79be7a3a-cbdc-5a2f-880a-209820d747fc/79be7a3a-cbdc-5a2f-880a-209820d747fc_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7686%252F12337686%252Fexterior_rear_passenger-1774374607922.jpeg') HTTP/1.1" 204 0
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7686/12337686/exterior_rear_passenger-1774374607922.jpeg saved to cache
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 79be7a3a-cbdc-5a2f-880a-209820d747fc
2026-03-29 20:22:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7686/12337686/exterior_front_passenger-1774374588880.jpeg> (referer: None)
2026-03-29 20:22:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19358892.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65871a450>
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79be7a3a-cbdc-5a2f-880a-209820d747fc/79be7a3a-cbdc-5a2f-880a-209820d747fc_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7686%252F12337686%252Fexterior_front_passenger-1774374588880.jpeg') HTTP/1.1" 204 0
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7686/12337686/exterior_front_passenger-1774374588880.jpeg saved to cache
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 79be7a3a-cbdc-5a2f-880a-209820d747fc
2026-03-29 20:22:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20286408.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4288c28-cb59-5d6b-b775-d136d0106b8f with identifier: 19358892
2026-03-29 20:22:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4288c28-cb59-5d6b-b775-d136d0106b8f with scrape type 1
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a4288c28-cb59-5d6b-b775-d136d0106b8f
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8892%252F19358892%252Fexterior_front_driver-1774538493250.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8892/19358892/exterior_front_driver-1774538493250.jpg not downloaded yet
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8892%252F19358892%252Fexterior_rear_driver-1774538486590.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8892/19358892/exterior_rear_driver-1774538486590.jpg not downloaded yet
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8892%252F19358892%252Fexterior_front_passenger-1774538472934.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8892/19358892/exterior_front_passenger-1774538472934.jpg not downloaded yet
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8892%252F19358892%252Fexterior_rear_passenger-1774538478129.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8892/19358892/exterior_rear_passenger-1774538478129.jpg not downloaded yet
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8892%252F19358892%252Finterior_front_seats-1774537032269.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8892/19358892/interior_front_seats-1774537032269.jpg not downloaded yet
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8892%252F19358892%252Finterior_rear_seats-1774536868463.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8892/19358892/interior_rear_seats-1774536868463.jpg not downloaded yet
2026-03-29 20:22:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a89fcfe-e110-5761-b345-c56e7bf2dbc2 with identifier: 20286408
2026-03-29 20:22:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a89fcfe-e110-5761-b345-c56e7bf2dbc2 with scrape type 1
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a89fcfe-e110-5761-b345-c56e7bf2dbc2
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6408%252F20286408%252Fexterior_front_driver-1774774690479.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6408/20286408/exterior_front_driver-1774774690479.jpg not downloaded yet
2026-03-29 20:22:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7686/12337686/exterior_front_driver-1774374574565.jpeg> (referer: None)
2026-03-29 20:22:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7686/12337686/exterior_rear_driver-1774374615065.jpeg> (referer: None)
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8892%252F19358892%252Finterior_dashboard-1774538505230.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8892/19358892/interior_dashboard-1774538505230.jpg not downloaded yet
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6408%252F20286408%252Fexterior_rear_driver-1774774899336.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6408/20286408/exterior_rear_driver-1774774899336.jpg not downloaded yet
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8892%252F19358892%252Finterior_boot-1774536979310.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8892/19358892/interior_boot-1774536979310.jpg not downloaded yet
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6408%252F20286408%252Fexterior_front_passenger-1774774933010.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6408/20286408/exterior_front_passenger-1774774933010.jpg not downloaded yet
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8892%252F19358892%252Fdocs_service_history-1774691635376.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da83248a8fb6a26a393946b271f4fbbbb%27 HTTP/1.1" 200 None
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8892/19358892/docs_service_history-1774691635376.jpg?ixlib=js-3.8.0&auto=format&s=a83248a8fb6a26a393946b271f4fbbbb not downloaded yet
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6408%252F20286408%252Fexterior_rear_passenger-1774774913991.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6408/20286408/exterior_rear_passenger-1774774913991.jpg not downloaded yet
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8892%252F19358892%252Fdocs_service_history-1774537225110.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D066b55cb1100a08c059def6ce1fc5862%27 HTTP/1.1" 200 None
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8892/19358892/docs_service_history-1774537225110.jpg?ixlib=js-3.8.0&auto=format&s=066b55cb1100a08c059def6ce1fc5862 not downloaded yet
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6408%252F20286408%252Finterior_front_seats-1774775319746.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6408/20286408/interior_front_seats-1774775319746.jpg not downloaded yet
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b2c910>
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79be7a3a-cbdc-5a2f-880a-209820d747fc/79be7a3a-cbdc-5a2f-880a-209820d747fc_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7686%252F12337686%252Fexterior_front_driver-1774374574565.jpeg') HTTP/1.1" 204 0
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7686/12337686/exterior_front_driver-1774374574565.jpeg saved to cache
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79be7a3a-cbdc-5a2f-880a-209820d747fc
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b2e350>
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79be7a3a-cbdc-5a2f-880a-209820d747fc/79be7a3a-cbdc-5a2f-880a-209820d747fc_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7686%252F12337686%252Fexterior_rear_driver-1774374615065.jpeg') HTTP/1.1" 204 0
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7686/12337686/exterior_rear_driver-1774374615065.jpeg saved to cache
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 79be7a3a-cbdc-5a2f-880a-209820d747fc
2026-03-29 20:22:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79be7a3a-cbdc-5a2f-880a-209820d747fc, skipping ID generation
2026-03-29 20:22:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79be7a3a-cbdc-5a2f-880a-209820d747fc with scrape type 1
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79be7a3a-cbdc-5a2f-880a-209820d747fc sending to next pipeline
2026-03-29 20:22:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 79be7a3a-cbdc-5a2f-880a-209820d747fc, identifier: 12337686
2026-03-29 20:22:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/3042/16283042/docs_service_history-1774700374545.jpg?ixlib=js-3.8.0&auto=format&s=e7756f1478eff33d43e0ee0a5ae9b29b> (referer: None)
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6408%252F20286408%252Finterior_rear_seats-1774775346167.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6408/20286408/interior_rear_seats-1774775346167.jpg not downloaded yet
2026-03-29 20:22:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 79be7a3a-cbdc-5a2f-880a-209820d747fc with identifier: 12337686
2026-03-29 20:22:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 79be7a3a-cbdc-5a2f-880a-209820d747fc with identifier: 12337686
2026-03-29 20:22:08 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 79be7a3a-cbdc-5a2f-880a-209820d747fc with identifier: 12337686 to the API
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7686/12337686/exterior_rear_driver-1774374615065.jpeg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.1L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '79be7a3a-cbdc-5a2f-880a-209820d747fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'BP16 FZU',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/12337686',
'listing': 'auction',
'location': 'Merseyside Prenton',
'make': 'Renault',
'model': 'Clio',
'odometer': 63763,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 28,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79be7a3a-cbdc-5a2f-880a-209820d747fc/79be7a3a-cbdc-5a2f-880a-209820d747fc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1074891,
'Height': 2397,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7686/12337686/exterior_front_driver-1774374574565.jpeg',
'Width': 3196},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79be7a3a-cbdc-5a2f-880a-209820d747fc/79be7a3a-cbdc-5a2f-880a-209820d747fc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 688228,
'Height': 2008,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7686/12337686/exterior_rear_driver-1774374615065.jpeg',
'Width': 2677},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79be7a3a-cbdc-5a2f-880a-209820d747fc/79be7a3a-cbdc-5a2f-880a-209820d747fc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1178587,
'Height': 2446,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7686/12337686/exterior_front_passenger-1774374588880.jpeg',
'Width': 3261},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79be7a3a-cbdc-5a2f-880a-209820d747fc/79be7a3a-cbdc-5a2f-880a-209820d747fc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 989010,
'Height': 2165,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7686/12337686/exterior_rear_passenger-1774374607922.jpeg',
'Width': 2887},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79be7a3a-cbdc-5a2f-880a-209820d747fc/79be7a3a-cbdc-5a2f-880a-209820d747fc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3160946,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7686/12337686/12337686-interior_front_seats-modified-1774542819272.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79be7a3a-cbdc-5a2f-880a-209820d747fc/79be7a3a-cbdc-5a2f-880a-209820d747fc_image_5.mpo',
'Extension': 'mpo',
'FileSizeInBytes': 2540276,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7686/12337686/interior_rear_seats-1774374655756.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79be7a3a-cbdc-5a2f-880a-209820d747fc/79be7a3a-cbdc-5a2f-880a-209820d747fc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2276126,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7686/12337686/12337686-interior_dashboard-modified-1774542836437.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79be7a3a-cbdc-5a2f-880a-209820d747fc/79be7a3a-cbdc-5a2f-880a-209820d747fc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1582998,
'Height': 2375,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7686/12337686/12337686-instrument_cluster-modified-1774542953552.jpeg',
'Width': 3167},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79be7a3a-cbdc-5a2f-880a-209820d747fc/79be7a3a-cbdc-5a2f-880a-209820d747fc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2302017,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7686/12337686/interior_boot-1774374678259.jpeg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79be7a3a-cbdc-5a2f-880a-209820d747fc/79be7a3a-cbdc-5a2f-880a-209820d747fc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88408,
'Height': 909,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/7686/12337686/12337686-docs_service_history-modified-1774542742635.jpeg?ixlib=js-3.8.0&auto=format&s=32e33cc575c23e2faf03da719b0ccac7',
'Width': 1212}],
'price': 3313,
'price_includes_vat': False,
'registration_date': '2016-05-31',
'seats_number': None,
'seller_name': None,
'title': 'Renault Clio Dynamique NAV 16V',
'transmission': 'manual',
'trim': 'Dynamique NAV 16V',
'vin': 'VF15RSN0A55456530',
'year': 2016}
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712337686%27 HTTP/1.1" 200 None
2026-03-29 20:22:08 [motorway.uk] INFO: Saving data for 12337686: {'created_time': 1774815728.871397, 'last_price_update_time': 1774815728.871408, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='12337686') HTTP/1.1" 204 0
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6408%252F20286408%252Finterior_dashboard-1774776847114.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6408/20286408/interior_dashboard-1774776847114.jpg not downloaded yet
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6408%252F20286408%252Finstrument_cluster-1774775425453.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6408/20286408/instrument_cluster-1774775425453.jpg not downloaded yet
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bc97d0>
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e062e35-202d-52ce-a4c2-abc2d860d39e/6e062e35-202d-52ce-a4c2-abc2d860d39e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F3042%252F16283042%252Fdocs_service_history-1774700374545.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De7756f1478eff33d43e0ee0a5ae9b29b') HTTP/1.1" 204 0
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/3042/16283042/docs_service_history-1774700374545.jpg?ixlib=js-3.8.0&auto=format&s=e7756f1478eff33d43e0ee0a5ae9b29b saved to cache
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6e062e35-202d-52ce-a4c2-abc2d860d39e
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6408%252F20286408%252Finterior_boot-1774775393205.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6408/20286408/interior_boot-1774775393205.jpg not downloaded yet
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6408%252F20286408%252Fdamage_scratches-1774775004243.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6408/20286408/damage_scratches-1774775004243.jpg not downloaded yet
2026-03-29 20:22:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6408/20286408/exterior_front_driver-1774774690479.jpg> (referer: None)
2026-03-29 20:22:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8892/19358892/interior_rear_seats-1774536868463.jpg> (referer: None)
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bc8b90>
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a89fcfe-e110-5761-b345-c56e7bf2dbc2/9a89fcfe-e110-5761-b345-c56e7bf2dbc2_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6408%252F20286408%252Fexterior_front_driver-1774774690479.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6408/20286408/exterior_front_driver-1774774690479.jpg saved to cache
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a89fcfe-e110-5761-b345-c56e7bf2dbc2
2026-03-29 20:22:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e289d0>
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4288c28-cb59-5d6b-b775-d136d0106b8f/a4288c28-cb59-5d6b-b775-d136d0106b8f_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8892%252F19358892%252Finterior_rear_seats-1774536868463.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8892/19358892/interior_rear_seats-1774536868463.jpg saved to cache
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a4288c28-cb59-5d6b-b775-d136d0106b8f
2026-03-29 20:22:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6408/20286408/interior_front_seats-1774775319746.jpg> (referer: None)
2026-03-29 20:22:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6408/20286408/interior_boot-1774775393205.jpg> (referer: None)
2026-03-29 20:22:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf31250>
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a89fcfe-e110-5761-b345-c56e7bf2dbc2/9a89fcfe-e110-5761-b345-c56e7bf2dbc2_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6408%252F20286408%252Finterior_front_seats-1774775319746.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6408/20286408/interior_front_seats-1774775319746.jpg saved to cache
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9a89fcfe-e110-5761-b345-c56e7bf2dbc2
2026-03-29 20:22:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658475e10>
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a89fcfe-e110-5761-b345-c56e7bf2dbc2/9a89fcfe-e110-5761-b345-c56e7bf2dbc2_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6408%252F20286408%252Finterior_boot-1774775393205.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6408/20286408/interior_boot-1774775393205.jpg saved to cache
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9a89fcfe-e110-5761-b345-c56e7bf2dbc2
2026-03-29 20:22:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6408/20286408/damage_scratches-1774775004243.jpg> (referer: None)
2026-03-29 20:22:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d15e10>
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a89fcfe-e110-5761-b345-c56e7bf2dbc2/9a89fcfe-e110-5761-b345-c56e7bf2dbc2_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6408%252F20286408%252Fdamage_scratches-1774775004243.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6408/20286408/damage_scratches-1774775004243.jpg saved to cache
2026-03-29 20:22:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9a89fcfe-e110-5761-b345-c56e7bf2dbc2
2026-03-29 20:22:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6408/20286408/instrument_cluster-1774775425453.jpg> (referer: None)
2026-03-29 20:22:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6408/20286408/interior_dashboard-1774776847114.jpg> (referer: None)
2026-03-29 20:22:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf318d0>
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a89fcfe-e110-5761-b345-c56e7bf2dbc2/9a89fcfe-e110-5761-b345-c56e7bf2dbc2_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6408%252F20286408%252Finstrument_cluster-1774775425453.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6408/20286408/instrument_cluster-1774775425453.jpg saved to cache
2026-03-29 20:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9a89fcfe-e110-5761-b345-c56e7bf2dbc2
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf33c90>
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a89fcfe-e110-5761-b345-c56e7bf2dbc2/9a89fcfe-e110-5761-b345-c56e7bf2dbc2_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6408%252F20286408%252Finterior_dashboard-1774776847114.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6408/20286408/interior_dashboard-1774776847114.jpg saved to cache
2026-03-29 20:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9a89fcfe-e110-5761-b345-c56e7bf2dbc2
2026-03-29 20:22:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6408/20286408/interior_rear_seats-1774775346167.jpg> (referer: None)
2026-03-29 20:22:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8892/19358892/docs_service_history-1774537225110.jpg?ixlib=js-3.8.0&auto=format&s=066b55cb1100a08c059def6ce1fc5862> (referer: None)
2026-03-29 20:22:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6408/20286408/exterior_rear_passenger-1774774913991.jpg> (referer: None)
2026-03-29 20:22:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d15810>
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a89fcfe-e110-5761-b345-c56e7bf2dbc2/9a89fcfe-e110-5761-b345-c56e7bf2dbc2_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6408%252F20286408%252Finterior_rear_seats-1774775346167.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6408/20286408/interior_rear_seats-1774775346167.jpg saved to cache
2026-03-29 20:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9a89fcfe-e110-5761-b345-c56e7bf2dbc2
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586f0fd0>
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4288c28-cb59-5d6b-b775-d136d0106b8f/a4288c28-cb59-5d6b-b775-d136d0106b8f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8892%252F19358892%252Fdocs_service_history-1774537225110.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D066b55cb1100a08c059def6ce1fc5862') HTTP/1.1" 204 0
2026-03-29 20:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8892/19358892/docs_service_history-1774537225110.jpg?ixlib=js-3.8.0&auto=format&s=066b55cb1100a08c059def6ce1fc5862 saved to cache
2026-03-29 20:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a4288c28-cb59-5d6b-b775-d136d0106b8f
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a26710>
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a89fcfe-e110-5761-b345-c56e7bf2dbc2/9a89fcfe-e110-5761-b345-c56e7bf2dbc2_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6408%252F20286408%252Fexterior_rear_passenger-1774774913991.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6408/20286408/exterior_rear_passenger-1774774913991.jpg saved to cache
2026-03-29 20:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9a89fcfe-e110-5761-b345-c56e7bf2dbc2
2026-03-29 20:22:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/8892/19358892/docs_service_history-1774691635376.jpg?ixlib=js-3.8.0&auto=format&s=a83248a8fb6a26a393946b271f4fbbbb> (referer: None)
2026-03-29 20:22:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6408/20286408/exterior_front_passenger-1774774933010.jpg> (referer: None)
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf4d750>
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4288c28-cb59-5d6b-b775-d136d0106b8f/a4288c28-cb59-5d6b-b775-d136d0106b8f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F8892%252F19358892%252Fdocs_service_history-1774691635376.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da83248a8fb6a26a393946b271f4fbbbb') HTTP/1.1" 204 0
2026-03-29 20:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/8892/19358892/docs_service_history-1774691635376.jpg?ixlib=js-3.8.0&auto=format&s=a83248a8fb6a26a393946b271f4fbbbb saved to cache
2026-03-29 20:22:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a4288c28-cb59-5d6b-b775-d136d0106b8f
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf30c10>
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a89fcfe-e110-5761-b345-c56e7bf2dbc2/9a89fcfe-e110-5761-b345-c56e7bf2dbc2_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6408%252F20286408%252Fexterior_front_passenger-1774774933010.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6408/20286408/exterior_front_passenger-1774774933010.jpg saved to cache
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9a89fcfe-e110-5761-b345-c56e7bf2dbc2
2026-03-29 20:22:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8892/19358892/interior_dashboard-1774538505230.jpg> (referer: None)
2026-03-29 20:22:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6408/20286408/exterior_rear_driver-1774774899336.jpg> (referer: None)
2026-03-29 20:22:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8892/19358892/interior_boot-1774536979310.jpg> (referer: None)
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cf8c50>
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4288c28-cb59-5d6b-b775-d136d0106b8f/a4288c28-cb59-5d6b-b775-d136d0106b8f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8892%252F19358892%252Finterior_dashboard-1774538505230.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8892/19358892/interior_dashboard-1774538505230.jpg saved to cache
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a4288c28-cb59-5d6b-b775-d136d0106b8f
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586f2450>
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a89fcfe-e110-5761-b345-c56e7bf2dbc2/9a89fcfe-e110-5761-b345-c56e7bf2dbc2_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6408%252F20286408%252Fexterior_rear_driver-1774774899336.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6408/20286408/exterior_rear_driver-1774774899336.jpg saved to cache
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9a89fcfe-e110-5761-b345-c56e7bf2dbc2
2026-03-29 20:22:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a89fcfe-e110-5761-b345-c56e7bf2dbc2, skipping ID generation
2026-03-29 20:22:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a89fcfe-e110-5761-b345-c56e7bf2dbc2 with scrape type 1
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a89fcfe-e110-5761-b345-c56e7bf2dbc2 sending to next pipeline
2026-03-29 20:22:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 9a89fcfe-e110-5761-b345-c56e7bf2dbc2, identifier: 20286408
2026-03-29 20:22:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e2be90>
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4288c28-cb59-5d6b-b775-d136d0106b8f/a4288c28-cb59-5d6b-b775-d136d0106b8f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8892%252F19358892%252Finterior_boot-1774536979310.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8892/19358892/interior_boot-1774536979310.jpg saved to cache
2026-03-29 20:22:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a4288c28-cb59-5d6b-b775-d136d0106b8f
2026-03-29 20:22:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 9a89fcfe-e110-5761-b345-c56e7bf2dbc2 with identifier: 20286408
2026-03-29 20:22:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 9a89fcfe-e110-5761-b345-c56e7bf2dbc2 with identifier: 20286408
2026-03-29 20:22:11 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 9a89fcfe-e110-5761-b345-c56e7bf2dbc2 with identifier: 20286408 to the API
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6408/20286408/exterior_rear_driver-1774774899336.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '9a89fcfe-e110-5761-b345-c56e7bf2dbc2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KT15 MHK',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20286408',
'listing': 'auction',
'location': 'West Sussex Crawley',
'make': 'BMW',
'model': '1 Series',
'odometer': 59673,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a89fcfe-e110-5761-b345-c56e7bf2dbc2/9a89fcfe-e110-5761-b345-c56e7bf2dbc2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1318951,
'Height': 2504,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6408/20286408/exterior_front_driver-1774774690479.jpg',
'Width': 3339},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a89fcfe-e110-5761-b345-c56e7bf2dbc2/9a89fcfe-e110-5761-b345-c56e7bf2dbc2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1648369,
'Height': 2846,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6408/20286408/exterior_rear_driver-1774774899336.jpg',
'Width': 3794},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a89fcfe-e110-5761-b345-c56e7bf2dbc2/9a89fcfe-e110-5761-b345-c56e7bf2dbc2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1178601,
'Height': 2267,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6408/20286408/exterior_front_passenger-1774774933010.jpg',
'Width': 3023},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a89fcfe-e110-5761-b345-c56e7bf2dbc2/9a89fcfe-e110-5761-b345-c56e7bf2dbc2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1538495,
'Height': 2839,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6408/20286408/exterior_rear_passenger-1774774913991.jpg',
'Width': 3785},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a89fcfe-e110-5761-b345-c56e7bf2dbc2/9a89fcfe-e110-5761-b345-c56e7bf2dbc2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3111205,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6408/20286408/interior_front_seats-1774775319746.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a89fcfe-e110-5761-b345-c56e7bf2dbc2/9a89fcfe-e110-5761-b345-c56e7bf2dbc2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2151315,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6408/20286408/interior_rear_seats-1774775346167.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a89fcfe-e110-5761-b345-c56e7bf2dbc2/9a89fcfe-e110-5761-b345-c56e7bf2dbc2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2276864,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6408/20286408/interior_dashboard-1774776847114.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a89fcfe-e110-5761-b345-c56e7bf2dbc2/9a89fcfe-e110-5761-b345-c56e7bf2dbc2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2578806,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6408/20286408/instrument_cluster-1774775425453.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a89fcfe-e110-5761-b345-c56e7bf2dbc2/9a89fcfe-e110-5761-b345-c56e7bf2dbc2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3042489,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6408/20286408/interior_boot-1774775393205.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a89fcfe-e110-5761-b345-c56e7bf2dbc2/9a89fcfe-e110-5761-b345-c56e7bf2dbc2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2210057,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6408/20286408/damage_scratches-1774775004243.jpg',
'Width': 4032}],
'price': 5304,
'price_includes_vat': False,
'registration_date': '2015-05-28',
'seats_number': None,
'seller_name': None,
'title': 'BMW 118I Sport',
'transmission': 'manual',
'trim': '118I Sport',
'vin': 'WBA2R320205A87223',
'year': 2015}
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720286408%27 HTTP/1.1" 200 None
2026-03-29 20:22:12 [motorway.uk] INFO: Saving data for 20286408: {'created_time': 1774815732.111848, 'last_price_update_time': 1774815732.111859, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20286408') HTTP/1.1" 204 0
2026-03-29 20:22:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8892/19358892/exterior_rear_passenger-1774538478129.jpg> (referer: None)
2026-03-29 20:22:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8892/19358892/interior_front_seats-1774537032269.jpg> (referer: None)
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fe1250>
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4288c28-cb59-5d6b-b775-d136d0106b8f/a4288c28-cb59-5d6b-b775-d136d0106b8f_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8892%252F19358892%252Fexterior_rear_passenger-1774538478129.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8892/19358892/exterior_rear_passenger-1774538478129.jpg saved to cache
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a4288c28-cb59-5d6b-b775-d136d0106b8f
2026-03-29 20:22:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20076402.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cf8850>
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4288c28-cb59-5d6b-b775-d136d0106b8f/a4288c28-cb59-5d6b-b775-d136d0106b8f_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8892%252F19358892%252Finterior_front_seats-1774537032269.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8892/19358892/interior_front_seats-1774537032269.jpg saved to cache
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a4288c28-cb59-5d6b-b775-d136d0106b8f
2026-03-29 20:22:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a29f7d3-44bd-5965-8317-ce27ac63882d with identifier: 20076402
2026-03-29 20:22:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a29f7d3-44bd-5965-8317-ce27ac63882d with scrape type 1
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2a29f7d3-44bd-5965-8317-ce27ac63882d
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6402%252F20076402%252Fexterior_front_driver-1773053752178.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6402/20076402/exterior_front_driver-1773053752178.jpg already downloaded
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6402%252F20076402%252Fexterior_rear_driver-1773053756170.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6402/20076402/exterior_rear_driver-1773053756170.jpg already downloaded
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6402%252F20076402%252Fexterior_front_passenger-1773053754509.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6402/20076402/exterior_front_passenger-1773053754509.jpg already downloaded
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6402%252F20076402%252Fexterior_rear_passenger-1773053756879.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6402/20076402/exterior_rear_passenger-1773053756879.jpg already downloaded
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6402%252F20076402%252Finterior_front_seats-1773055013530.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6402/20076402/interior_front_seats-1773055013530.jpg already downloaded
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6402%252F20076402%252Finterior_rear_seats-1773055011697.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6402/20076402/interior_rear_seats-1773055011697.jpg already downloaded
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6402%252F20076402%252Finterior_dashboard-1773055145347.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6402/20076402/interior_dashboard-1773055145347.jpg already downloaded
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6402%252F20076402%252Finterior_boot-1773055014964.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6402/20076402/interior_boot-1773055014964.jpg already downloaded
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6402%252F20076402%252Fdocs_service_history-1774606589694-1.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddac0e5ef61a757ef7b72ebd0a6f66524%27 HTTP/1.1" 200 None
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6402/20076402/docs_service_history-1774606589694-1.jpeg?ixlib=js-3.8.0&auto=format&s=dac0e5ef61a757ef7b72ebd0a6f66524 not downloaded yet
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6402%252F20076402%252Fdocs_service_history-1774606603606-1.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D28899d1cee7e4941b070ecd995659ab8%27 HTTP/1.1" 200 None
2026-03-29 20:22:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6402/20076402/docs_service_history-1774606603606-1.jpeg?ixlib=js-3.8.0&auto=format&s=28899d1cee7e4941b070ecd995659ab8 not downloaded yet
2026-03-29 20:22:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8892/19358892/exterior_front_passenger-1774538472934.jpg> (referer: None)
2026-03-29 20:22:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8892/19358892/exterior_rear_driver-1774538486590.jpg> (referer: None)
2026-03-29 20:22:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6402/20076402/docs_service_history-1774606603606-1.jpeg?ixlib=js-3.8.0&auto=format&s=28899d1cee7e4941b070ecd995659ab8> (referer: None)
2026-03-29 20:22:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/8892/19358892/exterior_front_driver-1774538493250.jpg> (referer: None)
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6589e6590>
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4288c28-cb59-5d6b-b775-d136d0106b8f/a4288c28-cb59-5d6b-b775-d136d0106b8f_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8892%252F19358892%252Fexterior_front_passenger-1774538472934.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8892/19358892/exterior_front_passenger-1774538472934.jpg saved to cache
2026-03-29 20:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a4288c28-cb59-5d6b-b775-d136d0106b8f
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65901d950>
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4288c28-cb59-5d6b-b775-d136d0106b8f/a4288c28-cb59-5d6b-b775-d136d0106b8f_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8892%252F19358892%252Fexterior_rear_driver-1774538486590.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8892/19358892/exterior_rear_driver-1774538486590.jpg saved to cache
2026-03-29 20:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a4288c28-cb59-5d6b-b775-d136d0106b8f
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659af9a50>
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a29f7d3-44bd-5965-8317-ce27ac63882d/2a29f7d3-44bd-5965-8317-ce27ac63882d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6402%252F20076402%252Fdocs_service_history-1774606603606-1.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D28899d1cee7e4941b070ecd995659ab8') HTTP/1.1" 204 0
2026-03-29 20:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6402/20076402/docs_service_history-1774606603606-1.jpeg?ixlib=js-3.8.0&auto=format&s=28899d1cee7e4941b070ecd995659ab8 saved to cache
2026-03-29 20:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2a29f7d3-44bd-5965-8317-ce27ac63882d
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c3a210>
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4288c28-cb59-5d6b-b775-d136d0106b8f/a4288c28-cb59-5d6b-b775-d136d0106b8f_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F8892%252F19358892%252Fexterior_front_driver-1774538493250.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/8892/19358892/exterior_front_driver-1774538493250.jpg saved to cache
2026-03-29 20:22:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a4288c28-cb59-5d6b-b775-d136d0106b8f
2026-03-29 20:22:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a4288c28-cb59-5d6b-b775-d136d0106b8f, skipping ID generation
2026-03-29 20:22:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4288c28-cb59-5d6b-b775-d136d0106b8f with scrape type 1
2026-03-29 20:22:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a4288c28-cb59-5d6b-b775-d136d0106b8f sending to next pipeline
2026-03-29 20:22:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a4288c28-cb59-5d6b-b775-d136d0106b8f, identifier: 19358892
2026-03-29 20:22:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a4288c28-cb59-5d6b-b775-d136d0106b8f with identifier: 19358892
2026-03-29 20:22:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a4288c28-cb59-5d6b-b775-d136d0106b8f with identifier: 19358892
2026-03-29 20:22:13 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a4288c28-cb59-5d6b-b775-d136d0106b8f with identifier: 19358892 to the API
2026-03-29 20:22:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-modified.imgix.net/8892/19358892/exterior_front_driver-1774538493250.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'a4288c28-cb59-5d6b-b775-d136d0106b8f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YM71 AOE',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19358892',
'listing': 'auction',
'location': 'South Yorkshire Rotherham',
'make': 'Nissan',
'model': 'Juke',
'odometer': 58000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4288c28-cb59-5d6b-b775-d136d0106b8f/a4288c28-cb59-5d6b-b775-d136d0106b8f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2964899,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8892/19358892/exterior_front_driver-1774538493250.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4288c28-cb59-5d6b-b775-d136d0106b8f/a4288c28-cb59-5d6b-b775-d136d0106b8f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3342799,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8892/19358892/exterior_rear_driver-1774538486590.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4288c28-cb59-5d6b-b775-d136d0106b8f/a4288c28-cb59-5d6b-b775-d136d0106b8f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2864549,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8892/19358892/exterior_front_passenger-1774538472934.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4288c28-cb59-5d6b-b775-d136d0106b8f/a4288c28-cb59-5d6b-b775-d136d0106b8f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3099229,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8892/19358892/exterior_rear_passenger-1774538478129.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4288c28-cb59-5d6b-b775-d136d0106b8f/a4288c28-cb59-5d6b-b775-d136d0106b8f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3047105,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8892/19358892/interior_front_seats-1774537032269.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4288c28-cb59-5d6b-b775-d136d0106b8f/a4288c28-cb59-5d6b-b775-d136d0106b8f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3145665,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8892/19358892/interior_rear_seats-1774536868463.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4288c28-cb59-5d6b-b775-d136d0106b8f/a4288c28-cb59-5d6b-b775-d136d0106b8f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1526724,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/8892/19358892/interior_dashboard-1774538505230.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4288c28-cb59-5d6b-b775-d136d0106b8f/a4288c28-cb59-5d6b-b775-d136d0106b8f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4021508,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8892/19358892/interior_boot-1774536979310.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4288c28-cb59-5d6b-b775-d136d0106b8f/a4288c28-cb59-5d6b-b775-d136d0106b8f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1378276,
'Height': 2887,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/8892/19358892/docs_service_history-1774691635376.jpg?ixlib=js-3.8.0&auto=format&s=a83248a8fb6a26a393946b271f4fbbbb',
'Width': 3849},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4288c28-cb59-5d6b-b775-d136d0106b8f/a4288c28-cb59-5d6b-b775-d136d0106b8f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 742550,
'Height': 3189,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8892/19358892/docs_service_history-1774537225110.jpg?ixlib=js-3.8.0&auto=format&s=066b55cb1100a08c059def6ce1fc5862',
'Width': 2223}],
'price': 8495,
'price_includes_vat': False,
'registration_date': '2022-01-24',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Juke N-Connecta DiG-T',
'transmission': 'manual',
'trim': 'N-Connecta DiG-T',
'vin': 'SJNFAAF16U1161842',
'year': 2022}
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719358892%27 HTTP/1.1" 200 None
2026-03-29 20:22:15 [motorway.uk] INFO: Saving data for 19358892: {'created_time': 1774815735.050867, 'last_price_update_time': 1774815735.050878, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19358892') HTTP/1.1" 204 0
2026-03-29 20:22:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3042/16283042/interior_boot-1774699931208.jpg> (referer: None)
2026-03-29 20:22:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6402/20076402/docs_service_history-1774606589694-1.jpeg?ixlib=js-3.8.0&auto=format&s=dac0e5ef61a757ef7b72ebd0a6f66524> (referer: None)
2026-03-29 20:22:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a02090>
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e062e35-202d-52ce-a4c2-abc2d860d39e/6e062e35-202d-52ce-a4c2-abc2d860d39e_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3042%252F16283042%252Finterior_boot-1774699931208.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3042/16283042/interior_boot-1774699931208.jpg saved to cache
2026-03-29 20:22:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6e062e35-202d-52ce-a4c2-abc2d860d39e
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598d1710>
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a29f7d3-44bd-5965-8317-ce27ac63882d/2a29f7d3-44bd-5965-8317-ce27ac63882d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6402%252F20076402%252Fdocs_service_history-1774606589694-1.jpeg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Ddac0e5ef61a757ef7b72ebd0a6f66524') HTTP/1.1" 204 0
2026-03-29 20:22:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6402/20076402/docs_service_history-1774606589694-1.jpeg?ixlib=js-3.8.0&auto=format&s=dac0e5ef61a757ef7b72ebd0a6f66524 saved to cache
2026-03-29 20:22:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2a29f7d3-44bd-5965-8317-ce27ac63882d
2026-03-29 20:22:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a29f7d3-44bd-5965-8317-ce27ac63882d, skipping ID generation
2026-03-29 20:22:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a29f7d3-44bd-5965-8317-ce27ac63882d with scrape type 1
2026-03-29 20:22:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a29f7d3-44bd-5965-8317-ce27ac63882d sending to next pipeline
2026-03-29 20:22:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 2a29f7d3-44bd-5965-8317-ce27ac63882d, identifier: 20076402
2026-03-29 20:22:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 2a29f7d3-44bd-5965-8317-ce27ac63882d with identifier: 20076402
2026-03-29 20:22:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 2a29f7d3-44bd-5965-8317-ce27ac63882d with identifier: 20076402
2026-03-29 20:22:15 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 2a29f7d3-44bd-5965-8317-ce27ac63882d with identifier: 20076402 to the API
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-service-history-photos.imgix.net/redacted/oriented/6402/20076402/docs_service_history-1774606589694-1.jpeg?ixlib=js-3.8.0&auto=format&s=dac0e5ef61a757ef7b72ebd0a6f66524>
{'auction_title': '',
'category': None,
'color': 'Red',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '2a29f7d3-44bd-5965-8317-ce27ac63882d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KY64 LFR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20076402',
'listing': 'auction',
'location': 'Greater London Belvedere',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 65218,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf50d22a-d521-5b0b-b491-420b2d4c76ce/cf50d22a-d521-5b0b-b491-420b2d4c76ce_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1613888,
'Height': 2199,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6402/20076402/exterior_front_driver-1773053752178.jpg',
'Width': 2932},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf50d22a-d521-5b0b-b491-420b2d4c76ce/cf50d22a-d521-5b0b-b491-420b2d4c76ce_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1365203,
'Height': 2053,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6402/20076402/exterior_rear_driver-1773053756170.jpg',
'Width': 2737},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf50d22a-d521-5b0b-b491-420b2d4c76ce/cf50d22a-d521-5b0b-b491-420b2d4c76ce_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1474502,
'Height': 2210,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6402/20076402/exterior_front_passenger-1773053754509.jpg',
'Width': 2947},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf50d22a-d521-5b0b-b491-420b2d4c76ce/cf50d22a-d521-5b0b-b491-420b2d4c76ce_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1021543,
'Height': 1858,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6402/20076402/exterior_rear_passenger-1773053756879.jpg',
'Width': 2477},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf50d22a-d521-5b0b-b491-420b2d4c76ce/cf50d22a-d521-5b0b-b491-420b2d4c76ce_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 8437021,
'Height': 4000,
'OriginUrl': 'https://motorway-photos.imgix.net/6402/20076402/interior_front_seats-1773055013530.jpg',
'Width': 3000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf50d22a-d521-5b0b-b491-420b2d4c76ce/cf50d22a-d521-5b0b-b491-420b2d4c76ce_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 9241424,
'Height': 4000,
'OriginUrl': 'https://motorway-photos.imgix.net/6402/20076402/interior_rear_seats-1773055011697.jpg',
'Width': 3000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf50d22a-d521-5b0b-b491-420b2d4c76ce/cf50d22a-d521-5b0b-b491-420b2d4c76ce_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2772987,
'Height': 4000,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6402/20076402/interior_dashboard-1773055145347.jpg',
'Width': 3000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf50d22a-d521-5b0b-b491-420b2d4c76ce/cf50d22a-d521-5b0b-b491-420b2d4c76ce_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 7020049,
'Height': 4000,
'OriginUrl': 'https://motorway-photos.imgix.net/6402/20076402/interior_boot-1773055014964.jpg',
'Width': 3000},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a29f7d3-44bd-5965-8317-ce27ac63882d/2a29f7d3-44bd-5965-8317-ce27ac63882d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56630,
'Height': 1262,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6402/20076402/docs_service_history-1774606589694-1.jpeg?ixlib=js-3.8.0&auto=format&s=dac0e5ef61a757ef7b72ebd0a6f66524',
'Width': 892},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a29f7d3-44bd-5965-8317-ce27ac63882d/2a29f7d3-44bd-5965-8317-ce27ac63882d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58461,
'Height': 1262,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6402/20076402/docs_service_history-1774606603606-1.jpeg?ixlib=js-3.8.0&auto=format&s=28899d1cee7e4941b070ecd995659ab8',
'Width': 892}],
'price': 4052,
'price_includes_vat': False,
'registration_date': '2014-09-23',
'seats_number': None,
'seller_name': None,
'title': 'Nissan Qashqai Acenta Premium DiG-T',
'transmission': 'manual',
'trim': 'Acenta Premium DiG-T',
'vin': 'SJNFEAJ11U1078565',
'year': 2014}
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720076402%27 HTTP/1.1" 200 None
2026-03-29 20:22:15 [motorway.uk] INFO: Saving data for 20076402: {'created_time': 1774815735.822221, 'last_price_update_time': 1774815735.822234, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20076402') HTTP/1.1" 204 0
2026-03-29 20:22:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3042/16283042/interior_dashboard-1774699917820.jpg> (referer: None)
2026-03-29 20:22:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3042/16283042/interior_front_seats-1774699872130.jpg> (referer: None)
2026-03-29 20:22:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/3042/16283042/interior_rear_seats-1774699884943.jpg> (referer: None)
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a02c10>
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e062e35-202d-52ce-a4c2-abc2d860d39e/6e062e35-202d-52ce-a4c2-abc2d860d39e_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3042%252F16283042%252Finterior_dashboard-1774699917820.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3042/16283042/interior_dashboard-1774699917820.jpg saved to cache
2026-03-29 20:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6e062e35-202d-52ce-a4c2-abc2d860d39e
2026-03-29 20:22:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6598d0850>
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e062e35-202d-52ce-a4c2-abc2d860d39e/6e062e35-202d-52ce-a4c2-abc2d860d39e_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3042%252F16283042%252Finterior_front_seats-1774699872130.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3042/16283042/interior_front_seats-1774699872130.jpg saved to cache
2026-03-29 20:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6e062e35-202d-52ce-a4c2-abc2d860d39e
2026-03-29 20:22:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658524ad0>
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e062e35-202d-52ce-a4c2-abc2d860d39e/6e062e35-202d-52ce-a4c2-abc2d860d39e_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F3042%252F16283042%252Finterior_rear_seats-1774699884943.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/3042/16283042/interior_rear_seats-1774699884943.jpg saved to cache
2026-03-29 20:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6e062e35-202d-52ce-a4c2-abc2d860d39e
2026-03-29 20:22:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3042/16283042/exterior_rear_passenger-1774699281664.jpg> (referer: None)
2026-03-29 20:22:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3042/16283042/exterior_front_passenger-1774699298508.jpg> (referer: None)
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65aaf8a10>
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e062e35-202d-52ce-a4c2-abc2d860d39e/6e062e35-202d-52ce-a4c2-abc2d860d39e_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3042%252F16283042%252Fexterior_rear_passenger-1774699281664.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3042/16283042/exterior_rear_passenger-1774699281664.jpg saved to cache
2026-03-29 20:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6e062e35-202d-52ce-a4c2-abc2d860d39e
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658444510>
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e062e35-202d-52ce-a4c2-abc2d860d39e/6e062e35-202d-52ce-a4c2-abc2d860d39e_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3042%252F16283042%252Fexterior_front_passenger-1774699298508.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3042/16283042/exterior_front_passenger-1774699298508.jpg saved to cache
2026-03-29 20:22:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6e062e35-202d-52ce-a4c2-abc2d860d39e
2026-03-29 20:22:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3042/16283042/exterior_front_driver-1774699252376.jpg> (referer: None)
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658adc190>
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e062e35-202d-52ce-a4c2-abc2d860d39e/6e062e35-202d-52ce-a4c2-abc2d860d39e_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:22:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3042%252F16283042%252Fexterior_front_driver-1774699252376.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3042/16283042/exterior_front_driver-1774699252376.jpg saved to cache
2026-03-29 20:22:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e062e35-202d-52ce-a4c2-abc2d860d39e
2026-03-29 20:22:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3042/16283042/exterior_rear_driver-1774699270087.jpg> (referer: None)
2026-03-29 20:22:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658704c90>
2026-03-29 20:22:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e062e35-202d-52ce-a4c2-abc2d860d39e/6e062e35-202d-52ce-a4c2-abc2d860d39e_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3042%252F16283042%252Fexterior_rear_driver-1774699270087.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3042/16283042/exterior_rear_driver-1774699270087.jpg saved to cache
2026-03-29 20:22:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6e062e35-202d-52ce-a4c2-abc2d860d39e
2026-03-29 20:22:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e062e35-202d-52ce-a4c2-abc2d860d39e, skipping ID generation
2026-03-29 20:22:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e062e35-202d-52ce-a4c2-abc2d860d39e with scrape type 1
2026-03-29 20:22:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e062e35-202d-52ce-a4c2-abc2d860d39e sending to next pipeline
2026-03-29 20:22:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6e062e35-202d-52ce-a4c2-abc2d860d39e, identifier: 16283042
2026-03-29 20:22:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6e062e35-202d-52ce-a4c2-abc2d860d39e with identifier: 16283042
2026-03-29 20:22:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6e062e35-202d-52ce-a4c2-abc2d860d39e with identifier: 16283042
2026-03-29 20:22:17 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6e062e35-202d-52ce-a4c2-abc2d860d39e with identifier: 16283042 to the API
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3042/16283042/exterior_rear_driver-1774699270087.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '6e062e35-202d-52ce-a4c2-abc2d860d39e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LA17 WVR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/16283042',
'listing': 'auction',
'location': 'West Yorkshire Brighouse',
'make': 'MINI',
'model': 'Clubman',
'odometer': 51000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e062e35-202d-52ce-a4c2-abc2d860d39e/6e062e35-202d-52ce-a4c2-abc2d860d39e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1706771,
'Height': 2566,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3042/16283042/exterior_front_driver-1774699252376.jpg',
'Width': 3421},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e062e35-202d-52ce-a4c2-abc2d860d39e/6e062e35-202d-52ce-a4c2-abc2d860d39e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1653119,
'Height': 2468,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3042/16283042/exterior_rear_driver-1774699270087.jpg',
'Width': 3291},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e062e35-202d-52ce-a4c2-abc2d860d39e/6e062e35-202d-52ce-a4c2-abc2d860d39e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1668409,
'Height': 2427,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3042/16283042/exterior_front_passenger-1774699298508.jpg',
'Width': 3236},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e062e35-202d-52ce-a4c2-abc2d860d39e/6e062e35-202d-52ce-a4c2-abc2d860d39e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1606689,
'Height': 2481,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3042/16283042/exterior_rear_passenger-1774699281664.jpg',
'Width': 3308},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e062e35-202d-52ce-a4c2-abc2d860d39e/6e062e35-202d-52ce-a4c2-abc2d860d39e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4619506,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3042/16283042/interior_front_seats-1774699872130.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e062e35-202d-52ce-a4c2-abc2d860d39e/6e062e35-202d-52ce-a4c2-abc2d860d39e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4181852,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3042/16283042/interior_rear_seats-1774699884943.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e062e35-202d-52ce-a4c2-abc2d860d39e/6e062e35-202d-52ce-a4c2-abc2d860d39e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2011240,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3042/16283042/interior_dashboard-1774699917820.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e062e35-202d-52ce-a4c2-abc2d860d39e/6e062e35-202d-52ce-a4c2-abc2d860d39e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4042576,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3042/16283042/interior_boot-1774699931208.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e062e35-202d-52ce-a4c2-abc2d860d39e/6e062e35-202d-52ce-a4c2-abc2d860d39e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 533259,
'Height': 3478,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3042/16283042/docs_service_history-1774700374545.jpg?ixlib=js-3.8.0&auto=format&s=e7756f1478eff33d43e0ee0a5ae9b29b',
'Width': 2270},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e062e35-202d-52ce-a4c2-abc2d860d39e/6e062e35-202d-52ce-a4c2-abc2d860d39e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 538110,
'Height': 2824,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3042/16283042/docs_service_history-1774700381167.jpg?ixlib=js-3.8.0&auto=format&s=f681ec3c3b1ab07e6fd124e0759d5333',
'Width': 2022}],
'price': 8189,
'price_includes_vat': False,
'registration_date': '2017-08-19',
'seats_number': None,
'seller_name': None,
'title': 'MINI Clubman Cooper Black',
'transmission': 'manual',
'trim': 'Cooper Black',
'vin': 'WMWLN320802F64108',
'year': 2017}
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716283042%27 HTTP/1.1" 200 None
2026-03-29 20:22:17 [motorway.uk] INFO: Saving data for 16283042: {'created_time': 1774815737.711888, 'last_price_update_time': 1774815737.711899, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='16283042') HTTP/1.1" 204 0
2026-03-29 20:22:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18661288.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b001250f-af2b-5c06-910a-33f4e11230ec with identifier: 18661288
2026-03-29 20:22:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b001250f-af2b-5c06-910a-33f4e11230ec with scrape type 1
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b001250f-af2b-5c06-910a-33f4e11230ec
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1288%252F18661288%252Fexterior_front_driver-1774631851012.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1288/18661288/exterior_front_driver-1774631851012.jpg not downloaded yet
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1288%252F18661288%252Fexterior_rear_driver-1774631863889.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1288/18661288/exterior_rear_driver-1774631863889.jpg not downloaded yet
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1288%252F18661288%252Fexterior_front_passenger-1774631884905.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1288/18661288/exterior_front_passenger-1774631884905.jpg not downloaded yet
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1288%252F18661288%252Fexterior_rear_passenger-1774631875296.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1288/18661288/exterior_rear_passenger-1774631875296.jpg not downloaded yet
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1288%252F18661288%252Finterior_front_seats-1774632242495.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1288/18661288/interior_front_seats-1774632242495.jpg not downloaded yet
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1288%252F18661288%252Finterior_rear_seats-1774632535212.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1288/18661288/interior_rear_seats-1774632535212.jpg not downloaded yet
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1288%252F18661288%252Finterior_dashboard-1774692524588.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1288/18661288/interior_dashboard-1774692524588.jpg not downloaded yet
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1288%252F18661288%252Finterior_boot-1774632570226.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1288/18661288/interior_boot-1774632570226.jpg not downloaded yet
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1288%252F18661288%252Fdamage_scratches-1774631912969.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1288/18661288/damage_scratches-1774631912969.jpg not downloaded yet
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1288%252F18661288%252Fdamage_paintwork-1774631948149.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1288/18661288/damage_paintwork-1774631948149.jpg not downloaded yet
2026-03-29 20:22:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3131/20373131/exterior_rear_passenger-1774705461957.jpg> (referer: None)
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cc7450>
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8254ddde-df63-521e-90ea-493c68286987/8254ddde-df63-521e-90ea-493c68286987_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3131%252F20373131%252Fexterior_rear_passenger-1774705461957.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3131/20373131/exterior_rear_passenger-1774705461957.jpg saved to cache
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8254ddde-df63-521e-90ea-493c68286987
2026-03-29 20:22:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1288/18661288/damage_paintwork-1774631948149.jpg> (referer: None)
2026-03-29 20:22:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65845fa10>
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b001250f-af2b-5c06-910a-33f4e11230ec/b001250f-af2b-5c06-910a-33f4e11230ec_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1288%252F18661288%252Fdamage_paintwork-1774631948149.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1288/18661288/damage_paintwork-1774631948149.jpg saved to cache
2026-03-29 20:22:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b001250f-af2b-5c06-910a-33f4e11230ec
2026-03-29 20:22:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1288/18661288/damage_scratches-1774631912969.jpg> (referer: None)
2026-03-29 20:22:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a68950>
2026-03-29 20:22:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b001250f-af2b-5c06-910a-33f4e11230ec/b001250f-af2b-5c06-910a-33f4e11230ec_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1288%252F18661288%252Fdamage_scratches-1774631912969.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1288/18661288/damage_scratches-1774631912969.jpg saved to cache
2026-03-29 20:22:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b001250f-af2b-5c06-910a-33f4e11230ec
2026-03-29 20:22:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1288/18661288/interior_boot-1774632570226.jpg> (referer: None)
2026-03-29 20:22:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cc5950>
2026-03-29 20:22:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b001250f-af2b-5c06-910a-33f4e11230ec/b001250f-af2b-5c06-910a-33f4e11230ec_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1288%252F18661288%252Finterior_boot-1774632570226.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1288/18661288/interior_boot-1774632570226.jpg saved to cache
2026-03-29 20:22:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b001250f-af2b-5c06-910a-33f4e11230ec
2026-03-29 20:22:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1288/18661288/interior_dashboard-1774692524588.jpg> (referer: None)
2026-03-29 20:22:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d16fd0>
2026-03-29 20:22:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b001250f-af2b-5c06-910a-33f4e11230ec/b001250f-af2b-5c06-910a-33f4e11230ec_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1288%252F18661288%252Finterior_dashboard-1774692524588.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1288/18661288/interior_dashboard-1774692524588.jpg saved to cache
2026-03-29 20:22:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b001250f-af2b-5c06-910a-33f4e11230ec
2026-03-29 20:22:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1288/18661288/interior_rear_seats-1774632535212.jpg> (referer: None)
2026-03-29 20:22:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cc7290>
2026-03-29 20:22:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b001250f-af2b-5c06-910a-33f4e11230ec/b001250f-af2b-5c06-910a-33f4e11230ec_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1288%252F18661288%252Finterior_rear_seats-1774632535212.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1288/18661288/interior_rear_seats-1774632535212.jpg saved to cache
2026-03-29 20:22:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b001250f-af2b-5c06-910a-33f4e11230ec
2026-03-29 20:22:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1288/18661288/interior_front_seats-1774632242495.jpg> (referer: None)
2026-03-29 20:22:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/4637064.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cfb650>
2026-03-29 20:22:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b001250f-af2b-5c06-910a-33f4e11230ec/b001250f-af2b-5c06-910a-33f4e11230ec_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1288%252F18661288%252Finterior_front_seats-1774632242495.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1288/18661288/interior_front_seats-1774632242495.jpg saved to cache
2026-03-29 20:22:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b001250f-af2b-5c06-910a-33f4e11230ec
2026-03-29 20:22:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11a70e81-0e05-5e75-abc1-d25708328389 with identifier: 4637064
2026-03-29 20:22:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11a70e81-0e05-5e75-abc1-d25708328389 with scrape type 2
2026-03-29 20:22:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11a70e81-0e05-5e75-abc1-d25708328389 with scrape type 2
2026-03-29 20:22:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 11a70e81-0e05-5e75-abc1-d25708328389, identifier: 4637064
2026-03-29 20:22:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 11a70e81-0e05-5e75-abc1-d25708328389 with identifier: 4637064
2026-03-29 20:22:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 11a70e81-0e05-5e75-abc1-d25708328389 with identifier: 4637064
2026-03-29 20:22:22 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 11a70e81-0e05-5e75-abc1-d25708328389 with identifier: 4637064 to the API
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/4637064.json>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '2.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '11a70e81-0e05-5e75-abc1-d25708328389',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'T6 CEX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/4637064',
'listing': 'auction',
'location': 'Derry And Strabane Castlederg',
'make': 'Mercedes',
'model': 'C Class',
'odometer': 64400,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 15215,
'price_includes_vat': False,
'registration_date': '2018-03-29',
'seats_number': None,
'seller_name': None,
'title': 'Mercedes C 300 AMG Line Premium + Auto',
'transmission': 'automatic',
'trim': 'C 300 AMG Line Premium + Auto',
'vin': 'WDD2054482F699016',
'year': 2018}
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%274637064%27 HTTP/1.1" 200 None
2026-03-29 20:22:22 [motorway.uk] INFO: Saving data for 4637064: {'auction_closing_time': 1774884600.0, 'created_time': 1774471135.062565, 'last_price_update_time': 1774815742.335116}
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='4637064') HTTP/1.1" 204 0
2026-03-29 20:22:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1288/18661288/exterior_rear_passenger-1774631875296.jpg> (referer: None)
2026-03-29 20:22:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1288/18661288/exterior_front_passenger-1774631884905.jpg> (referer: None)
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658873790>
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b001250f-af2b-5c06-910a-33f4e11230ec/b001250f-af2b-5c06-910a-33f4e11230ec_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1288%252F18661288%252Fexterior_rear_passenger-1774631875296.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1288/18661288/exterior_rear_passenger-1774631875296.jpg saved to cache
2026-03-29 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b001250f-af2b-5c06-910a-33f4e11230ec
2026-03-29 20:22:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17537906.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659d7de10>
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b001250f-af2b-5c06-910a-33f4e11230ec/b001250f-af2b-5c06-910a-33f4e11230ec_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1288%252F18661288%252Fexterior_front_passenger-1774631884905.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1288/18661288/exterior_front_passenger-1774631884905.jpg saved to cache
2026-03-29 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b001250f-af2b-5c06-910a-33f4e11230ec
2026-03-29 20:22:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1288/18661288/exterior_front_driver-1774631851012.jpg> (referer: None)
2026-03-29 20:22:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ce544df-d297-544c-a83c-cf6a538bef6a with identifier: 17537906
2026-03-29 20:22:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ce544df-d297-544c-a83c-cf6a538bef6a with scrape type 1
2026-03-29 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8ce544df-d297-544c-a83c-cf6a538bef6a
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7906%252F17537906%252Fexterior_front_driver-1774366310245.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7906/17537906/exterior_front_driver-1774366310245.jpg not downloaded yet
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7906%252F17537906%252Fexterior_rear_driver-1774703064808.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7906/17537906/exterior_rear_driver-1774703064808.jpg not downloaded yet
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7906%252F17537906%252Fexterior_front_passenger-1774701098706.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7906/17537906/exterior_front_passenger-1774701098706.jpg not downloaded yet
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7906%252F17537906%252Fexterior_rear_passenger-1774703376147.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7906/17537906/exterior_rear_passenger-1774703376147.jpg not downloaded yet
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7906%252F17537906%252Finterior_front_seats-1774619342005.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7906/17537906/interior_front_seats-1774619342005.jpg not downloaded yet
2026-03-29 20:22:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1288/18661288/exterior_rear_driver-1774631863889.jpg> (referer: None)
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7906%252F17537906%252Finterior_rear_seats-1774619361512.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7906/17537906/interior_rear_seats-1774619361512.jpg not downloaded yet
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a6ab50>
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b001250f-af2b-5c06-910a-33f4e11230ec/b001250f-af2b-5c06-910a-33f4e11230ec_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1288%252F18661288%252Fexterior_front_driver-1774631851012.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1288/18661288/exterior_front_driver-1774631851012.jpg saved to cache
2026-03-29 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b001250f-af2b-5c06-910a-33f4e11230ec
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7906%252F17537906%252Finterior_dashboard-1774619392451.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7906/17537906/interior_dashboard-1774619392451.jpg not downloaded yet
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7906%252F17537906%252Finstrument_cluster-1774619599634.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7906/17537906/instrument_cluster-1774619599634.jpg not downloaded yet
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cfa7d0>
2026-03-29 20:22:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b001250f-af2b-5c06-910a-33f4e11230ec/b001250f-af2b-5c06-910a-33f4e11230ec_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1288%252F18661288%252Fexterior_rear_driver-1774631863889.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1288/18661288/exterior_rear_driver-1774631863889.jpg saved to cache
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b001250f-af2b-5c06-910a-33f4e11230ec
2026-03-29 20:22:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b001250f-af2b-5c06-910a-33f4e11230ec, skipping ID generation
2026-03-29 20:22:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b001250f-af2b-5c06-910a-33f4e11230ec with scrape type 1
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b001250f-af2b-5c06-910a-33f4e11230ec sending to next pipeline
2026-03-29 20:22:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b001250f-af2b-5c06-910a-33f4e11230ec, identifier: 18661288
2026-03-29 20:22:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b001250f-af2b-5c06-910a-33f4e11230ec with identifier: 18661288
2026-03-29 20:22:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b001250f-af2b-5c06-910a-33f4e11230ec with identifier: 18661288
2026-03-29 20:22:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b001250f-af2b-5c06-910a-33f4e11230ec with identifier: 18661288 to the API
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1288/18661288/exterior_rear_driver-1774631863889.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'b001250f-af2b-5c06-910a-33f4e11230ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'M28 MPX',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18661288',
'listing': 'auction',
'location': 'Nottinghamshire Nottingham',
'make': 'Renault',
'model': 'Megane',
'odometer': 76000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b001250f-af2b-5c06-910a-33f4e11230ec/b001250f-af2b-5c06-910a-33f4e11230ec_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1201426,
'Height': 2254,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1288/18661288/exterior_front_driver-1774631851012.jpg',
'Width': 3005},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b001250f-af2b-5c06-910a-33f4e11230ec/b001250f-af2b-5c06-910a-33f4e11230ec_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 995473,
'Height': 2218,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1288/18661288/exterior_rear_driver-1774631863889.jpg',
'Width': 2957},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b001250f-af2b-5c06-910a-33f4e11230ec/b001250f-af2b-5c06-910a-33f4e11230ec_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1036034,
'Height': 2106,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1288/18661288/exterior_front_passenger-1774631884905.jpg',
'Width': 2808},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b001250f-af2b-5c06-910a-33f4e11230ec/b001250f-af2b-5c06-910a-33f4e11230ec_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 798556,
'Height': 2176,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1288/18661288/exterior_rear_passenger-1774631875296.jpg',
'Width': 2901},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b001250f-af2b-5c06-910a-33f4e11230ec/b001250f-af2b-5c06-910a-33f4e11230ec_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3594324,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1288/18661288/interior_front_seats-1774632242495.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b001250f-af2b-5c06-910a-33f4e11230ec/b001250f-af2b-5c06-910a-33f4e11230ec_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3793419,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1288/18661288/interior_rear_seats-1774632535212.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b001250f-af2b-5c06-910a-33f4e11230ec/b001250f-af2b-5c06-910a-33f4e11230ec_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2326190,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1288/18661288/interior_dashboard-1774692524588.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b001250f-af2b-5c06-910a-33f4e11230ec/b001250f-af2b-5c06-910a-33f4e11230ec_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3122825,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1288/18661288/interior_boot-1774632570226.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b001250f-af2b-5c06-910a-33f4e11230ec/b001250f-af2b-5c06-910a-33f4e11230ec_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2745397,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1288/18661288/damage_scratches-1774631912969.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b001250f-af2b-5c06-910a-33f4e11230ec/b001250f-af2b-5c06-910a-33f4e11230ec_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2063227,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1288/18661288/damage_paintwork-1774631948149.jpg',
'Width': 4032}],
'price': 1298,
'price_includes_vat': False,
'registration_date': '2013-05-07',
'seats_number': None,
'seller_name': None,
'title': 'Renault Megane GT Line TT Energy DCI SS',
'transmission': 'manual',
'trim': 'GT Line TT Energy DCI SS',
'vin': 'VF1DZ140649086433',
'year': 2013}
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718661288%27 HTTP/1.1" 200 None
2026-03-29 20:22:23 [motorway.uk] INFO: Saving data for 18661288: {'created_time': 1774815743.565379, 'last_price_update_time': 1774815743.56539, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18661288') HTTP/1.1" 204 0
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F7906%252F17537906%252Finterior_boot-1774619405858.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7906/17537906/interior_boot-1774619405858.jpg not downloaded yet
2026-03-29 20:22:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20480204.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20122744.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7906%252F17537906%252Fdocs_service_history-1774702917184.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc8547244a981d86022f4da43e3b7bed5%27 HTTP/1.1" 200 None
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7906/17537906/docs_service_history-1774702917184.jpg?ixlib=js-3.8.0&auto=format&s=c8547244a981d86022f4da43e3b7bed5 not downloaded yet
2026-03-29 20:22:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/3131/20373131/exterior_front_passenger-1774705444464.jpg> (referer: None)
2026-03-29 20:22:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/3131/20373131/exterior_rear_driver-1774114670782.jpg> (referer: None)
2026-03-29 20:22:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7906/17537906/interior_front_seats-1774619342005.jpg> (referer: None)
2026-03-29 20:22:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a124ff5c-89be-5e69-88dd-213a041fb132 with identifier: 20480204
2026-03-29 20:22:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a124ff5c-89be-5e69-88dd-213a041fb132 with scrape type 1
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a124ff5c-89be-5e69-88dd-213a041fb132
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0204%252F20480204%252Fexterior_front_driver-1774721347717.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0204/20480204/exterior_front_driver-1774721347717.jpg not downloaded yet
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0204%252F20480204%252Fexterior_rear_driver-1774721341289.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0204/20480204/exterior_rear_driver-1774721341289.jpg not downloaded yet
2026-03-29 20:22:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0 with identifier: 20122744
2026-03-29 20:22:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0 with scrape type 1
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2744%252F20122744%252Fexterior_front_driver-1774719955301.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2744/20122744/exterior_front_driver-1774719955301.jpg not downloaded yet
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0204%252F20480204%252Fexterior_front_passenger-1774721334990.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0204/20480204/exterior_front_passenger-1774721334990.jpg not downloaded yet
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2744%252F20122744%252Fexterior_rear_driver-1774719952241.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2744/20122744/exterior_rear_driver-1774719952241.jpg not downloaded yet
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0204%252F20480204%252Fexterior_rear_passenger-1774721329619.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0204/20480204/exterior_rear_passenger-1774721329619.jpg not downloaded yet
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2744%252F20122744%252Fexterior_front_passenger-1774719960803.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2744/20122744/exterior_front_passenger-1774719960803.jpg not downloaded yet
2026-03-29 20:22:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b3b990>
2026-03-29 20:22:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8254ddde-df63-521e-90ea-493c68286987/8254ddde-df63-521e-90ea-493c68286987_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F3131%252F20373131%252Fexterior_front_passenger-1774705444464.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/3131/20373131/exterior_front_passenger-1774705444464.jpg saved to cache
2026-03-29 20:22:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8254ddde-df63-521e-90ea-493c68286987
2026-03-29 20:22:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fb3650>
2026-03-29 20:22:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8254ddde-df63-521e-90ea-493c68286987/8254ddde-df63-521e-90ea-493c68286987_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F3131%252F20373131%252Fexterior_rear_driver-1774114670782.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/3131/20373131/exterior_rear_driver-1774114670782.jpg saved to cache
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8254ddde-df63-521e-90ea-493c68286987
2026-03-29 20:22:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8254ddde-df63-521e-90ea-493c68286987, skipping ID generation
2026-03-29 20:22:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8254ddde-df63-521e-90ea-493c68286987 with scrape type 1
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8254ddde-df63-521e-90ea-493c68286987 sending to next pipeline
2026-03-29 20:22:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8254ddde-df63-521e-90ea-493c68286987, identifier: 20373131
2026-03-29 20:22:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599eb250>
2026-03-29 20:22:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce544df-d297-544c-a83c-cf6a538bef6a/8ce544df-d297-544c-a83c-cf6a538bef6a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7906%252F17537906%252Finterior_front_seats-1774619342005.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7906/17537906/interior_front_seats-1774619342005.jpg saved to cache
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8ce544df-d297-544c-a83c-cf6a538bef6a
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0204%252F20480204%252Finterior_front_seats-1774722070203.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0204/20480204/interior_front_seats-1774722070203.jpg not downloaded yet
2026-03-29 20:22:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8254ddde-df63-521e-90ea-493c68286987 with identifier: 20373131
2026-03-29 20:22:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8254ddde-df63-521e-90ea-493c68286987 with identifier: 20373131
2026-03-29 20:22:24 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8254ddde-df63-521e-90ea-493c68286987 with identifier: 20373131 to the API
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/3131/20373131/exterior_rear_driver-1774114670782.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.4L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '8254ddde-df63-521e-90ea-493c68286987',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'GF15 LXO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20373131',
'listing': 'auction',
'location': 'Greater London Sidcup',
'make': 'Volkswagen',
'model': 'Golf',
'odometer': 36755,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8254ddde-df63-521e-90ea-493c68286987/8254ddde-df63-521e-90ea-493c68286987_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2475489,
'Height': 2867,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3131/20373131/exterior_front_driver-1774114654780.jpg',
'Width': 3823},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8254ddde-df63-521e-90ea-493c68286987/8254ddde-df63-521e-90ea-493c68286987_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2189849,
'Height': 2681,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3131/20373131/exterior_rear_driver-1774114670782.jpg',
'Width': 3575},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8254ddde-df63-521e-90ea-493c68286987/8254ddde-df63-521e-90ea-493c68286987_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2117010,
'Height': 2597,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3131/20373131/exterior_front_passenger-1774705444464.jpg',
'Width': 3463},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8254ddde-df63-521e-90ea-493c68286987/8254ddde-df63-521e-90ea-493c68286987_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2272074,
'Height': 2687,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/3131/20373131/exterior_rear_passenger-1774705461957.jpg',
'Width': 3583},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8254ddde-df63-521e-90ea-493c68286987/8254ddde-df63-521e-90ea-493c68286987_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3637479,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3131/20373131/interior_front_seats-1774115435974.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8254ddde-df63-521e-90ea-493c68286987/8254ddde-df63-521e-90ea-493c68286987_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3606266,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3131/20373131/interior_rear_seats-1774115456485.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8254ddde-df63-521e-90ea-493c68286987/8254ddde-df63-521e-90ea-493c68286987_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3765252,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/3131/20373131/interior_dashboard-1774115509299.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8254ddde-df63-521e-90ea-493c68286987/8254ddde-df63-521e-90ea-493c68286987_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3644373,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/3131/20373131/interior_boot-1774115530669.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8254ddde-df63-521e-90ea-493c68286987/8254ddde-df63-521e-90ea-493c68286987_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2147996,
'Height': 1527,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3131/20373131/docs_service_history-1774115883394.jpg?ixlib=js-3.8.0&auto=format&s=be3cd9a1dc8c31aca9970b0fc722c1d7',
'Width': 2192},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8254ddde-df63-521e-90ea-493c68286987/8254ddde-df63-521e-90ea-493c68286987_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2348294,
'Height': 1619,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/3131/20373131/docs_service_history-1774115883671.jpg?ixlib=js-3.8.0&auto=format&s=ad61b41ca85565bdd522872d4e61760e',
'Width': 2298}],
'price': 7417,
'price_includes_vat': False,
'registration_date': '2015-04-01',
'seats_number': None,
'seller_name': None,
'title': 'Volkswagen Golf S BlueMotion TECHN-GY TSI',
'transmission': 'manual',
'trim': 'S BlueMotion TECHN-GY TSI',
'vin': 'WVWZZZAUZFW283225',
'year': 2015}
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720373131%27 HTTP/1.1" 200 None
2026-03-29 20:22:24 [motorway.uk] INFO: Saving data for 20373131: {'created_time': 1774815744.674079, 'last_price_update_time': 1774815744.674089, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20373131') HTTP/1.1" 204 0
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2744%252F20122744%252Fexterior_rear_passenger-1774719958094.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2744/20122744/exterior_rear_passenger-1774719958094.jpg not downloaded yet
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0204%252F20480204%252Finterior_rear_seats-1774722124984.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0204/20480204/interior_rear_seats-1774722124984.jpg not downloaded yet
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2744%252F20122744%252Finterior_front_seats-1774720897134.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2744/20122744/interior_front_seats-1774720897134.jpg not downloaded yet
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0204%252F20480204%252F20480204-interior_dashboard-modified-1774776111902.jpeg%27 HTTP/1.1" 200 None
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0204/20480204/20480204-interior_dashboard-modified-1774776111902.jpeg not downloaded yet
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2744%252F20122744%252Finterior_rear_seats-1774720950408.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2744/20122744/interior_rear_seats-1774720950408.jpg not downloaded yet
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0204%252F20480204%252Finstrument_cluster-1774721901819.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0204/20480204/instrument_cluster-1774721901819.jpg not downloaded yet
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2744%252F20122744%252Finterior_dashboard-1774720830719.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2744/20122744/interior_dashboard-1774720830719.jpg not downloaded yet
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0204%252F20480204%252Finterior_boot-1774722066032.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0204/20480204/interior_boot-1774722066032.jpg not downloaded yet
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2744%252F20122744%252Finstrument_cluster-1774720650842.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2744/20122744/instrument_cluster-1774720650842.jpg not downloaded yet
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0204%252F20480204%252F20480204-damage_missing_trims-default-1774776133105.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0204/20480204/20480204-damage_missing_trims-default-1774776133105.jpg not downloaded yet
2026-03-29 20:22:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/modified/7906/17537906/docs_service_history-1774702917184.jpg?ixlib=js-3.8.0&auto=format&s=c8547244a981d86022f4da43e3b7bed5> (referer: None)
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F2744%252F20122744%252Finterior_boot-1774720823876.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2744/20122744/interior_boot-1774720823876.jpg not downloaded yet
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2744%252F20122744%252Fdocs_service_history-1774721704713.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd7b3b7b7e5fb0c402f8176b4d85c24f0%27 HTTP/1.1" 200 None
2026-03-29 20:22:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2744/20122744/docs_service_history-1774721704713.jpg?ixlib=js-3.8.0&auto=format&s=d7b3b7b7e5fb0c402f8176b4d85c24f0 not downloaded yet
2026-03-29 20:22:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0204/20480204/interior_front_seats-1774722070203.jpg> (referer: None)
2026-03-29 20:22:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7906/17537906/instrument_cluster-1774619599634.jpg> (referer: None)
2026-03-29 20:22:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7906/17537906/interior_boot-1774619405858.jpg> (referer: None)
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a7fcd0>
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce544df-d297-544c-a83c-cf6a538bef6a/8ce544df-d297-544c-a83c-cf6a538bef6a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fmodified%252F7906%252F17537906%252Fdocs_service_history-1774702917184.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dc8547244a981d86022f4da43e3b7bed5') HTTP/1.1" 204 0
2026-03-29 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/modified/7906/17537906/docs_service_history-1774702917184.jpg?ixlib=js-3.8.0&auto=format&s=c8547244a981d86022f4da43e3b7bed5 saved to cache
2026-03-29 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8ce544df-d297-544c-a83c-cf6a538bef6a
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bed7d50>
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a124ff5c-89be-5e69-88dd-213a041fb132/a124ff5c-89be-5e69-88dd-213a041fb132_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0204%252F20480204%252Finterior_front_seats-1774722070203.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0204/20480204/interior_front_seats-1774722070203.jpg saved to cache
2026-03-29 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a124ff5c-89be-5e69-88dd-213a041fb132
2026-03-29 20:22:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658888f10>
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce544df-d297-544c-a83c-cf6a538bef6a/8ce544df-d297-544c-a83c-cf6a538bef6a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7906%252F17537906%252Finstrument_cluster-1774619599634.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7906/17537906/instrument_cluster-1774619599634.jpg saved to cache
2026-03-29 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8ce544df-d297-544c-a83c-cf6a538bef6a
2026-03-29 20:22:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65850e610>
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce544df-d297-544c-a83c-cf6a538bef6a/8ce544df-d297-544c-a83c-cf6a538bef6a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7906%252F17537906%252Finterior_boot-1774619405858.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7906/17537906/interior_boot-1774619405858.jpg saved to cache
2026-03-29 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8ce544df-d297-544c-a83c-cf6a538bef6a
2026-03-29 20:22:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2744/20122744/exterior_front_passenger-1774719960803.jpg> (referer: None)
2026-03-29 20:22:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0204/20480204/20480204-damage_missing_trims-default-1774776133105.jpg> (referer: None)
2026-03-29 20:22:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/2744/20122744/docs_service_history-1774721704713.jpg?ixlib=js-3.8.0&auto=format&s=d7b3b7b7e5fb0c402f8176b4d85c24f0> (referer: None)
2026-03-29 20:22:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2744/20122744/interior_boot-1774720823876.jpg> (referer: None)
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be02350>
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0/78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2744%252F20122744%252Fexterior_front_passenger-1774719960803.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2744/20122744/exterior_front_passenger-1774719960803.jpg saved to cache
2026-03-29 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583f94d0>
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a124ff5c-89be-5e69-88dd-213a041fb132/a124ff5c-89be-5e69-88dd-213a041fb132_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0204%252F20480204%252F20480204-damage_missing_trims-default-1774776133105.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0204/20480204/20480204-damage_missing_trims-default-1774776133105.jpg saved to cache
2026-03-29 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a124ff5c-89be-5e69-88dd-213a041fb132
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cc1790>
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0/78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F2744%252F20122744%252Fdocs_service_history-1774721704713.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd7b3b7b7e5fb0c402f8176b4d85c24f0') HTTP/1.1" 204 0
2026-03-29 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/2744/20122744/docs_service_history-1774721704713.jpg?ixlib=js-3.8.0&auto=format&s=d7b3b7b7e5fb0c402f8176b4d85c24f0 saved to cache
2026-03-29 20:22:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a1ef90>
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0/78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2744%252F20122744%252Finterior_boot-1774720823876.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2744/20122744/interior_boot-1774720823876.jpg saved to cache
2026-03-29 20:22:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0
2026-03-29 20:22:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0204/20480204/interior_boot-1774722066032.jpg> (referer: None)
2026-03-29 20:22:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2744/20122744/interior_rear_seats-1774720950408.jpg> (referer: None)
2026-03-29 20:22:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2744/20122744/instrument_cluster-1774720650842.jpg> (referer: None)
2026-03-29 20:22:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0204/20480204/instrument_cluster-1774721901819.jpg> (referer: None)
2026-03-29 20:22:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2744/20122744/interior_dashboard-1774720830719.jpg> (referer: None)
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659076850>
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a124ff5c-89be-5e69-88dd-213a041fb132/a124ff5c-89be-5e69-88dd-213a041fb132_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0204%252F20480204%252Finterior_boot-1774722066032.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0204/20480204/interior_boot-1774722066032.jpg saved to cache
2026-03-29 20:22:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a124ff5c-89be-5e69-88dd-213a041fb132
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658d796d0>
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0/78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2744%252F20122744%252Finterior_rear_seats-1774720950408.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2744/20122744/interior_rear_seats-1774720950408.jpg saved to cache
2026-03-29 20:22:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a43b90>
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0/78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2744%252F20122744%252Finstrument_cluster-1774720650842.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2744/20122744/instrument_cluster-1774720650842.jpg saved to cache
2026-03-29 20:22:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf9d6d0>
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a124ff5c-89be-5e69-88dd-213a041fb132/a124ff5c-89be-5e69-88dd-213a041fb132_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0204%252F20480204%252Finstrument_cluster-1774721901819.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0204/20480204/instrument_cluster-1774721901819.jpg saved to cache
2026-03-29 20:22:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a124ff5c-89be-5e69-88dd-213a041fb132
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b37950>
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0/78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2744%252F20122744%252Finterior_dashboard-1774720830719.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2744/20122744/interior_dashboard-1774720830719.jpg saved to cache
2026-03-29 20:22:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0
2026-03-29 20:22:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0204/20480204/interior_rear_seats-1774722124984.jpg> (referer: None)
2026-03-29 20:22:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/2744/20122744/interior_front_seats-1774720897134.jpg> (referer: None)
2026-03-29 20:22:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/0204/20480204/20480204-interior_dashboard-modified-1774776111902.jpeg> (referer: None)
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a156d0>
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a124ff5c-89be-5e69-88dd-213a041fb132/a124ff5c-89be-5e69-88dd-213a041fb132_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0204%252F20480204%252Finterior_rear_seats-1774722124984.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0204/20480204/interior_rear_seats-1774722124984.jpg saved to cache
2026-03-29 20:22:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a124ff5c-89be-5e69-88dd-213a041fb132
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f84c90>
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0/78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F2744%252F20122744%252Finterior_front_seats-1774720897134.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/2744/20122744/interior_front_seats-1774720897134.jpg saved to cache
2026-03-29 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658703590>
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a124ff5c-89be-5e69-88dd-213a041fb132/a124ff5c-89be-5e69-88dd-213a041fb132_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F0204%252F20480204%252F20480204-interior_dashboard-modified-1774776111902.jpeg') HTTP/1.1" 204 0
2026-03-29 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/0204/20480204/20480204-interior_dashboard-modified-1774776111902.jpeg saved to cache
2026-03-29 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a124ff5c-89be-5e69-88dd-213a041fb132
2026-03-29 20:22:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2744/20122744/exterior_front_driver-1774719955301.jpg> (referer: None)
2026-03-29 20:22:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0204/20480204/exterior_front_passenger-1774721334990.jpg> (referer: None)
2026-03-29 20:22:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2744/20122744/exterior_rear_driver-1774719952241.jpg> (referer: None)
2026-03-29 20:22:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0204/20480204/exterior_rear_passenger-1774721329619.jpg> (referer: None)
2026-03-29 20:22:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/2744/20122744/exterior_rear_passenger-1774719958094.jpg> (referer: None)
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be55310>
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0/78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2744%252F20122744%252Fexterior_front_driver-1774719955301.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2744/20122744/exterior_front_driver-1774719955301.jpg saved to cache
2026-03-29 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfb62d0>
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a124ff5c-89be-5e69-88dd-213a041fb132/a124ff5c-89be-5e69-88dd-213a041fb132_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0204%252F20480204%252Fexterior_front_passenger-1774721334990.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0204/20480204/exterior_front_passenger-1774721334990.jpg saved to cache
2026-03-29 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a124ff5c-89be-5e69-88dd-213a041fb132
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584621d0>
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0/78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2744%252F20122744%252Fexterior_rear_driver-1774719952241.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2744/20122744/exterior_rear_driver-1774719952241.jpg saved to cache
2026-03-29 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bdab50>
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a124ff5c-89be-5e69-88dd-213a041fb132/a124ff5c-89be-5e69-88dd-213a041fb132_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0204%252F20480204%252Fexterior_rear_passenger-1774721329619.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0204/20480204/exterior_rear_passenger-1774721329619.jpg saved to cache
2026-03-29 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a124ff5c-89be-5e69-88dd-213a041fb132
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf4a9d0>
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0/78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F2744%252F20122744%252Fexterior_rear_passenger-1774719958094.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/2744/20122744/exterior_rear_passenger-1774719958094.jpg saved to cache
2026-03-29 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0
2026-03-29 20:22:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0, skipping ID generation
2026-03-29 20:22:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0 with scrape type 1
2026-03-29 20:22:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0 sending to next pipeline
2026-03-29 20:22:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0, identifier: 20122744
2026-03-29 20:22:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0 with identifier: 20122744
2026-03-29 20:22:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0 with identifier: 20122744
2026-03-29 20:22:28 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0 with identifier: 20122744 to the API
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/2744/20122744/exterior_rear_passenger-1774719958094.jpg>
{'auction_title': '',
'category': None,
'color': 'Blue',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'SL67 OXR',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20122744',
'listing': 'auction',
'location': 'East Lothian Haddington',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 43140,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0/78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 955506,
'Height': 2177,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2744/20122744/exterior_front_driver-1774719955301.jpg',
'Width': 2903},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0/78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1213549,
'Height': 2135,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2744/20122744/exterior_rear_driver-1774719952241.jpg',
'Width': 2847},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0/78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1247558,
'Height': 2210,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2744/20122744/exterior_front_passenger-1774719960803.jpg',
'Width': 2946},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0/78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1421103,
'Height': 2429,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2744/20122744/exterior_rear_passenger-1774719958094.jpg',
'Width': 3238},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0/78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1505004,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/2744/20122744/interior_front_seats-1774720897134.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0/78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1333400,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/2744/20122744/interior_rear_seats-1774720950408.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0/78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1665823,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2744/20122744/interior_dashboard-1774720830719.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0/78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1300531,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/2744/20122744/instrument_cluster-1774720650842.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0/78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1566764,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/2744/20122744/interior_boot-1774720823876.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0/78d1dec7-bf3e-5cbc-9ff6-8d1b516e2db0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 907021,
'Height': 3840,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/2744/20122744/docs_service_history-1774721704713.jpg?ixlib=js-3.8.0&auto=format&s=d7b3b7b7e5fb0c402f8176b4d85c24f0',
'Width': 2880}],
'price': 4726,
'price_includes_vat': False,
'registration_date': '2017-10-30',
'seats_number': None,
'seller_name': None,
'title': 'Skoda Fabia S MPI',
'transmission': 'manual',
'trim': 'S MPI',
'vin': 'TMBFA6NJ1JZ055159',
'year': 2017}
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720122744%27 HTTP/1.1" 200 None
2026-03-29 20:22:28 [motorway.uk] INFO: Saving data for 20122744: {'created_time': 1774815748.484067, 'last_price_update_time': 1774815748.484076, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20122744') HTTP/1.1" 204 0
2026-03-29 20:22:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0204/20480204/exterior_front_driver-1774721347717.jpg> (referer: None)
2026-03-29 20:22:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0204/20480204/exterior_rear_driver-1774721341289.jpg> (referer: None)
2026-03-29 20:22:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/7906/17537906/interior_rear_seats-1774619361512.jpg> (referer: None)
2026-03-29 20:22:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7906/17537906/interior_dashboard-1774619392451.jpg> (referer: None)
2026-03-29 20:22:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7906/17537906/exterior_rear_passenger-1774703376147.jpg> (referer: None)
2026-03-29 20:22:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bed67d0>
2026-03-29 20:22:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a124ff5c-89be-5e69-88dd-213a041fb132/a124ff5c-89be-5e69-88dd-213a041fb132_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0204%252F20480204%252Fexterior_front_driver-1774721347717.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0204/20480204/exterior_front_driver-1774721347717.jpg saved to cache
2026-03-29 20:22:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a124ff5c-89be-5e69-88dd-213a041fb132
2026-03-29 20:22:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bce210>
2026-03-29 20:22:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a124ff5c-89be-5e69-88dd-213a041fb132/a124ff5c-89be-5e69-88dd-213a041fb132_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0204%252F20480204%252Fexterior_rear_driver-1774721341289.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0204/20480204/exterior_rear_driver-1774721341289.jpg saved to cache
2026-03-29 20:22:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a124ff5c-89be-5e69-88dd-213a041fb132
2026-03-29 20:22:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a124ff5c-89be-5e69-88dd-213a041fb132, skipping ID generation
2026-03-29 20:22:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a124ff5c-89be-5e69-88dd-213a041fb132 with scrape type 1
2026-03-29 20:22:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a124ff5c-89be-5e69-88dd-213a041fb132 sending to next pipeline
2026-03-29 20:22:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a124ff5c-89be-5e69-88dd-213a041fb132, identifier: 20480204
2026-03-29 20:22:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf12e10>
2026-03-29 20:22:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce544df-d297-544c-a83c-cf6a538bef6a/8ce544df-d297-544c-a83c-cf6a538bef6a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F7906%252F17537906%252Finterior_rear_seats-1774619361512.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/7906/17537906/interior_rear_seats-1774619361512.jpg saved to cache
2026-03-29 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8ce544df-d297-544c-a83c-cf6a538bef6a
2026-03-29 20:22:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659bfd210>
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce544df-d297-544c-a83c-cf6a538bef6a/8ce544df-d297-544c-a83c-cf6a538bef6a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7906%252F17537906%252Finterior_dashboard-1774619392451.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7906/17537906/interior_dashboard-1774619392451.jpg saved to cache
2026-03-29 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8ce544df-d297-544c-a83c-cf6a538bef6a
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658cc1b50>
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce544df-d297-544c-a83c-cf6a538bef6a/8ce544df-d297-544c-a83c-cf6a538bef6a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7906%252F17537906%252Fexterior_rear_passenger-1774703376147.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7906/17537906/exterior_rear_passenger-1774703376147.jpg saved to cache
2026-03-29 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8ce544df-d297-544c-a83c-cf6a538bef6a
2026-03-29 20:22:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a124ff5c-89be-5e69-88dd-213a041fb132 with identifier: 20480204
2026-03-29 20:22:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a124ff5c-89be-5e69-88dd-213a041fb132 with identifier: 20480204
2026-03-29 20:22:29 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a124ff5c-89be-5e69-88dd-213a041fb132 with identifier: 20480204 to the API
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0204/20480204/exterior_rear_driver-1774721341289.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': 'a124ff5c-89be-5e69-88dd-213a041fb132',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RF14 FXW',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20480204',
'listing': 'auction',
'location': 'Hampshire Romsey',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 63466,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a124ff5c-89be-5e69-88dd-213a041fb132/a124ff5c-89be-5e69-88dd-213a041fb132_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 947808,
'Height': 2233,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0204/20480204/exterior_front_driver-1774721347717.jpg',
'Width': 2977},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a124ff5c-89be-5e69-88dd-213a041fb132/a124ff5c-89be-5e69-88dd-213a041fb132_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 950918,
'Height': 2338,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0204/20480204/exterior_rear_driver-1774721341289.jpg',
'Width': 3117},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a124ff5c-89be-5e69-88dd-213a041fb132/a124ff5c-89be-5e69-88dd-213a041fb132_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1054874,
'Height': 2510,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0204/20480204/exterior_front_passenger-1774721334990.jpg',
'Width': 3346},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a124ff5c-89be-5e69-88dd-213a041fb132/a124ff5c-89be-5e69-88dd-213a041fb132_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1061153,
'Height': 2494,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0204/20480204/exterior_rear_passenger-1774721329619.jpg',
'Width': 3325},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a124ff5c-89be-5e69-88dd-213a041fb132/a124ff5c-89be-5e69-88dd-213a041fb132_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1075891,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0204/20480204/interior_front_seats-1774722070203.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a124ff5c-89be-5e69-88dd-213a041fb132/a124ff5c-89be-5e69-88dd-213a041fb132_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1185130,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0204/20480204/interior_rear_seats-1774722124984.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a124ff5c-89be-5e69-88dd-213a041fb132/a124ff5c-89be-5e69-88dd-213a041fb132_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1417168,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/0204/20480204/20480204-interior_dashboard-modified-1774776111902.jpeg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a124ff5c-89be-5e69-88dd-213a041fb132/a124ff5c-89be-5e69-88dd-213a041fb132_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1194689,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0204/20480204/instrument_cluster-1774721901819.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a124ff5c-89be-5e69-88dd-213a041fb132/a124ff5c-89be-5e69-88dd-213a041fb132_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1577539,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0204/20480204/interior_boot-1774722066032.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a124ff5c-89be-5e69-88dd-213a041fb132/a124ff5c-89be-5e69-88dd-213a041fb132_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 969708,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/0204/20480204/20480204-damage_missing_trims-default-1774776133105.jpg',
'Width': 3840}],
'price': 2758,
'price_includes_vat': False,
'registration_date': '2014-08-08',
'seats_number': None,
'seller_name': None,
'title': 'Ford Fiesta Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'vin': 'WF0DXXGAKDEM24629',
'year': 2014}
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720480204%27 HTTP/1.1" 200 None
2026-03-29 20:22:29 [motorway.uk] INFO: Saving data for 20480204: {'created_time': 1774815749.697738, 'last_price_update_time': 1774815749.697748, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20480204') HTTP/1.1" 204 0
2026-03-29 20:22:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7906/17537906/exterior_front_passenger-1774701098706.jpg> (referer: None)
2026-03-29 20:22:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/7906/17537906/exterior_rear_driver-1774703064808.jpg> (referer: None)
2026-03-29 20:22:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/7906/17537906/exterior_front_driver-1774366310245.jpg> (referer: None)
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b31d10>
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce544df-d297-544c-a83c-cf6a538bef6a/8ce544df-d297-544c-a83c-cf6a538bef6a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7906%252F17537906%252Fexterior_front_passenger-1774701098706.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7906/17537906/exterior_front_passenger-1774701098706.jpg saved to cache
2026-03-29 20:22:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8ce544df-d297-544c-a83c-cf6a538bef6a
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583fb910>
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce544df-d297-544c-a83c-cf6a538bef6a/8ce544df-d297-544c-a83c-cf6a538bef6a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F7906%252F17537906%252Fexterior_rear_driver-1774703064808.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/7906/17537906/exterior_rear_driver-1774703064808.jpg saved to cache
2026-03-29 20:22:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8ce544df-d297-544c-a83c-cf6a538bef6a
2026-03-29 20:22:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfd0c90>
2026-03-29 20:22:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce544df-d297-544c-a83c-cf6a538bef6a/8ce544df-d297-544c-a83c-cf6a538bef6a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F7906%252F17537906%252Fexterior_front_driver-1774366310245.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/7906/17537906/exterior_front_driver-1774366310245.jpg saved to cache
2026-03-29 20:22:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ce544df-d297-544c-a83c-cf6a538bef6a
2026-03-29 20:22:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ce544df-d297-544c-a83c-cf6a538bef6a, skipping ID generation
2026-03-29 20:22:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ce544df-d297-544c-a83c-cf6a538bef6a with scrape type 1
2026-03-29 20:22:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ce544df-d297-544c-a83c-cf6a538bef6a sending to next pipeline
2026-03-29 20:22:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8ce544df-d297-544c-a83c-cf6a538bef6a, identifier: 17537906
2026-03-29 20:22:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8ce544df-d297-544c-a83c-cf6a538bef6a with identifier: 17537906
2026-03-29 20:22:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8ce544df-d297-544c-a83c-cf6a538bef6a with identifier: 17537906
2026-03-29 20:22:30 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8ce544df-d297-544c-a83c-cf6a538bef6a with identifier: 17537906 to the API
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/7906/17537906/exterior_front_driver-1774366310245.jpg>
{'auction_title': '',
'category': None,
'color': 'Black',
'currency': 'GBP',
'doors_number': None,
'engine': '3.0L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '8ce544df-d297-544c-a83c-cf6a538bef6a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FN62 YNY',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17537906',
'listing': 'auction',
'location': 'Northamptonshire Northampton',
'make': 'Jaguar',
'model': 'XJ Series',
'odometer': 156713,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce544df-d297-544c-a83c-cf6a538bef6a/8ce544df-d297-544c-a83c-cf6a538bef6a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2011701,
'Height': 2744,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7906/17537906/exterior_front_driver-1774366310245.jpg',
'Width': 3659},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce544df-d297-544c-a83c-cf6a538bef6a/8ce544df-d297-544c-a83c-cf6a538bef6a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1808383,
'Height': 2369,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7906/17537906/exterior_rear_driver-1774703064808.jpg',
'Width': 3159},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce544df-d297-544c-a83c-cf6a538bef6a/8ce544df-d297-544c-a83c-cf6a538bef6a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1288011,
'Height': 2321,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7906/17537906/exterior_front_passenger-1774701098706.jpg',
'Width': 3095},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce544df-d297-544c-a83c-cf6a538bef6a/8ce544df-d297-544c-a83c-cf6a538bef6a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1976789,
'Height': 2420,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/7906/17537906/exterior_rear_passenger-1774703376147.jpg',
'Width': 3227},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce544df-d297-544c-a83c-cf6a538bef6a/8ce544df-d297-544c-a83c-cf6a538bef6a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3468257,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7906/17537906/interior_front_seats-1774619342005.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce544df-d297-544c-a83c-cf6a538bef6a/8ce544df-d297-544c-a83c-cf6a538bef6a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2946691,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7906/17537906/interior_rear_seats-1774619361512.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce544df-d297-544c-a83c-cf6a538bef6a/8ce544df-d297-544c-a83c-cf6a538bef6a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3918432,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7906/17537906/interior_dashboard-1774619392451.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce544df-d297-544c-a83c-cf6a538bef6a/8ce544df-d297-544c-a83c-cf6a538bef6a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2585129,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/7906/17537906/instrument_cluster-1774619599634.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce544df-d297-544c-a83c-cf6a538bef6a/8ce544df-d297-544c-a83c-cf6a538bef6a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3246842,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/7906/17537906/interior_boot-1774619405858.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce544df-d297-544c-a83c-cf6a538bef6a/8ce544df-d297-544c-a83c-cf6a538bef6a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 682152,
'Height': 2418,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/modified/7906/17537906/docs_service_history-1774702917184.jpg?ixlib=js-3.8.0&auto=format&s=c8547244a981d86022f4da43e3b7bed5',
'Width': 1813}],
'price': 2667,
'price_includes_vat': False,
'registration_date': '2012-09-08',
'seats_number': None,
'seller_name': None,
'title': 'Jaguar XJ Luxury V6 D Auto',
'transmission': 'automatic',
'trim': 'XJ Luxury V6 D Auto',
'vin': 'SAJAC1021CNV37505',
'year': 2012}
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717537906%27 HTTP/1.1" 200 None
2026-03-29 20:22:30 [motorway.uk] INFO: Saving data for 17537906: {'created_time': 1774815750.75036, 'last_price_update_time': 1774815750.750371, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17537906') HTTP/1.1" 204 0
2026-03-29 20:22:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1584&page=44&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9819/14979819/docs_service_history-1774694905853.jpg?ixlib=js-3.8.0&auto=format&s=69eb94e319091f86a10e6c2b3f924e10> (referer: None)
2026-03-29 20:22:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/5928/20435928/docs_service_history-1774705414490.jpg?ixlib=js-3.8.0&auto=format&s=93a8fee62394b3c12dc66c6dfdcfba7d> (referer: None)
2026-03-29 20:22:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6245/20096245/interior_dashboard-1774714459897.jpg> (referer: None)
2026-03-29 20:22:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6245/20096245/interior_front_seats-1774713771963.jpg> (referer: None)
2026-03-29 20:22:30 [motorway.uk] INFO: Found listing with ID: 20451003
2026-03-29 20:22:30 [motorway.uk] INFO: Found listing with ID: 14684218
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714684218%27 HTTP/1.1" 200 None
2026-03-29 20:22:30 [motorway.uk] INFO: Scrape type for 14684218: 1
2026-03-29 20:22:30 [motorway.uk] INFO: Found listing with ID: 20422948
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720422948%27 HTTP/1.1" 200 None
2026-03-29 20:22:30 [motorway.uk] INFO: Scrape type for 20422948: 1
2026-03-29 20:22:30 [motorway.uk] INFO: Found listing with ID: 20499385
2026-03-29 20:22:30 [motorway.uk] INFO: Found listing with ID: 16912620
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716912620%27 HTTP/1.1" 200 None
2026-03-29 20:22:30 [motorway.uk] INFO: Scrape type for 16912620: 1
2026-03-29 20:22:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659e1d450>
2026-03-29 20:22:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7140c70b-51c4-5274-a187-68b60fb6b60e/7140c70b-51c4-5274-a187-68b60fb6b60e_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9819%252F14979819%252Fdocs_service_history-1774694905853.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D69eb94e319091f86a10e6c2b3f924e10') HTTP/1.1" 204 0
2026-03-29 20:22:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9819/14979819/docs_service_history-1774694905853.jpg?ixlib=js-3.8.0&auto=format&s=69eb94e319091f86a10e6c2b3f924e10 saved to cache
2026-03-29 20:22:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7140c70b-51c4-5274-a187-68b60fb6b60e
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a40950>
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eaba9c3-ee02-5f23-b4bb-fbe112199003/6eaba9c3-ee02-5f23-b4bb-fbe112199003_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F5928%252F20435928%252Fdocs_service_history-1774705414490.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D93a8fee62394b3c12dc66c6dfdcfba7d') HTTP/1.1" 204 0
2026-03-29 20:22:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/5928/20435928/docs_service_history-1774705414490.jpg?ixlib=js-3.8.0&auto=format&s=93a8fee62394b3c12dc66c6dfdcfba7d saved to cache
2026-03-29 20:22:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6eaba9c3-ee02-5f23-b4bb-fbe112199003
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 20290355
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 20346452
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720346452%27 HTTP/1.1" 200 None
2026-03-29 20:22:31 [motorway.uk] INFO: Scrape type for 20346452: 1
2026-03-29 20:22:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x03'
2026-03-29 20:22:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658888f10>
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0beba8a3-9174-5484-abab-e26c29c10f3a/0beba8a3-9174-5484-abab-e26c29c10f3a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6245%252F20096245%252Finterior_dashboard-1774714459897.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6245/20096245/interior_dashboard-1774714459897.jpg saved to cache
2026-03-29 20:22:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0beba8a3-9174-5484-abab-e26c29c10f3a
2026-03-29 20:22:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a460d0>
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0beba8a3-9174-5484-abab-e26c29c10f3a/0beba8a3-9174-5484-abab-e26c29c10f3a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6245%252F20096245%252Finterior_front_seats-1774713771963.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6245/20096245/interior_front_seats-1774713771963.jpg saved to cache
2026-03-29 20:22:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0beba8a3-9174-5484-abab-e26c29c10f3a
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 20492694
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 20488759
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 19778290
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 20235127
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720235127%27 HTTP/1.1" 200 None
2026-03-29 20:22:31 [motorway.uk] INFO: Scrape type for 20235127: 2
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 20357385
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 5496276
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 20398366
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 20488805
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 19217492
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 20311195
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 20418338
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 16896697
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 20269930
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 20489216
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 19118754
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 16543574
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 19621328
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 20409554
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 19689914
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719689914%27 HTTP/1.1" 200 None
2026-03-29 20:22:31 [motorway.uk] INFO: Scrape type for 19689914: 1
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 20145284
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 20286923
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720286923%27 HTTP/1.1" 200 None
2026-03-29 20:22:31 [motorway.uk] INFO: Scrape type for 20286923: 1
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 15579981
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 16616720
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 7172629
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 7903453
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 19401646
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719401646%27 HTTP/1.1" 200 None
2026-03-29 20:22:31 [motorway.uk] INFO: Scrape type for 19401646: 1
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 20291009
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 19871725
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719871725%27 HTTP/1.1" 200 None
2026-03-29 20:22:31 [motorway.uk] INFO: Scrape type for 19871725: 1
2026-03-29 20:22:31 [motorway.uk] INFO: Found listing with ID: 19394258
2026-03-29 20:22:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6245/20096245/exterior_rear_passenger-1774713247201.jpg> (referer: None)
2026-03-29 20:22:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/5928/20435928/interior_boot-1774704143218.jpg> (referer: None)
2026-03-29 20:22:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9819/14979819/interior_boot-1774694621435.jpg> (referer: None)
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584f3690>
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0beba8a3-9174-5484-abab-e26c29c10f3a/0beba8a3-9174-5484-abab-e26c29c10f3a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6245%252F20096245%252Fexterior_rear_passenger-1774713247201.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6245/20096245/exterior_rear_passenger-1774713247201.jpg saved to cache
2026-03-29 20:22:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0beba8a3-9174-5484-abab-e26c29c10f3a
2026-03-29 20:22:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587a6f10>
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6eaba9c3-ee02-5f23-b4bb-fbe112199003/6eaba9c3-ee02-5f23-b4bb-fbe112199003_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F5928%252F20435928%252Finterior_boot-1774704143218.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/5928/20435928/interior_boot-1774704143218.jpg saved to cache
2026-03-29 20:22:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6eaba9c3-ee02-5f23-b4bb-fbe112199003
2026-03-29 20:22:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:22:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:22:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:22:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6584f2dd0>
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7140c70b-51c4-5274-a187-68b60fb6b60e/7140c70b-51c4-5274-a187-68b60fb6b60e_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9819%252F14979819%252Finterior_boot-1774694621435.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9819/14979819/interior_boot-1774694621435.jpg saved to cache
2026-03-29 20:22:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7140c70b-51c4-5274-a187-68b60fb6b60e
2026-03-29 20:22:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19911856.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 959278b6-4c51-519a-864b-f71846919cdb with identifier: 19911856
2026-03-29 20:22:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 959278b6-4c51-519a-864b-f71846919cdb with scrape type 1
2026-03-29 20:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 959278b6-4c51-519a-864b-f71846919cdb
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1856%252F19911856%252Fexterior_front_driver-1774714980634.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1856/19911856/exterior_front_driver-1774714980634.jpg not downloaded yet
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1856%252F19911856%252Fexterior_rear_driver-1774714986183.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1856/19911856/exterior_rear_driver-1774714986183.jpg not downloaded yet
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1856%252F19911856%252Fexterior_front_passenger-1774772450909.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1856/19911856/exterior_front_passenger-1774772450909.jpg not downloaded yet
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1856%252F19911856%252Fexterior_rear_passenger-1774714865985.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1856/19911856/exterior_rear_passenger-1774714865985.jpg not downloaded yet
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1856%252F19911856%252Finterior_front_seats-1774716254651.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1856/19911856/interior_front_seats-1774716254651.jpg not downloaded yet
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1856%252F19911856%252Finterior_rear_seats-1774716270322.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1856/19911856/interior_rear_seats-1774716270322.jpg not downloaded yet
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1856%252F19911856%252Finterior_dashboard-1774772467972.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1856/19911856/interior_dashboard-1774772467972.jpg not downloaded yet
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1856%252F19911856%252Finstrument_cluster-1774716192288.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1856/19911856/instrument_cluster-1774716192288.jpg not downloaded yet
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1856%252F19911856%252Finterior_boot-1774716213742.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1856/19911856/interior_boot-1774716213742.jpg not downloaded yet
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1856%252F19911856%252Fdocs_service_history-1774717299097.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da93118f73158513f583bdfcd7d2aa026%27 HTTP/1.1" 200 None
2026-03-29 20:22:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1856/19911856/docs_service_history-1774717299097.jpg?ixlib=js-3.8.0&auto=format&s=a93118f73158513f583bdfcd7d2aa026 not downloaded yet
2026-03-29 20:22:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20199197.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0 with identifier: 20199197
2026-03-29 20:22:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0 with scrape type 1
2026-03-29 20:22:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9197%252F20199197%252Fexterior_front_driver-1774701386102.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9197/20199197/exterior_front_driver-1774701386102.jpg not downloaded yet
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9197%252F20199197%252Fexterior_rear_driver-1774701700740.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9197/20199197/exterior_rear_driver-1774701700740.jpg not downloaded yet
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9197%252F20199197%252Fexterior_front_passenger-1774702175608.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9197/20199197/exterior_front_passenger-1774702175608.jpg not downloaded yet
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9197%252F20199197%252Fexterior_rear_passenger-1774701473082.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9197/20199197/exterior_rear_passenger-1774701473082.jpg not downloaded yet
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9197%252F20199197%252Finterior_front_seats-1774703344608.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9197/20199197/interior_front_seats-1774703344608.jpg not downloaded yet
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9197%252F20199197%252Finterior_rear_seats-1774703405194.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9197/20199197/interior_rear_seats-1774703405194.jpg not downloaded yet
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9197%252F20199197%252Finterior_dashboard-1774703610154.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9197/20199197/interior_dashboard-1774703610154.jpg not downloaded yet
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9197%252F20199197%252Finterior_boot-1774703386670.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9197/20199197/interior_boot-1774703386670.jpg not downloaded yet
2026-03-29 20:22:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9197%252F20199197%252Fdocs_service_history-1774703900738.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9c467f3d141a5e7608848fe41e9bfea2%27 HTTP/1.1" 200 None
2026-03-29 20:22:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9197/20199197/docs_service_history-1774703900738.jpg?ixlib=js-3.8.0&auto=format&s=9c467f3d141a5e7608848fe41e9bfea2 not downloaded yet
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9197%252F20199197%252Fdocs_service_history-1774703992997.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dda7a1057322c5608c6110a65e95e4d65%27 HTTP/1.1" 200 None
2026-03-29 20:22:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9197/20199197/docs_service_history-1774703992997.jpg?ixlib=js-3.8.0&auto=format&s=da7a1057322c5608c6110a65e95e4d65 not downloaded yet
2026-03-29 20:22:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1856/19911856/docs_service_history-1774717299097.jpg?ixlib=js-3.8.0&auto=format&s=a93118f73158513f583bdfcd7d2aa026> (referer: None)
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583f8e10>
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959278b6-4c51-519a-864b-f71846919cdb/959278b6-4c51-519a-864b-f71846919cdb_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1856%252F19911856%252Fdocs_service_history-1774717299097.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Da93118f73158513f583bdfcd7d2aa026') HTTP/1.1" 204 0
2026-03-29 20:22:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1856/19911856/docs_service_history-1774717299097.jpg?ixlib=js-3.8.0&auto=format&s=a93118f73158513f583bdfcd7d2aa026 saved to cache
2026-03-29 20:22:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 959278b6-4c51-519a-864b-f71846919cdb
2026-03-29 20:22:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9197/20199197/docs_service_history-1774703992997.jpg?ixlib=js-3.8.0&auto=format&s=da7a1057322c5608c6110a65e95e4d65> (referer: None)
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582f0710>
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0/e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9197%252F20199197%252Fdocs_service_history-1774703992997.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dda7a1057322c5608c6110a65e95e4d65') HTTP/1.1" 204 0
2026-03-29 20:22:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9197/20199197/docs_service_history-1774703992997.jpg?ixlib=js-3.8.0&auto=format&s=da7a1057322c5608c6110a65e95e4d65 saved to cache
2026-03-29 20:22:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0
2026-03-29 20:22:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9197/20199197/docs_service_history-1774703900738.jpg?ixlib=js-3.8.0&auto=format&s=9c467f3d141a5e7608848fe41e9bfea2> (referer: None)
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf48fd0>
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0/e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9197%252F20199197%252Fdocs_service_history-1774703900738.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D9c467f3d141a5e7608848fe41e9bfea2') HTTP/1.1" 204 0
2026-03-29 20:22:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9197/20199197/docs_service_history-1774703900738.jpg?ixlib=js-3.8.0&auto=format&s=9c467f3d141a5e7608848fe41e9bfea2 saved to cache
2026-03-29 20:22:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0
2026-03-29 20:22:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9197/20199197/interior_boot-1774703386670.jpg> (referer: None)
2026-03-29 20:22:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6582f2c10>
2026-03-29 20:22:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0/e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9197%252F20199197%252Finterior_boot-1774703386670.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9197/20199197/interior_boot-1774703386670.jpg saved to cache
2026-03-29 20:22:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0
2026-03-29 20:22:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9197/20199197/interior_dashboard-1774703610154.jpg> (referer: None)
2026-03-29 20:22:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bce3d0>
2026-03-29 20:22:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0/e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9197%252F20199197%252Finterior_dashboard-1774703610154.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9197/20199197/interior_dashboard-1774703610154.jpg saved to cache
2026-03-29 20:22:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0
2026-03-29 20:22:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9197/20199197/interior_rear_seats-1774703405194.jpg> (referer: None)
2026-03-29 20:22:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583f8850>
2026-03-29 20:22:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0/e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9197%252F20199197%252Finterior_rear_seats-1774703405194.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9197/20199197/interior_rear_seats-1774703405194.jpg saved to cache
2026-03-29 20:22:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0
2026-03-29 20:22:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9197/20199197/interior_front_seats-1774703344608.jpg> (referer: None)
2026-03-29 20:22:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587a5f90>
2026-03-29 20:22:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0/e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9197%252F20199197%252Finterior_front_seats-1774703344608.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9197/20199197/interior_front_seats-1774703344608.jpg saved to cache
2026-03-29 20:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0
2026-03-29 20:22:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9197/20199197/exterior_rear_passenger-1774701473082.jpg> (referer: None)
2026-03-29 20:22:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf4b210>
2026-03-29 20:22:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0/e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9197%252F20199197%252Fexterior_rear_passenger-1774701473082.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9197/20199197/exterior_rear_passenger-1774701473082.jpg saved to cache
2026-03-29 20:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0
2026-03-29 20:22:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9197/20199197/exterior_front_passenger-1774702175608.jpg> (referer: None)
2026-03-29 20:22:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bcf8d0>
2026-03-29 20:22:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0/e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9197%252F20199197%252Fexterior_front_passenger-1774702175608.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9197/20199197/exterior_front_passenger-1774702175608.jpg saved to cache
2026-03-29 20:22:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0
2026-03-29 20:22:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9197/20199197/exterior_rear_driver-1774701700740.jpg> (referer: None)
2026-03-29 20:22:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658409c90>
2026-03-29 20:22:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0/e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9197%252F20199197%252Fexterior_rear_driver-1774701700740.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9197/20199197/exterior_rear_driver-1774701700740.jpg saved to cache
2026-03-29 20:22:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0
2026-03-29 20:22:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9197/20199197/exterior_front_driver-1774701386102.jpg> (referer: None)
2026-03-29 20:22:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583fa750>
2026-03-29 20:22:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0/e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:22:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9197%252F20199197%252Fexterior_front_driver-1774701386102.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9197/20199197/exterior_front_driver-1774701386102.jpg saved to cache
2026-03-29 20:22:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0
2026-03-29 20:22:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0, skipping ID generation
2026-03-29 20:22:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0 with scrape type 1
2026-03-29 20:22:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0 sending to next pipeline
2026-03-29 20:22:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0, identifier: 20199197
2026-03-29 20:22:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0 with identifier: 20199197
2026-03-29 20:22:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0 with identifier: 20199197
2026-03-29 20:22:49 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0 with identifier: 20199197 to the API
2026-03-29 20:22:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/9197/20199197/exterior_front_driver-1774701386102.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'J10 MJL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20199197',
'listing': 'auction',
'location': 'Devon Exeter',
'make': 'Peugeot',
'model': 'Partner',
'odometer': 27000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 19,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0/e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1304696,
'Height': 2347,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9197/20199197/exterior_front_driver-1774701386102.jpg',
'Width': 3129},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0/e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1782204,
'Height': 2669,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9197/20199197/exterior_rear_driver-1774701700740.jpg',
'Width': 3558},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0/e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 835491,
'Height': 2433,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9197/20199197/exterior_front_passenger-1774702175608.jpg',
'Width': 3244},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0/e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1749349,
'Height': 2499,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9197/20199197/exterior_rear_passenger-1774701473082.jpg',
'Width': 3332},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0/e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2486377,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9197/20199197/interior_front_seats-1774703344608.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0/e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1724560,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9197/20199197/interior_rear_seats-1774703405194.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0/e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1927180,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/9197/20199197/interior_dashboard-1774703610154.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0/e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1872598,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/9197/20199197/interior_boot-1774703386670.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0/e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1589782,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9197/20199197/docs_service_history-1774703900738.jpg?ixlib=js-3.8.0&auto=format&s=9c467f3d141a5e7608848fe41e9bfea2',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0/e3eb525b-7eea-54d1-aeaa-1ddffa3f7fa0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1337760,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/9197/20199197/docs_service_history-1774703992997.jpg?ixlib=js-3.8.0&auto=format&s=da7a1057322c5608c6110a65e95e4d65',
'Width': 3840}],
'price': 5146,
'price_includes_vat': False,
'registration_date': '2012-03-14',
'seats_number': None,
'seller_name': None,
'title': 'Peugeot Partner Tepee S e-HDi',
'transmission': 'automatic',
'trim': 'Tepee S e-HDi',
'vin': 'VF37J9HP8BJ809509',
'year': 2012}
2026-03-29 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720199197%27 HTTP/1.1" 200 None
2026-03-29 20:22:50 [motorway.uk] INFO: Saving data for 20199197: {'created_time': 1774815770.011714, 'last_price_update_time': 1774815770.011723, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20199197') HTTP/1.1" 204 0
2026-03-29 20:22:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1856/19911856/interior_boot-1774716213742.jpg> (referer: None)
2026-03-29 20:22:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583f98d0>
2026-03-29 20:22:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959278b6-4c51-519a-864b-f71846919cdb/959278b6-4c51-519a-864b-f71846919cdb_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1856%252F19911856%252Finterior_boot-1774716213742.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1856/19911856/interior_boot-1774716213742.jpg saved to cache
2026-03-29 20:22:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 959278b6-4c51-519a-864b-f71846919cdb
2026-03-29 20:22:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1856/19911856/instrument_cluster-1774716192288.jpg> (referer: None)
2026-03-29 20:22:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf489d0>
2026-03-29 20:22:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959278b6-4c51-519a-864b-f71846919cdb/959278b6-4c51-519a-864b-f71846919cdb_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1856%252F19911856%252Finstrument_cluster-1774716192288.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1856/19911856/instrument_cluster-1774716192288.jpg saved to cache
2026-03-29 20:22:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 959278b6-4c51-519a-864b-f71846919cdb
2026-03-29 20:22:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1856/19911856/interior_dashboard-1774772467972.jpg> (referer: None)
2026-03-29 20:22:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be54190>
2026-03-29 20:22:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959278b6-4c51-519a-864b-f71846919cdb/959278b6-4c51-519a-864b-f71846919cdb_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1856%252F19911856%252Finterior_dashboard-1774772467972.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1856/19911856/interior_dashboard-1774772467972.jpg saved to cache
2026-03-29 20:22:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 959278b6-4c51-519a-864b-f71846919cdb
2026-03-29 20:22:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1856/19911856/interior_rear_seats-1774716270322.jpg> (referer: None)
2026-03-29 20:22:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583f8310>
2026-03-29 20:22:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959278b6-4c51-519a-864b-f71846919cdb/959278b6-4c51-519a-864b-f71846919cdb_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1856%252F19911856%252Finterior_rear_seats-1774716270322.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1856/19911856/interior_rear_seats-1774716270322.jpg saved to cache
2026-03-29 20:22:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 959278b6-4c51-519a-864b-f71846919cdb
2026-03-29 20:22:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1856/19911856/interior_front_seats-1774716254651.jpg> (referer: None)
2026-03-29 20:22:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfbc210>
2026-03-29 20:22:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959278b6-4c51-519a-864b-f71846919cdb/959278b6-4c51-519a-864b-f71846919cdb_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1856%252F19911856%252Finterior_front_seats-1774716254651.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1856/19911856/interior_front_seats-1774716254651.jpg saved to cache
2026-03-29 20:22:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 959278b6-4c51-519a-864b-f71846919cdb
2026-03-29 20:22:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1856/19911856/exterior_rear_passenger-1774714865985.jpg> (referer: None)
2026-03-29 20:22:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bd9b90>
2026-03-29 20:22:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959278b6-4c51-519a-864b-f71846919cdb/959278b6-4c51-519a-864b-f71846919cdb_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1856%252F19911856%252Fexterior_rear_passenger-1774714865985.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1856/19911856/exterior_rear_passenger-1774714865985.jpg saved to cache
2026-03-29 20:22:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 959278b6-4c51-519a-864b-f71846919cdb
2026-03-29 20:22:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/1856/19911856/exterior_front_passenger-1774772450909.jpg> (referer: None)
2026-03-29 20:22:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be55e10>
2026-03-29 20:22:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959278b6-4c51-519a-864b-f71846919cdb/959278b6-4c51-519a-864b-f71846919cdb_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F1856%252F19911856%252Fexterior_front_passenger-1774772450909.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/1856/19911856/exterior_front_passenger-1774772450909.jpg saved to cache
2026-03-29 20:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 959278b6-4c51-519a-864b-f71846919cdb
2026-03-29 20:22:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1856/19911856/exterior_rear_driver-1774714986183.jpg> (referer: None)
2026-03-29 20:22:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c5ae10>
2026-03-29 20:22:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959278b6-4c51-519a-864b-f71846919cdb/959278b6-4c51-519a-864b-f71846919cdb_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1856%252F19911856%252Fexterior_rear_driver-1774714986183.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1856/19911856/exterior_rear_driver-1774714986183.jpg saved to cache
2026-03-29 20:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 959278b6-4c51-519a-864b-f71846919cdb
2026-03-29 20:22:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1856/19911856/exterior_front_driver-1774714980634.jpg> (referer: None)
2026-03-29 20:22:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:22:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be56f10>
2026-03-29 20:22:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:22:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:22:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:22:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_959278b6-4c51-519a-864b-f71846919cdb/959278b6-4c51-519a-864b-f71846919cdb_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1856%252F19911856%252Fexterior_front_driver-1774714980634.jpg') HTTP/1.1" 204 0
2026-03-29 20:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1856/19911856/exterior_front_driver-1774714980634.jpg saved to cache
2026-03-29 20:22:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 959278b6-4c51-519a-864b-f71846919cdb
2026-03-29 20:22:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 959278b6-4c51-519a-864b-f71846919cdb, skipping ID generation
2026-03-29 20:22:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 959278b6-4c51-519a-864b-f71846919cdb with scrape type 1
2026-03-29 20:22:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 959278b6-4c51-519a-864b-f71846919cdb sending to next pipeline
2026-03-29 20:22:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 959278b6-4c51-519a-864b-f71846919cdb, identifier: 19911856
2026-03-29 20:22:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 959278b6-4c51-519a-864b-f71846919cdb with identifier: 19911856
2026-03-29 20:22:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 959278b6-4c51-519a-864b-f71846919cdb with identifier: 19911856
2026-03-29 20:22:52 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 959278b6-4c51-519a-864b-f71846919cdb with identifier: 19911856 to the API
2026-03-29 20:22:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:22:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:22:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1856/19911856/exterior_front_driver-1774714980634.jpg>
{'auction_title': '',
'category': None,
'color': 'White',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '959278b6-4c51-519a-864b-f71846919cdb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'AE67 SRZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19911856',
'listing': 'auction',
'location': 'Plymouth Plymouth',
'make': 'Peugeot',
'model': '3008',
'odometer': 49835,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959278b6-4c51-519a-864b-f71846919cdb/959278b6-4c51-519a-864b-f71846919cdb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 958372,
'Height': 2479,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1856/19911856/exterior_front_driver-1774714980634.jpg',
'Width': 3305},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959278b6-4c51-519a-864b-f71846919cdb/959278b6-4c51-519a-864b-f71846919cdb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 692153,
'Height': 2438,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1856/19911856/exterior_rear_driver-1774714986183.jpg',
'Width': 3251},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959278b6-4c51-519a-864b-f71846919cdb/959278b6-4c51-519a-864b-f71846919cdb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1190564,
'Height': 2490,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1856/19911856/exterior_front_passenger-1774772450909.jpg',
'Width': 3320},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959278b6-4c51-519a-864b-f71846919cdb/959278b6-4c51-519a-864b-f71846919cdb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1151231,
'Height': 2745,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1856/19911856/exterior_rear_passenger-1774714865985.jpg',
'Width': 3660},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959278b6-4c51-519a-864b-f71846919cdb/959278b6-4c51-519a-864b-f71846919cdb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2263914,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1856/19911856/interior_front_seats-1774716254651.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959278b6-4c51-519a-864b-f71846919cdb/959278b6-4c51-519a-864b-f71846919cdb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2209140,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1856/19911856/interior_rear_seats-1774716270322.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959278b6-4c51-519a-864b-f71846919cdb/959278b6-4c51-519a-864b-f71846919cdb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1841525,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/1856/19911856/interior_dashboard-1774772467972.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959278b6-4c51-519a-864b-f71846919cdb/959278b6-4c51-519a-864b-f71846919cdb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1037811,
'Height': 2880,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1856/19911856/instrument_cluster-1774716192288.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959278b6-4c51-519a-864b-f71846919cdb/959278b6-4c51-519a-864b-f71846919cdb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1779415,
'Height': 2880,
'OriginUrl': 'https://motorway-photos.imgix.net/1856/19911856/interior_boot-1774716213742.jpg',
'Width': 3840},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_959278b6-4c51-519a-864b-f71846919cdb/959278b6-4c51-519a-864b-f71846919cdb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 940570,
'Height': 2880,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1856/19911856/docs_service_history-1774717299097.jpg?ixlib=js-3.8.0&auto=format&s=a93118f73158513f583bdfcd7d2aa026',
'Width': 3840}],
'price': 7423,
'price_includes_vat': False,
'registration_date': '2017-09-18',
'seats_number': None,
'seller_name': None,
'title': 'Peugeot 3008 Allure S/S',
'transmission': 'manual',
'trim': 'Allure S/S',
'vin': 'VF3MRHNYHHS220453',
'year': 2017}
2026-03-29 20:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719911856%27 HTTP/1.1" 200 None
2026-03-29 20:22:53 [motorway.uk] INFO: Saving data for 19911856: {'created_time': 1774815773.069051, 'last_price_update_time': 1774815773.069066, 'auction_closing_time': 1774884600.0}
2026-03-29 20:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19911856') HTTP/1.1" 204 0
2026-03-29 20:22:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20489770.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfa4a26a-4b1b-50e6-8813-9ba6a4082dc1 with identifier: 20489770
2026-03-29 20:22:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfa4a26a-4b1b-50e6-8813-9ba6a4082dc1 with scrape type 1
2026-03-29 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bfa4a26a-4b1b-50e6-8813-9ba6a4082dc1
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9770%252F20489770%252Fexterior_front_driver-1774708494583.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9770/20489770/exterior_front_driver-1774708494583.jpg not downloaded yet
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9770%252F20489770%252Fexterior_rear_driver-1774708509418.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9770/20489770/exterior_rear_driver-1774708509418.jpg not downloaded yet
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9770%252F20489770%252Fexterior_front_passenger-1774708529030.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9770/20489770/exterior_front_passenger-1774708529030.jpg not downloaded yet
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9770%252F20489770%252Fexterior_rear_passenger-1774708521084.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9770/20489770/exterior_rear_passenger-1774708521084.jpg not downloaded yet
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9770%252F20489770%252Finterior_front_seats-1774710695371.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9770/20489770/interior_front_seats-1774710695371.jpg not downloaded yet
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9770%252F20489770%252Finterior_rear_seats-1774710739655.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9770/20489770/interior_rear_seats-1774710739655.jpg not downloaded yet
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9770%252F20489770%252Finterior_dashboard-1774710769767.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9770/20489770/interior_dashboard-1774710769767.jpg not downloaded yet
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9770%252F20489770%252Finstrument_cluster-1774710777700.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9770/20489770/instrument_cluster-1774710777700.jpg not downloaded yet
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F9770%252F20489770%252Finterior_boot-1774710772280.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9770/20489770/interior_boot-1774710772280.jpg not downloaded yet
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9770%252F20489770%252Fdocs_service_history-1774710868647.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3e28cd7ffc9b8d4906ce633b3b21d5b4%27 HTTP/1.1" 200 None
2026-03-29 20:22:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9770/20489770/docs_service_history-1774710868647.jpg?ixlib=js-3.8.0&auto=format&s=3e28cd7ffc9b8d4906ce633b3b21d5b4 not downloaded yet
2026-03-29 20:22:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20440595.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:22:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:22:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46daff72-726a-5ddb-94ca-9034a690c724 with identifier: 20440595
2026-03-29 20:22:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46daff72-726a-5ddb-94ca-9034a690c724 with scrape type 1
2026-03-29 20:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 46daff72-726a-5ddb-94ca-9034a690c724
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0595%252F20440595%252Fexterior_front_driver-1774712833606.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0595/20440595/exterior_front_driver-1774712833606.jpg not downloaded yet
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0595%252F20440595%252Fexterior_rear_driver-1774712865389.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0595/20440595/exterior_rear_driver-1774712865389.jpg not downloaded yet
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0595%252F20440595%252Fexterior_front_passenger-1774712919493.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0595/20440595/exterior_front_passenger-1774712919493.jpg not downloaded yet
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0595%252F20440595%252Fexterior_rear_passenger-1774712895863.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0595/20440595/exterior_rear_passenger-1774712895863.jpg not downloaded yet
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0595%252F20440595%252Finterior_front_seats-1774714513292.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0595/20440595/interior_front_seats-1774714513292.jpg not downloaded yet
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:22:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0595%252F20440595%252Finterior_rear_seats-1774714822494.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:22:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0595/20440595/interior_rear_seats-1774714822494.jpg not downloaded yet
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0595%252F20440595%252Finterior_dashboard-1774714596433.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0595/20440595/interior_dashboard-1774714596433.jpg not downloaded yet
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0595%252F20440595%252Finstrument_cluster-1774714542802.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0595/20440595/instrument_cluster-1774714542802.jpg not downloaded yet
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F0595%252F20440595%252Finterior_boot-1774714780559.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0595/20440595/interior_boot-1774714780559.jpg not downloaded yet
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0595%252F20440595%252Fdocs_service_history-1774716299925.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D921a2f47f9c8eb86ba12398f43bf5105%27 HTTP/1.1" 200 None
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0595/20440595/docs_service_history-1774716299925.jpg?ixlib=js-3.8.0&auto=format&s=921a2f47f9c8eb86ba12398f43bf5105 not downloaded yet
2026-03-29 20:23:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/9770/20489770/docs_service_history-1774710868647.jpg?ixlib=js-3.8.0&auto=format&s=3e28cd7ffc9b8d4906ce633b3b21d5b4> (referer: None)
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6599f3210>
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa4a26a-4b1b-50e6-8813-9ba6a4082dc1/bfa4a26a-4b1b-50e6-8813-9ba6a4082dc1_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F9770%252F20489770%252Fdocs_service_history-1774710868647.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D3e28cd7ffc9b8d4906ce633b3b21d5b4') HTTP/1.1" 204 0
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/9770/20489770/docs_service_history-1774710868647.jpg?ixlib=js-3.8.0&auto=format&s=3e28cd7ffc9b8d4906ce633b3b21d5b4 saved to cache
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bfa4a26a-4b1b-50e6-8813-9ba6a4082dc1
2026-03-29 20:23:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/0595/20440595/docs_service_history-1774716299925.jpg?ixlib=js-3.8.0&auto=format&s=921a2f47f9c8eb86ba12398f43bf5105> (referer: None)
2026-03-29 20:23:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659b35b50>
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46daff72-726a-5ddb-94ca-9034a690c724/46daff72-726a-5ddb-94ca-9034a690c724_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F0595%252F20440595%252Fdocs_service_history-1774716299925.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D921a2f47f9c8eb86ba12398f43bf5105') HTTP/1.1" 204 0
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/0595/20440595/docs_service_history-1774716299925.jpg?ixlib=js-3.8.0&auto=format&s=921a2f47f9c8eb86ba12398f43bf5105 saved to cache
2026-03-29 20:23:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 46daff72-726a-5ddb-94ca-9034a690c724
2026-03-29 20:23:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20486910.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:23:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:23:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48a22d81-f240-529d-bfc7-2dec3b53903d with identifier: 20486910
2026-03-29 20:23:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48a22d81-f240-529d-bfc7-2dec3b53903d with scrape type 1
2026-03-29 20:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 48a22d81-f240-529d-bfc7-2dec3b53903d
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6910%252F20486910%252Fexterior_front_driver-1774703884621.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6910/20486910/exterior_front_driver-1774703884621.jpg not downloaded yet
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6910%252F20486910%252Fexterior_rear_driver-1774703896353.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6910/20486910/exterior_rear_driver-1774703896353.jpg not downloaded yet
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6910%252F20486910%252Fexterior_front_passenger-1774703917594.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6910/20486910/exterior_front_passenger-1774703917594.jpg not downloaded yet
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6910%252F20486910%252Fexterior_rear_passenger-1774703909073.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6910/20486910/exterior_rear_passenger-1774703909073.jpg not downloaded yet
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6910%252F20486910%252Finterior_front_seats-1774704554254.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6910/20486910/interior_front_seats-1774704554254.jpg not downloaded yet
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6910%252F20486910%252Finterior_rear_seats-1774704565313.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6910/20486910/interior_rear_seats-1774704565313.jpg not downloaded yet
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6910%252F20486910%252Finterior_dashboard-1774704589345.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6910/20486910/interior_dashboard-1774704589345.jpg not downloaded yet
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6910%252F20486910%252Finterior_boot-1774704592697.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6910/20486910/interior_boot-1774704592697.jpg not downloaded yet
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6910%252F20486910%252Fdocs_service_history-1774704724870.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D84e3983b6447172ec7e230a68055a185%27 HTTP/1.1" 200 None
2026-03-29 20:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6910/20486910/docs_service_history-1774704724870.jpg?ixlib=js-3.8.0&auto=format&s=84e3983b6447172ec7e230a68055a185 not downloaded yet
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6910%252F20486910%252Fdamage_scratches-1774712051081.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6910/20486910/damage_scratches-1774712051081.jpg not downloaded yet
2026-03-29 20:23:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0595/20440595/instrument_cluster-1774714542802.jpg> (referer: None)
2026-03-29 20:23:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fd9790>
2026-03-29 20:23:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46daff72-726a-5ddb-94ca-9034a690c724/46daff72-726a-5ddb-94ca-9034a690c724_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0595%252F20440595%252Finstrument_cluster-1774714542802.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0595/20440595/instrument_cluster-1774714542802.jpg saved to cache
2026-03-29 20:23:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 46daff72-726a-5ddb-94ca-9034a690c724
2026-03-29 20:23:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0595/20440595/interior_boot-1774714780559.jpg> (referer: None)
2026-03-29 20:23:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6910/20486910/damage_scratches-1774712051081.jpg> (referer: None)
2026-03-29 20:23:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fd9350>
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46daff72-726a-5ddb-94ca-9034a690c724/46daff72-726a-5ddb-94ca-9034a690c724_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0595%252F20440595%252Finterior_boot-1774714780559.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0595/20440595/interior_boot-1774714780559.jpg saved to cache
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 46daff72-726a-5ddb-94ca-9034a690c724
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6588156d0>
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48a22d81-f240-529d-bfc7-2dec3b53903d/48a22d81-f240-529d-bfc7-2dec3b53903d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6910%252F20486910%252Fdamage_scratches-1774712051081.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6910/20486910/damage_scratches-1774712051081.jpg saved to cache
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 48a22d81-f240-529d-bfc7-2dec3b53903d
2026-03-29 20:23:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6910/20486910/docs_service_history-1774704724870.jpg?ixlib=js-3.8.0&auto=format&s=84e3983b6447172ec7e230a68055a185> (referer: None)
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a47550>
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48a22d81-f240-529d-bfc7-2dec3b53903d/48a22d81-f240-529d-bfc7-2dec3b53903d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6910%252F20486910%252Fdocs_service_history-1774704724870.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D84e3983b6447172ec7e230a68055a185') HTTP/1.1" 204 0
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6910/20486910/docs_service_history-1774704724870.jpg?ixlib=js-3.8.0&auto=format&s=84e3983b6447172ec7e230a68055a185 saved to cache
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 48a22d81-f240-529d-bfc7-2dec3b53903d
2026-03-29 20:23:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6910/20486910/interior_dashboard-1774704589345.jpg> (referer: None)
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658817bd0>
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48a22d81-f240-529d-bfc7-2dec3b53903d/48a22d81-f240-529d-bfc7-2dec3b53903d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6910%252F20486910%252Finterior_dashboard-1774704589345.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6910/20486910/interior_dashboard-1774704589345.jpg saved to cache
2026-03-29 20:23:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 48a22d81-f240-529d-bfc7-2dec3b53903d
2026-03-29 20:23:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6910/20486910/interior_rear_seats-1774704565313.jpg> (referer: None)
2026-03-29 20:23:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6910/20486910/interior_boot-1774704592697.jpg> (referer: None)
2026-03-29 20:23:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658542150>
2026-03-29 20:23:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48a22d81-f240-529d-bfc7-2dec3b53903d/48a22d81-f240-529d-bfc7-2dec3b53903d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6910%252F20486910%252Finterior_rear_seats-1774704565313.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6910/20486910/interior_rear_seats-1774704565313.jpg saved to cache
2026-03-29 20:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 48a22d81-f240-529d-bfc7-2dec3b53903d
2026-03-29 20:23:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658554810>
2026-03-29 20:23:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48a22d81-f240-529d-bfc7-2dec3b53903d/48a22d81-f240-529d-bfc7-2dec3b53903d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6910%252F20486910%252Finterior_boot-1774704592697.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6910/20486910/interior_boot-1774704592697.jpg saved to cache
2026-03-29 20:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 48a22d81-f240-529d-bfc7-2dec3b53903d
2026-03-29 20:23:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/6910/20486910/interior_front_seats-1774704554254.jpg> (referer: None)
2026-03-29 20:23:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6588147d0>
2026-03-29 20:23:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48a22d81-f240-529d-bfc7-2dec3b53903d/48a22d81-f240-529d-bfc7-2dec3b53903d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F6910%252F20486910%252Finterior_front_seats-1774704554254.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6910/20486910/interior_front_seats-1774704554254.jpg saved to cache
2026-03-29 20:23:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 48a22d81-f240-529d-bfc7-2dec3b53903d
2026-03-29 20:23:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6910/20486910/exterior_rear_passenger-1774703909073.jpg> (referer: None)
2026-03-29 20:23:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6910/20486910/exterior_front_passenger-1774703917594.jpg> (referer: None)
2026-03-29 20:23:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a82b50>
2026-03-29 20:23:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48a22d81-f240-529d-bfc7-2dec3b53903d/48a22d81-f240-529d-bfc7-2dec3b53903d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6910%252F20486910%252Fexterior_rear_passenger-1774703909073.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6910/20486910/exterior_rear_passenger-1774703909073.jpg saved to cache
2026-03-29 20:23:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 48a22d81-f240-529d-bfc7-2dec3b53903d
2026-03-29 20:23:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587ca510>
2026-03-29 20:23:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48a22d81-f240-529d-bfc7-2dec3b53903d/48a22d81-f240-529d-bfc7-2dec3b53903d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6910%252F20486910%252Fexterior_front_passenger-1774703917594.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6910/20486910/exterior_front_passenger-1774703917594.jpg saved to cache
2026-03-29 20:23:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 48a22d81-f240-529d-bfc7-2dec3b53903d
2026-03-29 20:23:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20235127.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:23:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:23:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6910/20486910/exterior_rear_driver-1774703896353.jpg> (referer: None)
2026-03-29 20:23:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/6910/20486910/exterior_front_driver-1774703884621.jpg> (referer: None)
2026-03-29 20:23:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39a93984-921a-5434-9a6a-cabd279b2ec6 with identifier: 20235127
2026-03-29 20:23:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39a93984-921a-5434-9a6a-cabd279b2ec6 with scrape type 2
2026-03-29 20:23:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39a93984-921a-5434-9a6a-cabd279b2ec6 with scrape type 2
2026-03-29 20:23:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 39a93984-921a-5434-9a6a-cabd279b2ec6, identifier: 20235127
2026-03-29 20:23:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 39a93984-921a-5434-9a6a-cabd279b2ec6 with identifier: 20235127
2026-03-29 20:23:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 39a93984-921a-5434-9a6a-cabd279b2ec6 with identifier: 20235127
2026-03-29 20:23:05 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 39a93984-921a-5434-9a6a-cabd279b2ec6 with identifier: 20235127 to the API
2026-03-29 20:23:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:23:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:23:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20235127.json>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '39a93984-921a-5434-9a6a-cabd279b2ec6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GL17 MXM',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20235127',
'listing': 'auction',
'location': 'Glasgow City Glasgow',
'make': 'Skoda',
'model': 'Rapid',
'odometer': 48339,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 4275,
'price_includes_vat': False,
'registration_date': '2017-05-03',
'seats_number': None,
'seller_name': None,
'title': 'Skoda Rapid Spaceback S TSI',
'transmission': 'manual',
'trim': 'Spaceback S TSI',
'vin': 'TMBFA6NH7H4538546',
'year': 2017}
2026-03-29 20:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720235127%27 HTTP/1.1" 200 None
2026-03-29 20:23:05 [motorway.uk] INFO: Saving data for 20235127: {'auction_closing_time': 1774884600.0, 'created_time': 1774471269.329042, 'last_price_update_time': 1774815785.949476}
2026-03-29 20:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20235127') HTTP/1.1" 204 0
2026-03-29 20:23:05 [scrapy.extensions.logstats] INFO: Crawled 395 pages (at 16 pages/min), scraped 238 items (at 14 items/min)
2026-03-29 20:23:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 304MiB
2026-03-29 20:23:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586f7950>
2026-03-29 20:23:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48a22d81-f240-529d-bfc7-2dec3b53903d/48a22d81-f240-529d-bfc7-2dec3b53903d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6910%252F20486910%252Fexterior_rear_driver-1774703896353.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6910/20486910/exterior_rear_driver-1774703896353.jpg saved to cache
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 48a22d81-f240-529d-bfc7-2dec3b53903d
2026-03-29 20:23:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6585424d0>
2026-03-29 20:23:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_48a22d81-f240-529d-bfc7-2dec3b53903d/48a22d81-f240-529d-bfc7-2dec3b53903d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6910%252F20486910%252Fexterior_front_driver-1774703884621.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6910/20486910/exterior_front_driver-1774703884621.jpg saved to cache
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 48a22d81-f240-529d-bfc7-2dec3b53903d
2026-03-29 20:23:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 48a22d81-f240-529d-bfc7-2dec3b53903d, skipping ID generation
2026-03-29 20:23:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48a22d81-f240-529d-bfc7-2dec3b53903d with scrape type 1
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 48a22d81-f240-529d-bfc7-2dec3b53903d sending to next pipeline
2026-03-29 20:23:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 48a22d81-f240-529d-bfc7-2dec3b53903d, identifier: 20486910
2026-03-29 20:23:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 48a22d81-f240-529d-bfc7-2dec3b53903d with identifier: 20486910
2026-03-29 20:23:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 48a22d81-f240-529d-bfc7-2dec3b53903d with identifier: 20486910
2026-03-29 20:23:06 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 48a22d81-f240-529d-bfc7-2dec3b53903d with identifier: 20486910 to the API
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:23:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/6910/20486910/exterior_front_driver-1774703884621.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.1L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Petrol',
'id': '48a22d81-f240-529d-bfc7-2dec3b53903d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'MF67 ZGL',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20486910',
'listing': 'auction',
'location': 'South Yorkshire Sheffield',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 51000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48a22d81-f240-529d-bfc7-2dec3b53903d/48a22d81-f240-529d-bfc7-2dec3b53903d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1395294,
'Height': 2333,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6910/20486910/exterior_front_driver-1774703884621.jpg',
'Width': 3111},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48a22d81-f240-529d-bfc7-2dec3b53903d/48a22d81-f240-529d-bfc7-2dec3b53903d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1211484,
'Height': 2294,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6910/20486910/exterior_rear_driver-1774703896353.jpg',
'Width': 3058},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48a22d81-f240-529d-bfc7-2dec3b53903d/48a22d81-f240-529d-bfc7-2dec3b53903d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1115370,
'Height': 2315,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6910/20486910/exterior_front_passenger-1774703917594.jpg',
'Width': 3087},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48a22d81-f240-529d-bfc7-2dec3b53903d/48a22d81-f240-529d-bfc7-2dec3b53903d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2157344,
'Height': 2981,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6910/20486910/exterior_rear_passenger-1774703909073.jpg',
'Width': 3974},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48a22d81-f240-529d-bfc7-2dec3b53903d/48a22d81-f240-529d-bfc7-2dec3b53903d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2742483,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6910/20486910/interior_front_seats-1774704554254.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48a22d81-f240-529d-bfc7-2dec3b53903d/48a22d81-f240-529d-bfc7-2dec3b53903d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2411455,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6910/20486910/interior_rear_seats-1774704565313.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48a22d81-f240-529d-bfc7-2dec3b53903d/48a22d81-f240-529d-bfc7-2dec3b53903d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1420738,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/6910/20486910/interior_dashboard-1774704589345.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48a22d81-f240-529d-bfc7-2dec3b53903d/48a22d81-f240-529d-bfc7-2dec3b53903d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2937016,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/6910/20486910/interior_boot-1774704592697.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48a22d81-f240-529d-bfc7-2dec3b53903d/48a22d81-f240-529d-bfc7-2dec3b53903d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299687,
'Height': 1384,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/6910/20486910/docs_service_history-1774704724870.jpg?ixlib=js-3.8.0&auto=format&s=84e3983b6447172ec7e230a68055a185',
'Width': 1822},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_48a22d81-f240-529d-bfc7-2dec3b53903d/48a22d81-f240-529d-bfc7-2dec3b53903d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2737923,
'Height': 3367,
'OriginUrl': 'https://motorway-photos-modified.imgix.net/6910/20486910/damage_scratches-1774712051081.jpg',
'Width': 4489}],
'price': 5033,
'price_includes_vat': False,
'registration_date': '2018-02-26',
'seats_number': None,
'seller_name': None,
'title': 'Ford Fiesta Zetec',
'transmission': 'manual',
'trim': 'Zetec',
'vin': 'WF0FXXGAHFJL67510',
'year': 2018}
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720486910%27 HTTP/1.1" 200 None
2026-03-29 20:23:06 [motorway.uk] INFO: Saving data for 20486910: {'created_time': 1774815786.632724, 'last_price_update_time': 1774815786.632734, 'auction_closing_time': 1774884600.0}
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20486910') HTTP/1.1" 204 0
2026-03-29 20:23:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0595/20440595/interior_dashboard-1774714596433.jpg> (referer: None)
2026-03-29 20:23:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0595/20440595/interior_front_seats-1774714513292.jpg> (referer: None)
2026-03-29 20:23:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/0595/20440595/interior_rear_seats-1774714822494.jpg> (referer: None)
2026-03-29 20:23:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587b8110>
2026-03-29 20:23:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46daff72-726a-5ddb-94ca-9034a690c724/46daff72-726a-5ddb-94ca-9034a690c724_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0595%252F20440595%252Finterior_dashboard-1774714596433.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0595/20440595/interior_dashboard-1774714596433.jpg saved to cache
2026-03-29 20:23:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 46daff72-726a-5ddb-94ca-9034a690c724
2026-03-29 20:23:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64be57790>
2026-03-29 20:23:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46daff72-726a-5ddb-94ca-9034a690c724/46daff72-726a-5ddb-94ca-9034a690c724_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0595%252F20440595%252Finterior_front_seats-1774714513292.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0595/20440595/interior_front_seats-1774714513292.jpg saved to cache
2026-03-29 20:23:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 46daff72-726a-5ddb-94ca-9034a690c724
2026-03-29 20:23:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a82950>
2026-03-29 20:23:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46daff72-726a-5ddb-94ca-9034a690c724/46daff72-726a-5ddb-94ca-9034a690c724_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F0595%252F20440595%252Finterior_rear_seats-1774714822494.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/0595/20440595/interior_rear_seats-1774714822494.jpg saved to cache
2026-03-29 20:23:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 46daff72-726a-5ddb-94ca-9034a690c724
2026-03-29 20:23:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0595/20440595/exterior_rear_passenger-1774712895863.jpg> (referer: None)
2026-03-29 20:23:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf13610>
2026-03-29 20:23:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46daff72-726a-5ddb-94ca-9034a690c724/46daff72-726a-5ddb-94ca-9034a690c724_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0595%252F20440595%252Fexterior_rear_passenger-1774712895863.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0595/20440595/exterior_rear_passenger-1774712895863.jpg saved to cache
2026-03-29 20:23:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 46daff72-726a-5ddb-94ca-9034a690c724
2026-03-29 20:23:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0595/20440595/exterior_front_driver-1774712833606.jpg> (referer: None)
2026-03-29 20:23:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0595/20440595/exterior_rear_driver-1774712865389.jpg> (referer: None)
2026-03-29 20:23:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=1620&page=45&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:23:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:23:07 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.117(s), this was the 1st time calling it.
2026-03-29 20:23:07 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.375479276989004 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:23:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6586f4090>
2026-03-29 20:23:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46daff72-726a-5ddb-94ca-9034a690c724/46daff72-726a-5ddb-94ca-9034a690c724_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0595%252F20440595%252Fexterior_front_driver-1774712833606.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0595/20440595/exterior_front_driver-1774712833606.jpg saved to cache
2026-03-29 20:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46daff72-726a-5ddb-94ca-9034a690c724
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65879e450>
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46daff72-726a-5ddb-94ca-9034a690c724/46daff72-726a-5ddb-94ca-9034a690c724_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0595%252F20440595%252Fexterior_rear_driver-1774712865389.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0595/20440595/exterior_rear_driver-1774712865389.jpg saved to cache
2026-03-29 20:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 46daff72-726a-5ddb-94ca-9034a690c724
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 20392033
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720392033%27 HTTP/1.1" 200 None
2026-03-29 20:23:08 [motorway.uk] INFO: Scrape type for 20392033: 1
2026-03-29 20:23:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/0595/20440595/exterior_front_passenger-1774712919493.jpg> (referer: None)
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 6855795
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 6221793
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 16311303
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 20477312
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720477312%27 HTTP/1.1" 200 None
2026-03-29 20:23:08 [motorway.uk] INFO: Scrape type for 20477312: 1
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 20286694
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 20439535
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720439535%27 HTTP/1.1" 200 None
2026-03-29 20:23:08 [motorway.uk] INFO: Scrape type for 20439535: 1
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 19648962
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719648962%27 HTTP/1.1" 200 None
2026-03-29 20:23:08 [motorway.uk] INFO: Scrape type for 19648962: 1
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 20475889
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 19395541
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 20377618
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 13609049
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 20111098
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 20158063
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 20461954
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 20411240
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720411240%27 HTTP/1.1" 200 None
2026-03-29 20:23:08 [motorway.uk] INFO: Scrape type for 20411240: 1
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 20485932
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 20080126
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 10041890
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 19794671
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 20498723
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 19811025
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 7025386
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277025386%27 HTTP/1.1" 200 None
2026-03-29 20:23:08 [motorway.uk] INFO: Scrape type for 7025386: 1
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 20277132
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 17822067
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 2720964
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%272720964%27 HTTP/1.1" 200 None
2026-03-29 20:23:08 [motorway.uk] INFO: Scrape type for 2720964: 1
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfb4390>
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46daff72-726a-5ddb-94ca-9034a690c724/46daff72-726a-5ddb-94ca-9034a690c724_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F0595%252F20440595%252Fexterior_front_passenger-1774712919493.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/0595/20440595/exterior_front_passenger-1774712919493.jpg saved to cache
2026-03-29 20:23:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 46daff72-726a-5ddb-94ca-9034a690c724
2026-03-29 20:23:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46daff72-726a-5ddb-94ca-9034a690c724, skipping ID generation
2026-03-29 20:23:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46daff72-726a-5ddb-94ca-9034a690c724 with scrape type 1
2026-03-29 20:23:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46daff72-726a-5ddb-94ca-9034a690c724 sending to next pipeline
2026-03-29 20:23:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 46daff72-726a-5ddb-94ca-9034a690c724, identifier: 20440595
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 20457137
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 19525497
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 20490195
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 20487725
2026-03-29 20:23:08 [motorway.uk] INFO: Found listing with ID: 20076469
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720076469%27 HTTP/1.1" 200 None
2026-03-29 20:23:08 [motorway.uk] INFO: Scrape type for 20076469: 1
2026-03-29 20:23:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 46daff72-726a-5ddb-94ca-9034a690c724 with identifier: 20440595
2026-03-29 20:23:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 46daff72-726a-5ddb-94ca-9034a690c724 with identifier: 20440595
2026-03-29 20:23:08 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 46daff72-726a-5ddb-94ca-9034a690c724 with identifier: 20440595 to the API
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:23:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:23:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/0595/20440595/exterior_front_passenger-1774712919493.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '2.2L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': '46daff72-726a-5ddb-94ca-9034a690c724',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OU58 XOZ',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20440595',
'listing': 'auction',
'location': 'Buckinghamshire Aylesbury',
'make': 'Toyota',
'model': 'Corolla',
'odometer': 97726,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 34,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46daff72-726a-5ddb-94ca-9034a690c724/46daff72-726a-5ddb-94ca-9034a690c724_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1972732,
'Height': 2526,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0595/20440595/exterior_front_driver-1774712833606.jpg',
'Width': 3368},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46daff72-726a-5ddb-94ca-9034a690c724/46daff72-726a-5ddb-94ca-9034a690c724_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1870051,
'Height': 2519,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0595/20440595/exterior_rear_driver-1774712865389.jpg',
'Width': 3359},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46daff72-726a-5ddb-94ca-9034a690c724/46daff72-726a-5ddb-94ca-9034a690c724_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2236433,
'Height': 2681,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0595/20440595/exterior_front_passenger-1774712919493.jpg',
'Width': 3575},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46daff72-726a-5ddb-94ca-9034a690c724/46daff72-726a-5ddb-94ca-9034a690c724_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1424346,
'Height': 2264,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0595/20440595/exterior_rear_passenger-1774712895863.jpg',
'Width': 3018},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46daff72-726a-5ddb-94ca-9034a690c724/46daff72-726a-5ddb-94ca-9034a690c724_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3725351,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0595/20440595/interior_front_seats-1774714513292.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46daff72-726a-5ddb-94ca-9034a690c724/46daff72-726a-5ddb-94ca-9034a690c724_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3807304,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0595/20440595/interior_rear_seats-1774714822494.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46daff72-726a-5ddb-94ca-9034a690c724/46daff72-726a-5ddb-94ca-9034a690c724_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1778510,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0595/20440595/interior_dashboard-1774714596433.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46daff72-726a-5ddb-94ca-9034a690c724/46daff72-726a-5ddb-94ca-9034a690c724_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2987934,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/0595/20440595/instrument_cluster-1774714542802.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46daff72-726a-5ddb-94ca-9034a690c724/46daff72-726a-5ddb-94ca-9034a690c724_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3435797,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/0595/20440595/interior_boot-1774714780559.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46daff72-726a-5ddb-94ca-9034a690c724/46daff72-726a-5ddb-94ca-9034a690c724_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2227723,
'Height': 2987,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/0595/20440595/docs_service_history-1774716299925.jpg?ixlib=js-3.8.0&auto=format&s=921a2f47f9c8eb86ba12398f43bf5105',
'Width': 2013}],
'price': 634,
'price_includes_vat': False,
'registration_date': '2008-09-19',
'seats_number': None,
'seller_name': None,
'title': 'Toyota Corolla Verso SR D-4D',
'transmission': 'manual',
'trim': 'Verso SR D-4D',
'vin': 'NMTEA16R20R161699',
'year': 2008}
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720440595%27 HTTP/1.1" 200 None
2026-03-29 20:23:09 [motorway.uk] INFO: Saving data for 20440595: {'created_time': 1774815789.041196, 'last_price_update_time': 1774815789.041206, 'auction_closing_time': 1774884600.0}
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20440595') HTTP/1.1" 204 0
2026-03-29 20:23:09 [motorway.uk] INFO: Found listing with ID: 18151907
2026-03-29 20:23:09 [motorway.uk] INFO: Found listing with ID: 20441173
2026-03-29 20:23:09 [motorway.uk] INFO: Found listing with ID: 20363657
2026-03-29 20:23:09 [motorway.uk] INFO: Found listing with ID: 20411608
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720411608%27 HTTP/1.1" 200 None
2026-03-29 20:23:09 [motorway.uk] INFO: Scrape type for 20411608: 1
2026-03-29 20:23:09 [motorway.uk] INFO: Found listing with ID: 19896790
2026-03-29 20:23:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/9770/20489770/interior_boot-1774710772280.jpg> (referer: None)
2026-03-29 20:23:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9770/20489770/instrument_cluster-1774710777700.jpg> (referer: None)
2026-03-29 20:23:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/9770/20489770/interior_dashboard-1774710769767.jpg> (referer: None)
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6583fa290>
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa4a26a-4b1b-50e6-8813-9ba6a4082dc1/bfa4a26a-4b1b-50e6-8813-9ba6a4082dc1_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F9770%252F20489770%252Finterior_boot-1774710772280.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/9770/20489770/interior_boot-1774710772280.jpg saved to cache
2026-03-29 20:23:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bfa4a26a-4b1b-50e6-8813-9ba6a4082dc1
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587a5f90>
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa4a26a-4b1b-50e6-8813-9ba6a4082dc1/bfa4a26a-4b1b-50e6-8813-9ba6a4082dc1_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9770%252F20489770%252Finstrument_cluster-1774710777700.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9770/20489770/instrument_cluster-1774710777700.jpg saved to cache
2026-03-29 20:23:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bfa4a26a-4b1b-50e6-8813-9ba6a4082dc1
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658a1ee90>
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfa4a26a-4b1b-50e6-8813-9ba6a4082dc1/bfa4a26a-4b1b-50e6-8813-9ba6a4082dc1_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F9770%252F20489770%252Finterior_dashboard-1774710769767.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/9770/20489770/interior_dashboard-1774710769767.jpg saved to cache
2026-03-29 20:23:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bfa4a26a-4b1b-50e6-8813-9ba6a4082dc1
2026-03-29 20:23:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:23:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20346452.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:23:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:23:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fde1e44-b3d6-5c01-948a-2d57e6bd156f with identifier: 20346452
2026-03-29 20:23:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fde1e44-b3d6-5c01-948a-2d57e6bd156f with scrape type 1
2026-03-29 20:23:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5fde1e44-b3d6-5c01-948a-2d57e6bd156f
2026-03-29 20:23:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6452%252F20346452%252Fexterior_front_driver-1774693655037.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6452/20346452/exterior_front_driver-1774693655037.jpg not downloaded yet
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6452%252F20346452%252Fexterior_rear_driver-1774693643945.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6452/20346452/exterior_rear_driver-1774693643945.jpg not downloaded yet
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6452%252F20346452%252Fexterior_front_passenger-1774693636474.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6452/20346452/exterior_front_passenger-1774693636474.jpg not downloaded yet
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F6452%252F20346452%252Fexterior_rear_passenger-1774693667523.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/6452/20346452/exterior_rear_passenger-1774693667523.jpg not downloaded yet
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6452%252F20346452%252Finterior_front_seats-1774694911587.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6452/20346452/interior_front_seats-1774694911587.jpg not downloaded yet
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F6452%252F20346452%252Finterior_rear_seats-1774694783598.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/6452/20346452/interior_rear_seats-1774694783598.jpg not downloaded yet
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6452%252F20346452%252Finterior_dashboard-1774697340217.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6452/20346452/interior_dashboard-1774697340217.jpg not downloaded yet
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6452%252F20346452%252Finstrument_cluster-1774697217997.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6452/20346452/instrument_cluster-1774697217997.jpg not downloaded yet
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6452%252F20346452%252Finterior_boot-1774697352079.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6452/20346452/interior_boot-1774697352079.jpg not downloaded yet
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6452%252F20346452%252Fdocs_service_history-1774697571299.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De5f946f3c38131dd596d2272c248fb2e%27 HTTP/1.1" 200 None
2026-03-29 20:23:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6452/20346452/docs_service_history-1774697571299.jpg?ixlib=js-3.8.0&auto=format&s=e5f946f3c38131dd596d2272c248fb2e not downloaded yet
2026-03-29 20:23:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15408464.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:23:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:23:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffa5fa80-2f67-5bcb-828f-ba1896c4da6a with identifier: 15408464
2026-03-29 20:23:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffa5fa80-2f67-5bcb-828f-ba1896c4da6a with scrape type 1
2026-03-29 20:23:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ffa5fa80-2f67-5bcb-828f-ba1896c4da6a
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8464%252F15408464%252Fexterior_front_driver-1774717414473.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8464/15408464/exterior_front_driver-1774717414473.jpg not downloaded yet
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8464%252F15408464%252Fexterior_rear_driver-1774717474411.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8464/15408464/exterior_rear_driver-1774717474411.jpg not downloaded yet
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8464%252F15408464%252Fexterior_front_passenger-1774717505235.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8464/15408464/exterior_front_passenger-1774717505235.jpg not downloaded yet
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8464%252F15408464%252Fexterior_rear_passenger-1774717526293.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8464/15408464/exterior_rear_passenger-1774717526293.jpg not downloaded yet
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8464%252F15408464%252Finterior_front_seats-1774718071855.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8464/15408464/interior_front_seats-1774718071855.jpg not downloaded yet
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8464%252F15408464%252Finterior_rear_seats-1774718094911.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8464/15408464/interior_rear_seats-1774718094911.jpg not downloaded yet
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8464%252F15408464%252Finterior_dashboard-1774718129679.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8464/15408464/interior_dashboard-1774718129679.jpg not downloaded yet
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F8464%252F15408464%252Finterior_boot-1774718203382.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8464/15408464/interior_boot-1774718203382.jpg not downloaded yet
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8464%252F15408464%252Fdocs_service_history-1774719135912.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dba9e102f0f5f714b826edcd61dedf1f4%27 HTTP/1.1" 200 None
2026-03-29 20:23:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8464/15408464/docs_service_history-1774719135912.jpg?ixlib=js-3.8.0&auto=format&s=ba9e102f0f5f714b826edcd61dedf1f4 not downloaded yet
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8464%252F15408464%252Fdocs_service_history-1774719136043.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D20b6b9fb0b9fac58f0e27ccc9f1e724c%27 HTTP/1.1" 200 None
2026-03-29 20:23:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8464/15408464/docs_service_history-1774719136043.jpg?ixlib=js-3.8.0&auto=format&s=20b6b9fb0b9fac58f0e27ccc9f1e724c not downloaded yet
2026-03-29 20:23:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/6452/20346452/docs_service_history-1774697571299.jpg?ixlib=js-3.8.0&auto=format&s=e5f946f3c38131dd596d2272c248fb2e> (referer: None)
2026-03-29 20:23:15 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: short (3) - value: b'\x04\xb0'
2026-03-29 20:23:15 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 74 - value: b'ALI-NX1\x00'
2026-03-29 20:23:15 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: short (3) - value: b'\n\\'
2026-03-29 20:23:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00R'
2026-03-29 20:23:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: long (4) - value: b'\x00\x00\x00\x00'
2026-03-29 20:23:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658bd8f10>
2026-03-29 20:23:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fde1e44-b3d6-5c01-948a-2d57e6bd156f/5fde1e44-b3d6-5c01-948a-2d57e6bd156f_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F6452%252F20346452%252Fdocs_service_history-1774697571299.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3De5f946f3c38131dd596d2272c248fb2e') HTTP/1.1" 204 0
2026-03-29 20:23:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/6452/20346452/docs_service_history-1774697571299.jpg?ixlib=js-3.8.0&auto=format&s=e5f946f3c38131dd596d2272c248fb2e saved to cache
2026-03-29 20:23:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5fde1e44-b3d6-5c01-948a-2d57e6bd156f
2026-03-29 20:23:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8464/15408464/docs_service_history-1774719136043.jpg?ixlib=js-3.8.0&auto=format&s=20b6b9fb0b9fac58f0e27ccc9f1e724c> (referer: None)
2026-03-29 20:23:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659c58090>
2026-03-29 20:23:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffa5fa80-2f67-5bcb-828f-ba1896c4da6a/ffa5fa80-2f67-5bcb-828f-ba1896c4da6a_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8464%252F15408464%252Fdocs_service_history-1774719136043.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3D20b6b9fb0b9fac58f0e27ccc9f1e724c') HTTP/1.1" 204 0
2026-03-29 20:23:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8464/15408464/docs_service_history-1774719136043.jpg?ixlib=js-3.8.0&auto=format&s=20b6b9fb0b9fac58f0e27ccc9f1e724c saved to cache
2026-03-29 20:23:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ffa5fa80-2f67-5bcb-828f-ba1896c4da6a
2026-03-29 20:23:16 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.162(s), this was the 1st time calling it.
2026-03-29 20:23:16 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.03326955162286 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 20:23:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/8464/15408464/docs_service_history-1774719135912.jpg?ixlib=js-3.8.0&auto=format&s=ba9e102f0f5f714b826edcd61dedf1f4> (referer: None)
2026-03-29 20:23:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf5c910>
2026-03-29 20:23:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffa5fa80-2f67-5bcb-828f-ba1896c4da6a/ffa5fa80-2f67-5bcb-828f-ba1896c4da6a_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F8464%252F15408464%252Fdocs_service_history-1774719135912.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dba9e102f0f5f714b826edcd61dedf1f4') HTTP/1.1" 204 0
2026-03-29 20:23:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/8464/15408464/docs_service_history-1774719135912.jpg?ixlib=js-3.8.0&auto=format&s=ba9e102f0f5f714b826edcd61dedf1f4 saved to cache
2026-03-29 20:23:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ffa5fa80-2f67-5bcb-828f-ba1896c4da6a
2026-03-29 20:23:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8464/15408464/interior_boot-1774718203382.jpg> (referer: None)
2026-03-29 20:23:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f841d0>
2026-03-29 20:23:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffa5fa80-2f67-5bcb-828f-ba1896c4da6a/ffa5fa80-2f67-5bcb-828f-ba1896c4da6a_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8464%252F15408464%252Finterior_boot-1774718203382.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8464/15408464/interior_boot-1774718203382.jpg saved to cache
2026-03-29 20:23:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ffa5fa80-2f67-5bcb-828f-ba1896c4da6a
2026-03-29 20:23:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8464/15408464/interior_dashboard-1774718129679.jpg> (referer: None)
2026-03-29 20:23:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf5c810>
2026-03-29 20:23:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffa5fa80-2f67-5bcb-828f-ba1896c4da6a/ffa5fa80-2f67-5bcb-828f-ba1896c4da6a_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:23:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8464%252F15408464%252Finterior_dashboard-1774718129679.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8464/15408464/interior_dashboard-1774718129679.jpg saved to cache
2026-03-29 20:23:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ffa5fa80-2f67-5bcb-828f-ba1896c4da6a
2026-03-29 20:23:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8464/15408464/interior_rear_seats-1774718094911.jpg> (referer: None)
2026-03-29 20:23:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19871725.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 20:23:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 20:23:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587c8850>
2026-03-29 20:23:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffa5fa80-2f67-5bcb-828f-ba1896c4da6a/ffa5fa80-2f67-5bcb-828f-ba1896c4da6a_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8464%252F15408464%252Finterior_rear_seats-1774718094911.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8464/15408464/interior_rear_seats-1774718094911.jpg saved to cache
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ffa5fa80-2f67-5bcb-828f-ba1896c4da6a
2026-03-29 20:23:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b998e180-b47e-5b7c-8a28-eda8a23e874d with identifier: 19871725
2026-03-29 20:23:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b998e180-b47e-5b7c-8a28-eda8a23e874d with scrape type 1
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b998e180-b47e-5b7c-8a28-eda8a23e874d
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1725%252F19871725%252Fexterior_front_driver-1774714697114.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1725/19871725/exterior_front_driver-1774714697114.jpg not downloaded yet
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1725%252F19871725%252Fexterior_rear_driver-1774714712428.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1725/19871725/exterior_rear_driver-1774714712428.jpg not downloaded yet
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1725%252F19871725%252Fexterior_front_passenger-1774714725476.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1725/19871725/exterior_front_passenger-1774714725476.jpg not downloaded yet
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1725%252F19871725%252Fexterior_rear_passenger-1774714720758.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1725/19871725/exterior_rear_passenger-1774714720758.jpg not downloaded yet
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1725%252F19871725%252Finterior_front_seats-1774715087163.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1725/19871725/interior_front_seats-1774715087163.jpg not downloaded yet
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1725%252F19871725%252Finterior_rear_seats-1774715126656.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1725/19871725/interior_rear_seats-1774715126656.jpg not downloaded yet
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1725%252F19871725%252Finterior_dashboard-1774715168456.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1725/19871725/interior_dashboard-1774715168456.jpg not downloaded yet
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1725%252F19871725%252Finstrument_cluster-1774715189176.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1725/19871725/instrument_cluster-1774715189176.jpg not downloaded yet
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-photos.imgix.net%252F1725%252F19871725%252Finterior_boot-1774715285363.jpg%27 HTTP/1.1" 200 None
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1725/19871725/interior_boot-1774715285363.jpg not downloaded yet
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1725%252F19871725%252Fdocs_service_history-1774715842976.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd47de0a6e191bc0c5be5f527b7fc4401%27 HTTP/1.1" 200 None
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1725/19871725/docs_service_history-1774715842976.jpg?ixlib=js-3.8.0&auto=format&s=d47de0a6e191bc0c5be5f527b7fc4401 not downloaded yet
2026-03-29 20:23:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8464/15408464/exterior_rear_passenger-1774717526293.jpg> (referer: None)
2026-03-29 20:23:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/8464/15408464/interior_front_seats-1774718071855.jpg> (referer: None)
2026-03-29 20:23:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658f69290>
2026-03-29 20:23:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffa5fa80-2f67-5bcb-828f-ba1896c4da6a/ffa5fa80-2f67-5bcb-828f-ba1896c4da6a_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8464%252F15408464%252Fexterior_rear_passenger-1774717526293.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8464/15408464/exterior_rear_passenger-1774717526293.jpg saved to cache
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ffa5fa80-2f67-5bcb-828f-ba1896c4da6a
2026-03-29 20:23:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bed7550>
2026-03-29 20:23:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffa5fa80-2f67-5bcb-828f-ba1896c4da6a/ffa5fa80-2f67-5bcb-828f-ba1896c4da6a_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F8464%252F15408464%252Finterior_front_seats-1774718071855.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/8464/15408464/interior_front_seats-1774718071855.jpg saved to cache
2026-03-29 20:23:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ffa5fa80-2f67-5bcb-828f-ba1896c4da6a
2026-03-29 20:23:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-service-history-photos.imgix.net/redacted/oriented/1725/19871725/docs_service_history-1774715842976.jpg?ixlib=js-3.8.0&auto=format&s=d47de0a6e191bc0c5be5f527b7fc4401> (referer: None)
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658699490>
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b998e180-b47e-5b7c-8a28-eda8a23e874d/b998e180-b47e-5b7c-8a28-eda8a23e874d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-service-history-photos.imgix.net%252Fredacted%252Foriented%252F1725%252F19871725%252Fdocs_service_history-1774715842976.jpg%253Fixlib%3Djs-3.8.0%26auto%3Dformat%26s%3Dd47de0a6e191bc0c5be5f527b7fc4401') HTTP/1.1" 204 0
2026-03-29 20:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-service-history-photos.imgix.net/redacted/oriented/1725/19871725/docs_service_history-1774715842976.jpg?ixlib=js-3.8.0&auto=format&s=d47de0a6e191bc0c5be5f527b7fc4401 saved to cache
2026-03-29 20:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b998e180-b47e-5b7c-8a28-eda8a23e874d
2026-03-29 20:23:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1725/19871725/interior_boot-1774715285363.jpg> (referer: None)
2026-03-29 20:23:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1725/19871725/instrument_cluster-1774715189176.jpg> (referer: None)
2026-03-29 20:23:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bed4510>
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b998e180-b47e-5b7c-8a28-eda8a23e874d/b998e180-b47e-5b7c-8a28-eda8a23e874d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1725%252F19871725%252Finterior_boot-1774715285363.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1725/19871725/interior_boot-1774715285363.jpg saved to cache
2026-03-29 20:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b998e180-b47e-5b7c-8a28-eda8a23e874d
2026-03-29 20:23:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659cedf90>
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b998e180-b47e-5b7c-8a28-eda8a23e874d/b998e180-b47e-5b7c-8a28-eda8a23e874d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1725%252F19871725%252Finstrument_cluster-1774715189176.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1725/19871725/instrument_cluster-1774715189176.jpg saved to cache
2026-03-29 20:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b998e180-b47e-5b7c-8a28-eda8a23e874d
2026-03-29 20:23:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1725/19871725/interior_dashboard-1774715168456.jpg> (referer: None)
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658408850>
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b998e180-b47e-5b7c-8a28-eda8a23e874d/b998e180-b47e-5b7c-8a28-eda8a23e874d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1725%252F19871725%252Finterior_dashboard-1774715168456.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1725/19871725/interior_dashboard-1774715168456.jpg saved to cache
2026-03-29 20:23:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b998e180-b47e-5b7c-8a28-eda8a23e874d
2026-03-29 20:23:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1725/19871725/interior_front_seats-1774715087163.jpg> (referer: None)
2026-03-29 20:23:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos.imgix.net/1725/19871725/interior_rear_seats-1774715126656.jpg> (referer: None)
2026-03-29 20:23:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfd2450>
2026-03-29 20:23:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b998e180-b47e-5b7c-8a28-eda8a23e874d/b998e180-b47e-5b7c-8a28-eda8a23e874d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1725%252F19871725%252Finterior_front_seats-1774715087163.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1725/19871725/interior_front_seats-1774715087163.jpg saved to cache
2026-03-29 20:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b998e180-b47e-5b7c-8a28-eda8a23e874d
2026-03-29 20:23:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-29 20:23:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-29 20:23:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-29 20:23:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-29 20:23:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a15b90>
2026-03-29 20:23:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b998e180-b47e-5b7c-8a28-eda8a23e874d/b998e180-b47e-5b7c-8a28-eda8a23e874d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos.imgix.net%252F1725%252F19871725%252Finterior_rear_seats-1774715126656.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos.imgix.net/1725/19871725/interior_rear_seats-1774715126656.jpg saved to cache
2026-03-29 20:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b998e180-b47e-5b7c-8a28-eda8a23e874d
2026-03-29 20:23:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1725/19871725/exterior_rear_passenger-1774714720758.jpg> (referer: None)
2026-03-29 20:23:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bfd04d0>
2026-03-29 20:23:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b998e180-b47e-5b7c-8a28-eda8a23e874d/b998e180-b47e-5b7c-8a28-eda8a23e874d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1725%252F19871725%252Fexterior_rear_passenger-1774714720758.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1725/19871725/exterior_rear_passenger-1774714720758.jpg saved to cache
2026-03-29 20:23:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b998e180-b47e-5b7c-8a28-eda8a23e874d
2026-03-29 20:23:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1725/19871725/exterior_front_passenger-1774714725476.jpg> (referer: None)
2026-03-29 20:23:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1725/19871725/exterior_rear_driver-1774714712428.jpg> (referer: None)
2026-03-29 20:23:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa659a15a90>
2026-03-29 20:23:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b998e180-b47e-5b7c-8a28-eda8a23e874d/b998e180-b47e-5b7c-8a28-eda8a23e874d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1725%252F19871725%252Fexterior_front_passenger-1774714725476.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1725/19871725/exterior_front_passenger-1774714725476.jpg saved to cache
2026-03-29 20:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b998e180-b47e-5b7c-8a28-eda8a23e874d
2026-03-29 20:23:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fd81d0>
2026-03-29 20:23:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b998e180-b47e-5b7c-8a28-eda8a23e874d/b998e180-b47e-5b7c-8a28-eda8a23e874d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1725%252F19871725%252Fexterior_rear_driver-1774714712428.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1725/19871725/exterior_rear_driver-1774714712428.jpg saved to cache
2026-03-29 20:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b998e180-b47e-5b7c-8a28-eda8a23e874d
2026-03-29 20:23:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/1725/19871725/exterior_front_driver-1774714697114.jpg> (referer: None)
2026-03-29 20:23:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 20:23:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa6587a6010>
2026-03-29 20:23:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b998e180-b47e-5b7c-8a28-eda8a23e874d/b998e180-b47e-5b7c-8a28-eda8a23e874d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F1725%252F19871725%252Fexterior_front_driver-1774714697114.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/1725/19871725/exterior_front_driver-1774714697114.jpg saved to cache
2026-03-29 20:23:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b998e180-b47e-5b7c-8a28-eda8a23e874d
2026-03-29 20:23:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b998e180-b47e-5b7c-8a28-eda8a23e874d, skipping ID generation
2026-03-29 20:23:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b998e180-b47e-5b7c-8a28-eda8a23e874d with scrape type 1
2026-03-29 20:23:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b998e180-b47e-5b7c-8a28-eda8a23e874d sending to next pipeline
2026-03-29 20:23:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b998e180-b47e-5b7c-8a28-eda8a23e874d, identifier: 19871725
2026-03-29 20:23:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b998e180-b47e-5b7c-8a28-eda8a23e874d with identifier: 19871725
2026-03-29 20:23:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b998e180-b47e-5b7c-8a28-eda8a23e874d with identifier: 19871725
2026-03-29 20:23:21 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b998e180-b47e-5b7c-8a28-eda8a23e874d with identifier: 19871725 to the API
2026-03-29 20:23:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:23:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:23:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/1725/19871725/exterior_front_driver-1774714697114.jpg>
{'auction_title': '',
'category': None,
'color': 'Silver',
'currency': 'GBP',
'doors_number': None,
'engine': '1.6L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'b998e180-b47e-5b7c-8a28-eda8a23e874d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'MK14 ADO',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19871725',
'listing': 'auction',
'location': 'Essex Chelmsford',
'make': 'Ford',
'model': 'Focus',
'odometer': 61000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b998e180-b47e-5b7c-8a28-eda8a23e874d/b998e180-b47e-5b7c-8a28-eda8a23e874d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1544016,
'Height': 2753,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1725/19871725/exterior_front_driver-1774714697114.jpg',
'Width': 3671},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b998e180-b47e-5b7c-8a28-eda8a23e874d/b998e180-b47e-5b7c-8a28-eda8a23e874d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1476301,
'Height': 2572,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1725/19871725/exterior_rear_driver-1774714712428.jpg',
'Width': 3429},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b998e180-b47e-5b7c-8a28-eda8a23e874d/b998e180-b47e-5b7c-8a28-eda8a23e874d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1641579,
'Height': 2756,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1725/19871725/exterior_front_passenger-1774714725476.jpg',
'Width': 3675},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b998e180-b47e-5b7c-8a28-eda8a23e874d/b998e180-b47e-5b7c-8a28-eda8a23e874d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1877588,
'Height': 2991,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1725/19871725/exterior_rear_passenger-1774714720758.jpg',
'Width': 3988},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b998e180-b47e-5b7c-8a28-eda8a23e874d/b998e180-b47e-5b7c-8a28-eda8a23e874d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3122261,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1725/19871725/interior_front_seats-1774715087163.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b998e180-b47e-5b7c-8a28-eda8a23e874d/b998e180-b47e-5b7c-8a28-eda8a23e874d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3588917,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1725/19871725/interior_rear_seats-1774715126656.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b998e180-b47e-5b7c-8a28-eda8a23e874d/b998e180-b47e-5b7c-8a28-eda8a23e874d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1501086,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1725/19871725/interior_dashboard-1774715168456.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b998e180-b47e-5b7c-8a28-eda8a23e874d/b998e180-b47e-5b7c-8a28-eda8a23e874d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2370287,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/1725/19871725/instrument_cluster-1774715189176.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b998e180-b47e-5b7c-8a28-eda8a23e874d/b998e180-b47e-5b7c-8a28-eda8a23e874d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3203954,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/1725/19871725/interior_boot-1774715285363.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b998e180-b47e-5b7c-8a28-eda8a23e874d/b998e180-b47e-5b7c-8a28-eda8a23e874d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 557602,
'Height': 2733,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/1725/19871725/docs_service_history-1774715842976.jpg?ixlib=js-3.8.0&auto=format&s=d47de0a6e191bc0c5be5f527b7fc4401',
'Width': 1886}],
'price': 3498,
'price_includes_vat': False,
'registration_date': '2014-03-01',
'seats_number': None,
'seller_name': None,
'title': 'Ford Focus Titanium Navigator TDCI',
'transmission': 'manual',
'trim': 'Titanium Navigator TDCI',
'vin': 'WF0KXXGCBKEL65736',
'year': 2014}
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719871725%27 HTTP/1.1" 200 None
2026-03-29 20:23:22 [motorway.uk] INFO: Saving data for 19871725: {'created_time': 1774815802.066701, 'last_price_update_time': 1774815802.066712, 'auction_closing_time': 1774884600.0}
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19871725') HTTP/1.1" 204 0
2026-03-29 20:23:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8464/15408464/exterior_front_passenger-1774717505235.jpg> (referer: None)
2026-03-29 20:23:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8464/15408464/exterior_rear_driver-1774717474411.jpg> (referer: None)
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658fd9210>
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffa5fa80-2f67-5bcb-828f-ba1896c4da6a/ffa5fa80-2f67-5bcb-828f-ba1896c4da6a_image_2.jpg HTTP/1.1" 201 0
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8464%252F15408464%252Fexterior_front_passenger-1774717505235.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8464/15408464/exterior_front_passenger-1774717505235.jpg saved to cache
2026-03-29 20:23:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ffa5fa80-2f67-5bcb-828f-ba1896c4da6a
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bf4b5d0>
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffa5fa80-2f67-5bcb-828f-ba1896c4da6a/ffa5fa80-2f67-5bcb-828f-ba1896c4da6a_image_1.jpg HTTP/1.1" 201 0
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8464%252F15408464%252Fexterior_rear_driver-1774717474411.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8464/15408464/exterior_rear_driver-1774717474411.jpg saved to cache
2026-03-29 20:23:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ffa5fa80-2f67-5bcb-828f-ba1896c4da6a
2026-03-29 20:23:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6452/20346452/interior_boot-1774697352079.jpg> (referer: None)
2026-03-29 20:23:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-redacted.imgix.net/8464/15408464/exterior_front_driver-1774717414473.jpg> (referer: None)
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65840b110>
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fde1e44-b3d6-5c01-948a-2d57e6bd156f/5fde1e44-b3d6-5c01-948a-2d57e6bd156f_image_8.jpg HTTP/1.1" 201 0
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6452%252F20346452%252Finterior_boot-1774697352079.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6452/20346452/interior_boot-1774697352079.jpg saved to cache
2026-03-29 20:23:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5fde1e44-b3d6-5c01-948a-2d57e6bd156f
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa658540310>
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffa5fa80-2f67-5bcb-828f-ba1896c4da6a/ffa5fa80-2f67-5bcb-828f-ba1896c4da6a_image_0.jpg HTTP/1.1" 201 0
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-redacted.imgix.net%252F8464%252F15408464%252Fexterior_front_driver-1774717414473.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-redacted.imgix.net/8464/15408464/exterior_front_driver-1774717414473.jpg saved to cache
2026-03-29 20:23:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ffa5fa80-2f67-5bcb-828f-ba1896c4da6a
2026-03-29 20:23:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ffa5fa80-2f67-5bcb-828f-ba1896c4da6a, skipping ID generation
2026-03-29 20:23:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffa5fa80-2f67-5bcb-828f-ba1896c4da6a with scrape type 1
2026-03-29 20:23:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ffa5fa80-2f67-5bcb-828f-ba1896c4da6a sending to next pipeline
2026-03-29 20:23:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ffa5fa80-2f67-5bcb-828f-ba1896c4da6a, identifier: 15408464
2026-03-29 20:23:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ffa5fa80-2f67-5bcb-828f-ba1896c4da6a with identifier: 15408464
2026-03-29 20:23:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ffa5fa80-2f67-5bcb-828f-ba1896c4da6a with identifier: 15408464
2026-03-29 20:23:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ffa5fa80-2f67-5bcb-828f-ba1896c4da6a with identifier: 15408464 to the API
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 20:23:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://motorway-photos-redacted.imgix.net/8464/15408464/exterior_front_driver-1774717414473.jpg>
{'auction_title': '',
'category': None,
'color': 'Grey',
'currency': 'GBP',
'doors_number': None,
'engine': '1.5L',
'engine_horse_power': None,
'expiration_date': '2026-03-30T15:30:00Z',
'fuel_type': 'Diesel',
'id': 'ffa5fa80-2f67-5bcb-828f-ba1896c4da6a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': None,
'is_vat_included': False,
'license_plate': 'T30 LTP',
'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/15408464',
'listing': 'auction',
'location': 'East Riding of Yorkshire Brough',
'make': 'Peugeot',
'model': '508',
'odometer': 99300,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 20,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffa5fa80-2f67-5bcb-828f-ba1896c4da6a/ffa5fa80-2f67-5bcb-828f-ba1896c4da6a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1586709,
'Height': 2489,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8464/15408464/exterior_front_driver-1774717414473.jpg',
'Width': 3318},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffa5fa80-2f67-5bcb-828f-ba1896c4da6a/ffa5fa80-2f67-5bcb-828f-ba1896c4da6a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1171918,
'Height': 2482,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8464/15408464/exterior_rear_driver-1774717474411.jpg',
'Width': 3309},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffa5fa80-2f67-5bcb-828f-ba1896c4da6a/ffa5fa80-2f67-5bcb-828f-ba1896c4da6a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2061269,
'Height': 2650,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8464/15408464/exterior_front_passenger-1774717505235.jpg',
'Width': 3533},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffa5fa80-2f67-5bcb-828f-ba1896c4da6a/ffa5fa80-2f67-5bcb-828f-ba1896c4da6a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2186200,
'Height': 2829,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8464/15408464/exterior_rear_passenger-1774717526293.jpg',
'Width': 3772},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffa5fa80-2f67-5bcb-828f-ba1896c4da6a/ffa5fa80-2f67-5bcb-828f-ba1896c4da6a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3180473,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8464/15408464/interior_front_seats-1774718071855.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffa5fa80-2f67-5bcb-828f-ba1896c4da6a/ffa5fa80-2f67-5bcb-828f-ba1896c4da6a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3612965,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8464/15408464/interior_rear_seats-1774718094911.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffa5fa80-2f67-5bcb-828f-ba1896c4da6a/ffa5fa80-2f67-5bcb-828f-ba1896c4da6a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3032781,
'Height': 3024,
'OriginUrl': 'https://motorway-photos-redacted.imgix.net/8464/15408464/interior_dashboard-1774718129679.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffa5fa80-2f67-5bcb-828f-ba1896c4da6a/ffa5fa80-2f67-5bcb-828f-ba1896c4da6a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2139717,
'Height': 3024,
'OriginUrl': 'https://motorway-photos.imgix.net/8464/15408464/interior_boot-1774718203382.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffa5fa80-2f67-5bcb-828f-ba1896c4da6a/ffa5fa80-2f67-5bcb-828f-ba1896c4da6a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 892613,
'Height': 2007,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8464/15408464/docs_service_history-1774719135912.jpg?ixlib=js-3.8.0&auto=format&s=ba9e102f0f5f714b826edcd61dedf1f4',
'Width': 3490},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffa5fa80-2f67-5bcb-828f-ba1896c4da6a/ffa5fa80-2f67-5bcb-828f-ba1896c4da6a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1267884,
'Height': 2703,
'OriginUrl': 'https://motorway-service-history-photos.imgix.net/redacted/oriented/8464/15408464/docs_service_history-1774719136043.jpg?ixlib=js-3.8.0&auto=format&s=20b6b9fb0b9fac58f0e27ccc9f1e724c',
'Width': 4293}],
'price': 6760,
'price_includes_vat': False,
'registration_date': '2020-10-30',
'seats_number': None,
'seller_name': None,
'title': 'Peugeot 508 GT Line SW BlueHDi S/S',
'transmission': 'manual',
'trim': 'GT Line SW BlueHDi S/S',
'vin': 'VR3FCYHZJLY036376',
'year': 2020}
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715408464%27 HTTP/1.1" 200 None
2026-03-29 20:23:23 [motorway.uk] INFO: Saving data for 15408464: {'created_time': 1774815803.373866, 'last_price_update_time': 1774815803.373877, 'auction_closing_time': 1774884600.0}
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='15408464') HTTP/1.1" 204 0
2026-03-29 20:23:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6452/20346452/instrument_cluster-1774697217997.jpg> (referer: None)
2026-03-29 20:23:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://motorway-photos-modified.imgix.net/6452/20346452/interior_dashboard-1774697340217.jpg> (referer: None)
2026-03-29 20:23:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa64bed68d0>
2026-03-29 20:23:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fde1e44-b3d6-5c01-948a-2d57e6bd156f/5fde1e44-b3d6-5c01-948a-2d57e6bd156f_image_7.jpg HTTP/1.1" 201 0
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6452%252F20346452%252Finstrument_cluster-1774697217997.jpg') HTTP/1.1" 204 0
2026-03-29 20:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://motorway-photos-modified.imgix.net/6452/20346452/instrument_cluster-1774697217997.jpg saved to cache
2026-03-29 20:23:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5fde1e44-b3d6-5c01-948a-2d57e6bd156f
2026-03-29 20:23:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 20:23:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fa65840a110>
2026-03-29 20:23:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 20:23:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fde1e44-b3d6-5c01-948a-2d57e6bd156f/5fde1e44-b3d6-5c01-948a-2d57e6bd156f_image_6.jpg HTTP/1.1" 201 0
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 20:23:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='motorway.uk',RowKey='https%3A%252F%252Fmotorway-photos-modified.imgix.net%252F6452%252F20346452%252Finterior_dashboard-1774697340217.jpg') HTTP/1.1"